-- Logs begin at Thu 2022-03-10 03:21:43 UTC, end at Thu 2022-03-10 04:54:29 UTC. -- Mar 10 03:54:59.608922 dv-cinder-778193-25-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Mar 10 03:54:59.623708 dv-cinder-778193-25-iscsi devstack@keystone.service[79546]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Mar 10 03:54:59.623708 dv-cinder-778193-25-iscsi devstack@keystone.service[79546]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Mar 10 03:54:59 2022] *** Mar 10 03:54:59.623708 dv-cinder-778193-25-iscsi devstack@keystone.service[79546]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 10 03:54:59.623708 dv-cinder-778193-25-iscsi devstack@keystone.service[79546]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 10 03:54:59.623708 dv-cinder-778193-25-iscsi devstack@keystone.service[79546]: nodename: dv-cinder-778193-25-iscsi Mar 10 03:54:59.623708 dv-cinder-778193-25-iscsi devstack@keystone.service[79546]: machine: x86_64 Mar 10 03:54:59.623708 dv-cinder-778193-25-iscsi devstack@keystone.service[79546]: clock source: unix Mar 10 03:54:59.623708 dv-cinder-778193-25-iscsi devstack@keystone.service[79546]: pcre jit disabled Mar 10 03:54:59.623708 dv-cinder-778193-25-iscsi devstack@keystone.service[79546]: detected number of CPU cores: 4 Mar 10 03:54:59.623708 dv-cinder-778193-25-iscsi devstack@keystone.service[79546]: current working directory: / Mar 10 03:54:59.623708 dv-cinder-778193-25-iscsi devstack@keystone.service[79546]: detected binary path: /usr/bin/uwsgi-core Mar 10 03:54:59.623708 dv-cinder-778193-25-iscsi devstack@keystone.service[79546]: your processes number limit is 47680 Mar 10 03:54:59.623708 dv-cinder-778193-25-iscsi devstack@keystone.service[79546]: your memory page size is 4096 bytes Mar 10 03:54:59.623708 dv-cinder-778193-25-iscsi devstack@keystone.service[79546]: detected max file descriptor number: 2048 Mar 10 03:54:59.623708 dv-cinder-778193-25-iscsi devstack@keystone.service[79546]: lock engine: pthread robust mutexes Mar 10 03:54:59.623708 dv-cinder-778193-25-iscsi devstack@keystone.service[79546]: thunder lock: enabled Mar 10 03:54:59.623708 dv-cinder-778193-25-iscsi devstack@keystone.service[79546]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Mar 10 03:54:59.623708 dv-cinder-778193-25-iscsi devstack@keystone.service[79546]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 10 03:54:59.666212 dv-cinder-778193-25-iscsi devstack@keystone.service[79546]: Python main interpreter initialized at 0x560bc2cd09c0 Mar 10 03:54:59.666212 dv-cinder-778193-25-iscsi devstack@keystone.service[79546]: python threads support enabled Mar 10 03:54:59.666212 dv-cinder-778193-25-iscsi devstack@keystone.service[79546]: your server socket listen backlog is limited to 100 connections Mar 10 03:54:59.666212 dv-cinder-778193-25-iscsi devstack@keystone.service[79546]: your mercy for graceful operations on workers is 90 seconds Mar 10 03:54:59.666583 dv-cinder-778193-25-iscsi devstack@keystone.service[79546]: mapped 403077 bytes (393 KB) for 2 cores Mar 10 03:54:59.666659 dv-cinder-778193-25-iscsi devstack@keystone.service[79546]: *** Operational MODE: preforking *** Mar 10 03:54:59.666911 dv-cinder-778193-25-iscsi devstack@keystone.service[79546]: *** uWSGI is running in multiple interpreter mode *** Mar 10 03:54:59.666911 dv-cinder-778193-25-iscsi devstack@keystone.service[79546]: spawned uWSGI master process (pid: 79546) Mar 10 03:54:59.667109 dv-cinder-778193-25-iscsi systemd[1]: Started Devstack devstack@keystone.service. Mar 10 03:54:59.671311 dv-cinder-778193-25-iscsi devstack@keystone.service[79546]: spawned uWSGI worker 1 (pid: 79560, cores: 1) Mar 10 03:54:59.671311 dv-cinder-778193-25-iscsi devstack@keystone.service[79546]: spawned uWSGI worker 2 (pid: 79561, cores: 1) Mar 10 03:54:59.671311 dv-cinder-778193-25-iscsi devstack@keystone.service[79546]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 10 03:55:05.369001 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 10 03:55:05.369001 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: from cryptography.utils import int_from_bytes Mar 10 03:55:05.369741 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 10 03:55:05.369741 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: from cryptography.utils import int_from_bytes Mar 10 03:55:05.369850 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 10 03:55:05.369850 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: from cryptography.utils import int_from_bytes Mar 10 03:55:05.369850 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 10 03:55:05.369850 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: from cryptography.utils import int_from_bytes Mar 10 03:55:05.415303 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 10 03:55:05.415489 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 10 03:55:05.415565 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 10 03:55:05.415644 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 10 03:55:05.415746 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] command line args: [] {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 10 03:55:05.415983 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] command line args: [] {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 10 03:55:05.416069 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 10 03:55:05.416136 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 10 03:55:05.416198 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ================================================================================ {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 10 03:55:05.416260 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ================================================================================ {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 10 03:55:05.416438 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] admin_token = **** {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.416518 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] admin_token = **** {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.416650 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] config_dir = [] {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.416727 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] config_dir = [] {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.416790 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.416937 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.417024 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] config_source = [] {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.417084 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] config_source = [] {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.417140 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] debug = True {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.417282 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] debug = True {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.417366 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.419602 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.419720 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.419796 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.419856 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.419920 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.419986 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.420048 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.420110 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.420166 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.420226 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] list_limit = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.420289 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] list_limit = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.420346 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] log_config_append = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.420402 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] log_config_append = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.420457 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.420512 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.420572 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] log_dir = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.420639 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] log_dir = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.420701 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] log_file = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.420757 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] log_file = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.420816 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.420878 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.420939 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.421002 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.421063 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.421120 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.421180 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.421246 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.421305 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.421372 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.421437 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.421500 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.421557 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.421613 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.421673 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.421749 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.421808 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.421868 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.421929 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.421991 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.422053 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.422111 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.422165 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.422225 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.422293 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.422359 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.422423 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.422488 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.423155 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.423371 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.423550 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.423801 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.423966 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] publish_errors = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.424153 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] publish_errors = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.424374 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.424539 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.424732 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.424927 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.425121 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.425309 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.425532 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.425825 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.425989 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.426183 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.426390 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] standard_threads = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.426616 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] standard_threads = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.426781 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.426970 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.427164 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.427353 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.427546 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.427787 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.427956 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] use_journal = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.428119 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] use_journal = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.428280 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] use_json = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.428442 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] use_json = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.428577 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] use_stderr = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.428722 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] use_stderr = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.428885 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] use_syslog = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.429020 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] use_syslog = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.429147 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.429271 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 10 03:55:05.429395 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.429565 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.429733 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.429863 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.429987 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.430111 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.430242 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.430379 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.430505 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.430643 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.430770 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.430894 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.431097 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.431230 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.431362 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.431493 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.431619 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.431773 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.431910 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.432037 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.432162 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.432292 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.432423 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.432559 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.432695 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.432822 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.432961 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.433091 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.433221 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.433351 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.433484 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.433611 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.433742 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.433868 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.433993 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.434123 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.434265 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.434392 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.434517 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.434646 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.434772 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.434895 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.435028 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.435159 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.435284 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.435408 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.435532 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.435661 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.435818 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.435956 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.436083 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.436083 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.436324 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.436454 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.436586 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.436711 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.436834 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.436834 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.437077 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.437077 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.437386 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.437520 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.437655 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.437780 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.437904 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.438027 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.438160 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.438284 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.438408 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.438531 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.438654 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.438778 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.438910 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.439040 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.439166 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.439289 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.439427 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.439561 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.439720 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.439852 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.439976 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.440105 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.440231 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.440370 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.440496 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.440620 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.440743 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.440873 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.440998 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.441129 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.442349 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.442547 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.442880 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.443042 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.443233 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.443455 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.443626 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.443843 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.444200 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.444287 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.444359 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.444918 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.444990 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.445083 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.445159 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.445224 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.445292 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.445362 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.445432 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.445505 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.445578 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.445647 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.445720 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.445796 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.445870 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.445989 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.446062 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.446175 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.446247 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.446368 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.446449 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.446519 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.446594 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.446669 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.446746 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.446861 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.446941 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.447056 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.447136 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.447206 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.447273 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.447385 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.447458 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.447579 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.447653 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.447742 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.447823 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.447899 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.448014 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.448095 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.448165 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.448285 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.448358 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.448432 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.448546 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.448627 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.448697 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.448765 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.448832 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.448946 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.449031 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.449108 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.449178 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.449246 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.449246 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.449246 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.449246 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.449246 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.449246 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.449246 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.449246 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.449246 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.449855 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.449855 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.449855 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.449855 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.449855 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.449855 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.449855 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.449855 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.449855 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.450386 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.450386 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.450386 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.450386 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.450386 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.450386 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.450386 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.450386 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.450855 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.450855 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] auth.external = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.451040 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.451214 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.451446 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.451534 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.451708 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] auth.password = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.451795 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.451931 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] auth.token = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.452047 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.452166 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.452313 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.452400 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.452577 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.452670 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.452835 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.452919 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.453091 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.453173 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.453336 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.453420 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.453569 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.453661 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.453806 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] credential.caching = True {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.453885 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.454053 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.454136 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.454299 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.454383 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.454544 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.454627 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.454778 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.454869 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.455021 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.455133 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.455256 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.455336 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.455500 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.455591 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.455779 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.455863 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.456020 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.456104 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.456259 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.456348 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.456495 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.456578 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.456743 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.456828 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.456984 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.457067 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.457237 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.457321 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.457477 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.457561 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.457709 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] federation.caching = True {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.457791 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.457944 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.458037 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.458188 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.458272 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.458431 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.458517 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] auth.external = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.458663 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.458755 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.458907 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.458991 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.459143 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.459237 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.459394 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.459487 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] auth.password = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.459618 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] auth.token = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.459719 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.459900 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.460008 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.460714 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.460813 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.460962 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.461103 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.461184 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] identity.caching = True {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.461309 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.461444 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.461589 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.461667 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.461817 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.461901 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.462108 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.462192 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.462348 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] credential.caching = True {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.462431 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.462578 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.462661 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.462813 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.462896 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.463102 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.463184 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.463311 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.463399 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.463526 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.463605 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.463776 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.463861 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.464003 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.464087 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.464247 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.464331 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.464492 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.464576 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.464736 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.464820 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.464988 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.465073 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.465234 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.465318 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.465499 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.465583 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.465732 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.465816 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.465967 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.466051 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.466197 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.466280 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] federation.caching = True {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.466431 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.466515 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.466652 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.466733 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.466888 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.466972 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.467127 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.467212 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.467364 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.467449 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.467610 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.467718 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.467856 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.467953 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.468114 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.468198 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.468358 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.468439 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.468597 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.468685 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.468874 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.468955 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.469130 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.469213 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] identity.caching = True {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.469370 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.469457 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.469519 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.469707 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.469796 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.469857 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.470048 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.470136 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.470198 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.470399 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.470479 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.470539 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.470731 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.470821 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.470884 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.471072 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.471151 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.471322 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.471405 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.471579 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.471660 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.471846 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.471925 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.472092 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.472170 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.472343 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.472421 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.472578 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.472657 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.472813 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.472891 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.472964 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.473024 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.473247 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.user = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.473326 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.473491 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.473571 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.473736 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.473816 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.473971 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.474049 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.474204 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.474282 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.474447 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.474525 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.474680 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.474759 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.474819 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.474878 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.475128 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.475207 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.475363 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.475447 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.475514 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.475573 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.475878 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.476019 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.476152 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.476285 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.476419 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.476552 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.476697 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.476832 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.476978 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.477112 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.477246 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.477385 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.477528 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.477663 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.477796 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.477937 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.478071 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.478204 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.478345 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.478480 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.478620 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.478764 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.478899 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.479033 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.479183 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.479322 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.479456 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.479588 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.479738 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.479877 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.480023 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.480158 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.480291 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.480424 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.480557 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.480701 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.480844 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.480980 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.481114 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.481246 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.481379 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.481523 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.481659 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.481792 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.481925 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.482058 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.482192 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.482333 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.user = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.482468 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.482612 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.482747 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.482880 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.483014 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] resource.caching = True {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.483155 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.483291 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.483424 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.483557 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.483733 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.483874 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.484019 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.484165 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.484302 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.484447 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.484582 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.484715 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.484857 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.484992 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.485125 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.485259 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.485392 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.485525 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.485665 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.485800 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] role.caching = True {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.485933 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.486067 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] role.driver = sql {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.486199 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.486345 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.486488 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.486623 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.486757 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.486889 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.487023 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.487156 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.487361 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.487500 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.487634 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.487790 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.487924 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.488058 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.488202 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.488348 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.488484 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.488617 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.488750 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.488884 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.489025 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.489169 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.489303 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.489436 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.489570 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.489704 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.489851 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.489986 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.490133 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.490133 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.490386 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.490521 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.490663 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.490797 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.490937 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.491072 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.491204 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.491373 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.491517 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.491653 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.491837 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.491987 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.492122 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.492267 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.492402 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.492536 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] resource.caching = True {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.492669 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.492803 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.492936 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.493077 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.493212 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.493346 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.493479 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.493612 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.493746 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.493897 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.494034 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.494168 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.494301 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.494432 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.494565 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.494565 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.494828 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.494962 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.495095 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.495228 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.495361 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] role.caching = True {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.495503 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] token.caching = True {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.495637 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] role.driver = sql {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.495803 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.495938 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.496072 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.496205 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.496350 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.496485 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.496620 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.496753 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.496887 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.497019 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.497161 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.497161 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.497415 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.497559 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.497693 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.497826 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.497968 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.498103 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.498236 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.498370 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.498503 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.498637 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.498778 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.498914 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.499046 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.499190 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.499323 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.499466 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.499609 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.499765 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.499901 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.500046 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.500181 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.500314 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] database.connection = **** {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.500460 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.500608 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.500744 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.500878 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.501012 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.501146 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.501146 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.501417 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.501552 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.501686 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.501820 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.501954 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.502088 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.502229 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.502365 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.502498 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.502631 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.502764 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.502898 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.503039 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.503185 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.503320 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.503453 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.503586 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.503761 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.503914 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.504050 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.504185 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.504318 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.504451 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.504584 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.504726 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.504860 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.505004 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.505139 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.505273 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] token.caching = True {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.505406 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 10 03:55:05.505549 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.505549 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.505549 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.505549 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.505549 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.505549 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.505549 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.505549 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.505549 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.506639 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.506639 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.506639 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.506639 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.506639 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.506639 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.506639 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.506639 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.506639 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] database.connection = **** {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.508307 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.508307 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.508307 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.508307 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.508307 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.508307 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.508307 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.508307 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.508307 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.509494 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.509494 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.509494 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.509494 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.509494 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.509494 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.509494 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.509494 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.509494 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 10 03:55:05.510596 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 10 03:55:05.531839 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.532068 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.532279 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.536302 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.536533 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.536758 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.540926 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.545343 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.568826 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.569309 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.571848 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.572078 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.624045 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.624316 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.673871 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.674107 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.678387 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.678697 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.741037 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.741770 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.741993 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.742143 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.742229 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.742407 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.742489 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.742609 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.742804 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.743188 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.743469 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.743778 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.768370 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.768546 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.768617 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.768678 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.768811 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.769055 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.769275 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.769389 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.769549 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.769636 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.769754 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.769835 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.769973 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.770170 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.781591 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.781719 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.794616 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.794763 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.794834 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.794897 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.795064 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.795191 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.795271 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.795489 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.795570 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.795731 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.795857 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.795937 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79560) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.796171 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.796449 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 10 03:55:05.813914 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.814041 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.814110 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 10 03:55:05.814257 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 10 03:55:05.814469 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.814667 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 10 03:55:05.814749 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.814933 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.815019 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 10 03:55:05.815203 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.815352 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.815448 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.815706 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.815789 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.816064 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.816394 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.826986 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.827261 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.827523 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.827824 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.827961 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.828329 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.828663 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.829005 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.835871 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:05.837239 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:05.839046 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:05.839323 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.839601 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.839900 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.840172 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.840423 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.840569 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:05.840705 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.840853 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.840936 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.841132 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.841216 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.841413 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.841495 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.841693 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.841785 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.841950 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.842216 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.842486 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.842754 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.843025 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.843362 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.868046 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.869619 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:05.869871 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.869955 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.871460 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:05.871777 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.875101 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:05.875332 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.875755 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.876980 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:05.877255 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.877643 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.883408 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:05.883709 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.885380 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:05.885661 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.888090 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:05.888494 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.888781 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.889055 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.889322 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.889589 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.889854 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.890116 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.890250 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:05.890475 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.890732 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.891014 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.891286 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.891556 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.891849 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.892117 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.908363 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.908635 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.910345 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.910630 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.913042 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:05.915051 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:05.916580 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.916867 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.918594 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.918885 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.921800 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:05.923894 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:05.925275 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:05.927353 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:05.929300 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.929589 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.929864 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.930139 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.930408 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.930678 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.931411 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.931721 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.932006 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.932288 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.932567 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.932843 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.950080 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:05.950368 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.950627 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.950883 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.952243 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:05.952536 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.952800 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.953072 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.958516 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.960207 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.960478 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.960742 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.962389 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.962661 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.963558 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:05.963863 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.964139 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.964418 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.964688 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.965766 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:05.966054 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.966336 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.966620 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.966892 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.977554 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:05.977831 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.978107 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.978380 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.978651 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.979838 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:05.980116 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.980315 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.980452 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.980609 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.980756 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.980930 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.982523 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.982809 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:05.998634 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:06.000899 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:06.001978 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:06.004104 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:06.005199 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.007909 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.109252 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.112652 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.112839 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:06.112839 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.112839 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.113217 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:06.113217 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.113217 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.119185 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.120674 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.120767 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:06.122237 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:06.124086 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.124370 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.124642 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.124909 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.125635 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.125879 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.126166 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.126444 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.133800 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:06.134083 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.134364 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.135367 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:06.135654 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.135963 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.142112 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79560) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:06.142390 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.142765 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.143038 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.143343 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.143620 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 10 03:55:06.143753 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.143921 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.144006 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.144189 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.144332 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.144477 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.144557 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.144725 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.144819 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.145006 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.145138 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.145266 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.145393 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.145549 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.145678 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.145814 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79560) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.145944 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.146098 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.146370 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.146628 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.146889 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.147157 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 10 03:55:06.183974 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x560bc2cd09c0 pid: 79560 (default app) Mar 10 03:55:06.185331 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x560bc2cd09c0 pid: 79561 (default app) Mar 10 03:55:06.187411 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d934fc5-ac20-4d8b-be1e-faddf707f307 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:06.187720 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d934fc5-ac20-4d8b-be1e-faddf707f307 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:06.188002 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d934fc5-ac20-4d8b-be1e-faddf707f307 None None] PATH_INFO: `/v3` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:06.192118 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Thu Mar 10 03:55:06 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:14.441340 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b9da4-c619-4fd8-89da-fc57b2d26a0e None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:14.441868 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b9da4-c619-4fd8-89da-fc57b2d26a0e None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:14.441868 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b9da4-c619-4fd8-89da-fc57b2d26a0e None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:14.447566 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:14.452731 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc1516-e83f-4534-ad5e-6a99b90b8dd3 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:14.453149 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc1516-e83f-4534-ad5e-6a99b90b8dd3 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:14.453320 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc1516-e83f-4534-ad5e-6a99b90b8dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:14.483079 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG oslo_db.sqlalchemy.engines [None req-36bc1516-e83f-4534-ad5e-6a99b90b8dd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79560) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 10 03:55:14.669164 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG passlib.handlers.bcrypt [None req-36bc1516-e83f-4534-ad5e-6a99b90b8dd3 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79560) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 10 03:55:14.669578 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG passlib.handlers.bcrypt [None req-36bc1516-e83f-4534-ad5e-6a99b90b8dd3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79560) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 10 03:55:14.724846 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-36bc1516-e83f-4534-ad5e-6a99b90b8dd3 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:14.726420 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-36bc1516-e83f-4534-ad5e-6a99b90b8dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:14.847494 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Mar 10 03:55:14.964346 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b9da4-c619-4fd8-89da-fc57b2d26a0e None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:14.997038 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG oslo_db.sqlalchemy.engines [None req-988b9da4-c619-4fd8-89da-fc57b2d26a0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79561) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 10 03:55:15.122836 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b9da4-c619-4fd8-89da-fc57b2d26a0e None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:15.126981 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c9196-f279-4360-bed2-5c92ce720b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:15.127637 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c9196-f279-4360-bed2-5c92ce720b71 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:15.127954 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c9196-f279-4360-bed2-5c92ce720b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:15.128232 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c9196-f279-4360-bed2-5c92ce720b71 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:15.136200 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c9196-f279-4360-bed2-5c92ce720b71 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:15.187206 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0c0c9196-f279-4360-bed2-5c92ce720b71 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 10 03:55:15.187630 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c9196-f279-4360-bed2-5c92ce720b71 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:15.197328 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1324 bytes} [Thu Mar 10 03:55:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 10 03:55:15.203320 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc1516-e83f-4534-ad5e-6a99b90b8dd3 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:15.217234 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc1516-e83f-4534-ad5e-6a99b90b8dd3 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:15.221589 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08feb783-a570-4d0b-ae47-68ae73bd8637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:15.222689 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08feb783-a570-4d0b-ae47-68ae73bd8637 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:15.222974 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08feb783-a570-4d0b-ae47-68ae73bd8637 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:15.223249 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08feb783-a570-4d0b-ae47-68ae73bd8637 admin admin] PATH_INFO: `/v3/projects/15f699ac2a074d6bb8d9dc62578c5328` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:15.224762 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08feb783-a570-4d0b-ae47-68ae73bd8637 admin admin] RBAC: Authorizing `identity:get_project(project_id=15f699ac2a074d6bb8d9dc62578c5328)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:15.276829 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.common.rbac_enforcer.enforcer [None req-08feb783-a570-4d0b-ae47-68ae73bd8637 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 10 03:55:15.277115 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08feb783-a570-4d0b-ae47-68ae73bd8637 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:15.281634 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 3/5] 10.222.0.15 () {56 vars in 1207 bytes} [Thu Mar 10 03:55:15 2022] GET /identity/v3/projects/15f699ac2a074d6bb8d9dc62578c5328 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:17.551031 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275767b-e163-43d3-85c7-0465b7637636 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:17.551529 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275767b-e163-43d3-85c7-0465b7637636 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:17.551620 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275767b-e163-43d3-85c7-0465b7637636 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:17.556155 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 3/6] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:17.561384 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ff8f9-a9a9-463c-ab16-5f728eae6024 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:17.561753 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ff8f9-a9a9-463c-ab16-5f728eae6024 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:17.561948 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ff8f9-a9a9-463c-ab16-5f728eae6024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:17.580849 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-159ff8f9-a9a9-463c-ab16-5f728eae6024 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:17.582349 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-159ff8f9-a9a9-463c-ab16-5f728eae6024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:17.590635 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Mar 10 03:55:17.612558 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275767b-e163-43d3-85c7-0465b7637636 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:17.624398 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275767b-e163-43d3-85c7-0465b7637636 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:17.628606 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be9a4d-48f3-4df1-a1b7-095f60be8962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:17.629221 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be9a4d-48f3-4df1-a1b7-095f60be8962 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:17.629506 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be9a4d-48f3-4df1-a1b7-095f60be8962 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:17.629782 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be9a4d-48f3-4df1-a1b7-095f60be8962 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:17.637855 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be9a4d-48f3-4df1-a1b7-095f60be8962 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:17.639609 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be9a4d-48f3-4df1-a1b7-095f60be8962 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:17.648581 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1324 bytes} [Thu Mar 10 03:55:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 10 03:55:17.653735 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ff8f9-a9a9-463c-ab16-5f728eae6024 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:17.662491 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ff8f9-a9a9-463c-ab16-5f728eae6024 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:17.666774 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21bda5-a365-4695-8dc5-7695a73d4df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:17.667607 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21bda5-a365-4695-8dc5-7695a73d4df3 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:17.667919 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21bda5-a365-4695-8dc5-7695a73d4df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:17.668196 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21bda5-a365-4695-8dc5-7695a73d4df3 admin admin] PATH_INFO: `/v3/users/7d6bd1d36bd94be08e18367ce0063fc4` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:17.669565 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21bda5-a365-4695-8dc5-7695a73d4df3 admin admin] RBAC: Authorizing `identity:get_user(user_id=7d6bd1d36bd94be08e18367ce0063fc4)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:17.671360 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21bda5-a365-4695-8dc5-7695a73d4df3 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:17.672901 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 5/9] 10.222.0.15 () {56 vars in 1198 bytes} [Thu Mar 10 03:55:17 2022] GET /identity/v3/users/7d6bd1d36bd94be08e18367ce0063fc4 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:19.986619 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64736b-161f-4faa-9cd3-6fc4a3667d97 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:19.987158 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64736b-161f-4faa-9cd3-6fc4a3667d97 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:19.987158 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64736b-161f-4faa-9cd3-6fc4a3667d97 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:19.988981 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:19.994173 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ad986-61ef-47f0-b621-10a602b3195b None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:19.994549 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ad986-61ef-47f0-b621-10a602b3195b None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:19.994839 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ad986-61ef-47f0-b621-10a602b3195b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:20.011111 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-b29ad986-61ef-47f0-b621-10a602b3195b None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:20.012296 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-b29ad986-61ef-47f0-b621-10a602b3195b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:20.039164 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326fff3-ab49-4859-9b5b-7fdabf169d10 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:20.039453 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326fff3-ab49-4859-9b5b-7fdabf169d10 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:20.039759 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326fff3-ab49-4859-9b5b-7fdabf169d10 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:20.041472 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 6/11] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 03:55:20.046662 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4eb456-6244-474a-bdff-23dc203a0707 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:20.046949 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4eb456-6244-474a-bdff-23dc203a0707 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:20.047228 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4eb456-6244-474a-bdff-23dc203a0707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:20.087630 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG passlib.handlers.bcrypt [None req-ea4eb456-6244-474a-bdff-23dc203a0707 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79561) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 10 03:55:20.088069 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG passlib.handlers.bcrypt [None req-ea4eb456-6244-474a-bdff-23dc203a0707 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79561) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 10 03:55:20.089274 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 6/12] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 03:55:20.112613 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ad986-61ef-47f0-b621-10a602b3195b None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:20.134721 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-ea4eb456-6244-474a-bdff-23dc203a0707 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:20.136356 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-ea4eb456-6244-474a-bdff-23dc203a0707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:20.205846 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ad986-61ef-47f0-b621-10a602b3195b None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:20.230513 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 03:55:20.238316 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874b636-899c-4677-b56a-0ffa6b925a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:20.239048 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874b636-899c-4677-b56a-0ffa6b925a66 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:20.239331 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874b636-899c-4677-b56a-0ffa6b925a66 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:20.239613 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874b636-899c-4677-b56a-0ffa6b925a66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:20.250331 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6874b636-899c-4677-b56a-0ffa6b925a66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:55:20.252166 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4eb456-6244-474a-bdff-23dc203a0707 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:20.257248 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-6874b636-899c-4677-b56a-0ffa6b925a66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 03:55:20.258428 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 7/14] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:55:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:55:20.264163 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874b636-899c-4677-b56a-0ffa6b925a66 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:20.344551 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4eb456-6244-474a-bdff-23dc203a0707 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:20.356775 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874b636-899c-4677-b56a-0ffa6b925a66 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:20.375781 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a48b6a-210c-4df9-8621-71c95215716c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:20.376658 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a48b6a-210c-4df9-8621-71c95215716c None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:20.376941 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a48b6a-210c-4df9-8621-71c95215716c None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:20.377214 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a48b6a-210c-4df9-8621-71c95215716c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:20.389516 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7df6f2-d292-4366-9ebb-97faaa3b2c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:20.390162 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7df6f2-d292-4366-9ebb-97faaa3b2c9d None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:20.390443 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7df6f2-d292-4366-9ebb-97faaa3b2c9d None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:20.390714 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7df6f2-d292-4366-9ebb-97faaa3b2c9d None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:20.391465 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7df6f2-d292-4366-9ebb-97faaa3b2c9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:20.391797 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7df6f2-d292-4366-9ebb-97faaa3b2c9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:20.393166 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7df6f2-d292-4366-9ebb-97faaa3b2c9d None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:20.404489 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 8/15] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:55:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:55:20.410003 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7df6f2-d292-4366-9ebb-97faaa3b2c9d None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:20.440972 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a48b6a-210c-4df9-8621-71c95215716c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:20.442478 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a48b6a-210c-4df9-8621-71c95215716c None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:20.501639 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7df6f2-d292-4366-9ebb-97faaa3b2c9d None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:20.532189 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 8/16] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:55:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 10 03:55:20.533007 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dab4d8-074d-49bf-a765-082db0c872fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:20.534039 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dab4d8-074d-49bf-a765-082db0c872fa None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:20.534325 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dab4d8-074d-49bf-a765-082db0c872fa None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:20.534600 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dab4d8-074d-49bf-a765-082db0c872fa None admin] PATH_INFO: `/v3/users/7d6bd1d36bd94be08e18367ce0063fc4` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:20.535819 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dab4d8-074d-49bf-a765-082db0c872fa None admin] RBAC: Authorizing `identity:get_user(user_id=7d6bd1d36bd94be08e18367ce0063fc4)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:20.537561 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dab4d8-074d-49bf-a765-082db0c872fa None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:20.537752 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a48b6a-210c-4df9-8621-71c95215716c None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:20.539136 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 9/17] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:55:20 2022] GET /identity/v3/users/7d6bd1d36bd94be08e18367ce0063fc4 => generated 247 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:55:20.544182 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dab4d8-074d-49bf-a765-082db0c872fa None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:20.627173 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a48b6a-210c-4df9-8621-71c95215716c None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:20.635148 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dab4d8-074d-49bf-a765-082db0c872fa None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:20.661731 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84d419-66e1-4f59-ab14-26acf8135679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:20.662518 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84d419-66e1-4f59-ab14-26acf8135679 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:20.662904 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84d419-66e1-4f59-ab14-26acf8135679 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:20.663182 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84d419-66e1-4f59-ab14-26acf8135679 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:20.666444 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47aafa-14d3-4b68-b72d-46e19949f854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:20.667215 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47aafa-14d3-4b68-b72d-46e19949f854 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:20.667499 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47aafa-14d3-4b68-b72d-46e19949f854 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:20.667802 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47aafa-14d3-4b68-b72d-46e19949f854 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:20.668966 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47aafa-14d3-4b68-b72d-46e19949f854 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:20.670407 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47aafa-14d3-4b68-b72d-46e19949f854 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:20.672012 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 10/18] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:55:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:55:20.677722 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47aafa-14d3-4b68-b72d-46e19949f854 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:20.681541 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84d419-66e1-4f59-ab14-26acf8135679 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:20.683005 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84d419-66e1-4f59-ab14-26acf8135679 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:20.700515 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-ee84d419-66e1-4f59-ab14-26acf8135679 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:55:20.701901 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 9/19] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:55:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:55:20.707261 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84d419-66e1-4f59-ab14-26acf8135679 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:20.771549 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47aafa-14d3-4b68-b72d-46e19949f854 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:20.798036 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84d419-66e1-4f59-ab14-26acf8135679 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:20.802185 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3179d-1c77-45c8-950b-722557f67601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:20.802833 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3179d-1c77-45c8-950b-722557f67601 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:20.803115 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3179d-1c77-45c8-950b-722557f67601 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:20.803933 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3179d-1c77-45c8-950b-722557f67601 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:20.804754 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3179d-1c77-45c8-950b-722557f67601 None admin] RBAC: Adding query filter params (role.id=a8b2a5887cec4a31b7304792af3dd3f1, scope.domain.id=default, user.id=7d6bd1d36bd94be08e18367ce0063fc4) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:20.805065 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3179d-1c77-45c8-950b-722557f67601 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:20.806509 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3179d-1c77-45c8-950b-722557f67601 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:20.812936 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 11/20] 10.222.0.15 () {56 vars in 1322 bytes} [Thu Mar 10 03:55:20 2022] GET /identity/v3/role_assignments?user.id=7d6bd1d36bd94be08e18367ce0063fc4&scope.domain.id=default&role.id=a8b2a5887cec4a31b7304792af3dd3f1 => generated 233 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:55:20.831330 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbb1be-2294-442f-97c4-53113d5047ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:20.832054 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbb1be-2294-442f-97c4-53113d5047ee None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:20.832339 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbb1be-2294-442f-97c4-53113d5047ee None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:20.832614 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbb1be-2294-442f-97c4-53113d5047ee None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:20.833362 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbb1be-2294-442f-97c4-53113d5047ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:20.833670 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbb1be-2294-442f-97c4-53113d5047ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:20.835148 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbb1be-2294-442f-97c4-53113d5047ee None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:20.854421 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 10/21] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:55:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:55:23.403643 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1560f12-6279-4ccd-8735-dc18c1c89f0c None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:23.404151 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1560f12-6279-4ccd-8735-dc18c1c89f0c None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:23.404151 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1560f12-6279-4ccd-8735-dc18c1c89f0c None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:23.406460 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 12/22] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:23.412005 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e6287-135e-4d88-9869-d52aa6accca5 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:23.412879 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e6287-135e-4d88-9869-d52aa6accca5 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:23.413355 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e6287-135e-4d88-9869-d52aa6accca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:23.430605 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-e41e6287-135e-4d88-9869-d52aa6accca5 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:23.432151 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-e41e6287-135e-4d88-9869-d52aa6accca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:23.510794 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 11/23] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:55:23.546822 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1560f12-6279-4ccd-8735-dc18c1c89f0c None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:23.659785 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1560f12-6279-4ccd-8735-dc18c1c89f0c None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:23.694823 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08e566-bf1b-4fb6-8c0d-1a3d9d356fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:23.695977 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08e566-bf1b-4fb6-8c0d-1a3d9d356fce None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:23.696483 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08e566-bf1b-4fb6-8c0d-1a3d9d356fce None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:23.696948 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08e566-bf1b-4fb6-8c0d-1a3d9d356fce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:23.707536 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08e566-bf1b-4fb6-8c0d-1a3d9d356fce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:23.709410 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08e566-bf1b-4fb6-8c0d-1a3d9d356fce None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:23.713793 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c898db-e3cf-44c4-9ebc-85ee287f958a None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:23.714308 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c898db-e3cf-44c4-9ebc-85ee287f958a None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:23.714799 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c898db-e3cf-44c4-9ebc-85ee287f958a None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:23.716785 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 12/24] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:23.723708 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1712b-3178-4c0b-bff3-c1d8f572979c None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:23.723708 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1712b-3178-4c0b-bff3-c1d8f572979c None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:23.723708 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1712b-3178-4c0b-bff3-c1d8f572979c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:23.733933 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-8f08e566-bf1b-4fb6-8c0d-1a3d9d356fce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:55:23.733933 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 13/25] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:55:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:55:23.738686 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08e566-bf1b-4fb6-8c0d-1a3d9d356fce None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:23.753463 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-52c1712b-3178-4c0b-bff3-c1d8f572979c None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:23.754939 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-52c1712b-3178-4c0b-bff3-c1d8f572979c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:23.841015 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08e566-bf1b-4fb6-8c0d-1a3d9d356fce None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:23.875315 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d61f59-8a82-4574-902b-3fc94908164a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:23.876254 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d61f59-8a82-4574-902b-3fc94908164a None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:23.876669 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d61f59-8a82-4574-902b-3fc94908164a None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:23.877090 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d61f59-8a82-4574-902b-3fc94908164a None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:23.877949 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d61f59-8a82-4574-902b-3fc94908164a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:23.878388 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d61f59-8a82-4574-902b-3fc94908164a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:23.879922 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d61f59-8a82-4574-902b-3fc94908164a None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:23.906192 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 13/26] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:55:23.907852 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 14/27] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:55:23.913490 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1712b-3178-4c0b-bff3-c1d8f572979c None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:23.950032 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d61f59-8a82-4574-902b-3fc94908164a None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:24.061758 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d61f59-8a82-4574-902b-3fc94908164a None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:24.099724 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74786f61-2ddb-440e-a7df-6bbf3cba61f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:24.103712 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1712b-3178-4c0b-bff3-c1d8f572979c None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:24.103919 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74786f61-2ddb-440e-a7df-6bbf3cba61f7 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:24.103919 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74786f61-2ddb-440e-a7df-6bbf3cba61f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:24.103919 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74786f61-2ddb-440e-a7df-6bbf3cba61f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:24.112943 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74786f61-2ddb-440e-a7df-6bbf3cba61f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:55:24.120662 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-74786f61-2ddb-440e-a7df-6bbf3cba61f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 03:55:24.122100 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 15/28] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:55:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:55:24.123180 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f092d-961a-4340-ba29-46d27ab880a7 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:24.123470 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f092d-961a-4340-ba29-46d27ab880a7 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:24.123777 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f092d-961a-4340-ba29-46d27ab880a7 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:24.125666 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 16/29] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:24.130243 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f092d-961a-4340-ba29-46d27ab880a7 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:24.144251 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3183bbf-e2e9-48ca-9670-9b9bfbd0275f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:24.144917 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3183bbf-e2e9-48ca-9670-9b9bfbd0275f None admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:24.145199 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3183bbf-e2e9-48ca-9670-9b9bfbd0275f None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:24.145477 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3183bbf-e2e9-48ca-9670-9b9bfbd0275f None admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:24.146431 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3183bbf-e2e9-48ca-9670-9b9bfbd0275f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:24.148472 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3183bbf-e2e9-48ca-9670-9b9bfbd0275f None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:24.310318 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f092d-961a-4340-ba29-46d27ab880a7 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:24.332804 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 14/30] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Mar 10 03:55:23 2022] POST /identity/v3/projects => generated 301 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 03:55:24.334907 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d40d50-3f31-4af4-9330-5af14bb239f7 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:24.335212 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d40d50-3f31-4af4-9330-5af14bb239f7 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:24.335492 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d40d50-3f31-4af4-9330-5af14bb239f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:24.348302 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbacc42-6b60-4cb0-b931-860aced52c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:24.349339 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbacc42-6b60-4cb0-b931-860aced52c5e None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:24.349619 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbacc42-6b60-4cb0-b931-860aced52c5e None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:24.349974 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbacc42-6b60-4cb0-b931-860aced52c5e None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:24.350735 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbacc42-6b60-4cb0-b931-860aced52c5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:24.351087 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbacc42-6b60-4cb0-b931-860aced52c5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:24.352581 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbacc42-6b60-4cb0-b931-860aced52c5e None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:24.366777 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 17/31] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:55:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:24.372936 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbacc42-6b60-4cb0-b931-860aced52c5e None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:24.380897 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-10d40d50-3f31-4af4-9330-5af14bb239f7 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:24.383003 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-10d40d50-3f31-4af4-9330-5af14bb239f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:24.558376 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbacc42-6b60-4cb0-b931-860aced52c5e None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:24.580061 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 15/32] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:55:24.585351 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007ba2f-06ed-4a38-b551-d2f318bc37b9 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:24.585637 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007ba2f-06ed-4a38-b551-d2f318bc37b9 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:24.585922 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007ba2f-06ed-4a38-b551-d2f318bc37b9 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:24.588016 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 16/33] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:24.603455 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f7332-0e7f-4291-97f4-43e8b2c6a782 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:24.603834 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f7332-0e7f-4291-97f4-43e8b2c6a782 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:24.604121 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f7332-0e7f-4291-97f4-43e8b2c6a782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:24.609344 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3de8e1-0689-4f0a-a8c3-96e6abc788ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:24.610284 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3de8e1-0689-4f0a-a8c3-96e6abc788ca None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:24.610575 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3de8e1-0689-4f0a-a8c3-96e6abc788ca None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:24.610853 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3de8e1-0689-4f0a-a8c3-96e6abc788ca None admin] PATH_INFO: `/v3/users/7d6bd1d36bd94be08e18367ce0063fc4` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:24.617058 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3de8e1-0689-4f0a-a8c3-96e6abc788ca None admin] RBAC: Authorizing `identity:get_user(user_id=7d6bd1d36bd94be08e18367ce0063fc4)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:24.618627 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3de8e1-0689-4f0a-a8c3-96e6abc788ca None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:24.620442 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 18/34] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:55:24 2022] GET /identity/v3/users/7d6bd1d36bd94be08e18367ce0063fc4 => generated 247 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:24.626942 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3de8e1-0689-4f0a-a8c3-96e6abc788ca None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:24.634897 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-3b5f7332-0e7f-4291-97f4-43e8b2c6a782 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:24.636138 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-3b5f7332-0e7f-4291-97f4-43e8b2c6a782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:24.730470 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 17/35] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 03:55:24.731331 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f7332-0e7f-4291-97f4-43e8b2c6a782 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:24.745741 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3de8e1-0689-4f0a-a8c3-96e6abc788ca None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:24.785161 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d89cfa-225f-414e-bd2d-02a477547cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:24.785832 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d89cfa-225f-414e-bd2d-02a477547cc7 None admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:24.786114 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d89cfa-225f-414e-bd2d-02a477547cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:24.786395 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d89cfa-225f-414e-bd2d-02a477547cc7 None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:24.787143 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d89cfa-225f-414e-bd2d-02a477547cc7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:24.788619 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d89cfa-225f-414e-bd2d-02a477547cc7 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:24.844544 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f7332-0e7f-4291-97f4-43e8b2c6a782 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:24.888289 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914bae6-8a76-41de-8e67-a1bf8792c124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:24.889092 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914bae6-8a76-41de-8e67-a1bf8792c124 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:24.889376 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914bae6-8a76-41de-8e67-a1bf8792c124 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:24.889654 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914bae6-8a76-41de-8e67-a1bf8792c124 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:24.890957 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914bae6-8a76-41de-8e67-a1bf8792c124 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:24.892679 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914bae6-8a76-41de-8e67-a1bf8792c124 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:24.894638 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 18/36] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:55:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:24.895462 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914bae6-8a76-41de-8e67-a1bf8792c124 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:24.938856 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 19/37] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Mar 10 03:55:24 2022] POST /identity/v3/roles => generated 225 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 03:55:24.940223 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d89cfa-225f-414e-bd2d-02a477547cc7 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:25.006720 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914bae6-8a76-41de-8e67-a1bf8792c124 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:25.042407 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2c8c7-1409-439c-8e12-f2b372968fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:25.043077 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2c8c7-1409-439c-8e12-f2b372968fbc None admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:25.043360 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2c8c7-1409-439c-8e12-f2b372968fbc None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:25.043634 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2c8c7-1409-439c-8e12-f2b372968fbc None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:25.044417 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2c8c7-1409-439c-8e12-f2b372968fbc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:25.045868 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2c8c7-1409-439c-8e12-f2b372968fbc None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:25.080842 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 19/38] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Mar 10 03:55:24 2022] POST /identity/v3/roles => generated 219 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 03:55:25.105206 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d89cfa-225f-414e-bd2d-02a477547cc7 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:25.146007 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20e819-a0bf-4c04-a573-6aba6f0c868e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:25.147074 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20e819-a0bf-4c04-a573-6aba6f0c868e None admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:25.147411 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20e819-a0bf-4c04-a573-6aba6f0c868e None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:25.147719 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20e819-a0bf-4c04-a573-6aba6f0c868e None admin] PATH_INFO: `/v3/domains/default/users/7d6bd1d36bd94be08e18367ce0063fc4/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:25.150163 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20e819-a0bf-4c04-a573-6aba6f0c868e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7d6bd1d36bd94be08e18367ce0063fc4, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:25.151829 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20e819-a0bf-4c04-a573-6aba6f0c868e None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:25.172284 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 20/39] 10.222.0.15 () {58 vars in 1361 bytes} [Thu Mar 10 03:55:24 2022] PUT /identity/v3/domains/default/users/7d6bd1d36bd94be08e18367ce0063fc4/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 03:55:25.200142 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6039a-d9d9-4199-9401-9fec0eb52c83 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:25.200142 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6039a-d9d9-4199-9401-9fec0eb52c83 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:25.200142 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6039a-d9d9-4199-9401-9fec0eb52c83 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:25.200142 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 20/40] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:25.206913 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2273bf-3622-4fc9-be82-b4d9f08ab136 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:25.207591 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2273bf-3622-4fc9-be82-b4d9f08ab136 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:25.208150 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2273bf-3622-4fc9-be82-b4d9f08ab136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:25.228486 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-1d2273bf-3622-4fc9-be82-b4d9f08ab136 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:25.230538 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-1d2273bf-3622-4fc9-be82-b4d9f08ab136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:25.311340 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c127035-77b7-47b8-b37c-63102c4e85d3 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:25.311704 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c127035-77b7-47b8-b37c-63102c4e85d3 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:25.311945 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c127035-77b7-47b8-b37c-63102c4e85d3 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:25.313958 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 21/41] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:25.315213 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 21/42] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:55:25.320561 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b89a8-0248-41e5-b034-88f011c49c6c None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:25.321171 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b89a8-0248-41e5-b034-88f011c49c6c None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:25.321662 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b89a8-0248-41e5-b034-88f011c49c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:25.339231 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2273bf-3622-4fc9-be82-b4d9f08ab136 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:25.342940 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-fe9b89a8-0248-41e5-b034-88f011c49c6c None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:25.344214 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-fe9b89a8-0248-41e5-b034-88f011c49c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:25.432765 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 22/43] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:55:25.452622 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2273bf-3622-4fc9-be82-b4d9f08ab136 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:25.455942 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b89a8-0248-41e5-b034-88f011c49c6c None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:25.487935 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2b0ef-9069-40ac-940b-98a1da81b3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:25.488625 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2b0ef-9069-40ac-940b-98a1da81b3b1 None admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:25.488892 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2b0ef-9069-40ac-940b-98a1da81b3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:25.489176 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2b0ef-9069-40ac-940b-98a1da81b3b1 None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:25.489920 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2b0ef-9069-40ac-940b-98a1da81b3b1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:25.491355 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2b0ef-9069-40ac-940b-98a1da81b3b1 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:25.505072 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 22/44] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Mar 10 03:55:25 2022] POST /identity/v3/roles => generated 223 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 03:55:25.561169 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b89a8-0248-41e5-b034-88f011c49c6c None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:25.597046 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c876c9c-ff06-4b16-9ae3-6e054cee809e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:25.597950 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c876c9c-ff06-4b16-9ae3-6e054cee809e None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:25.598131 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c876c9c-ff06-4b16-9ae3-6e054cee809e None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:25.598405 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c876c9c-ff06-4b16-9ae3-6e054cee809e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:25.599607 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c876c9c-ff06-4b16-9ae3-6e054cee809e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:25.601180 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c876c9c-ff06-4b16-9ae3-6e054cee809e None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:25.603112 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 23/45] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:55:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:25.608458 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2b0ef-9069-40ac-940b-98a1da81b3b1 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:25.708726 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2b0ef-9069-40ac-940b-98a1da81b3b1 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:25.743064 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba824fe9-e302-458c-9cd7-b13623506f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:25.743748 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba824fe9-e302-458c-9cd7-b13623506f76 None admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:25.744038 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba824fe9-e302-458c-9cd7-b13623506f76 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:25.744316 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba824fe9-e302-458c-9cd7-b13623506f76 None admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:25.745030 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba824fe9-e302-458c-9cd7-b13623506f76 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:25.746482 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba824fe9-e302-458c-9cd7-b13623506f76 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:25.774681 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 23/46] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Mar 10 03:55:25 2022] POST /identity/v3/projects => generated 312 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 03:55:27.540568 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01f856-9bd6-4d57-bc73-e78bf360ec39 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:27.541067 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01f856-9bd6-4d57-bc73-e78bf360ec39 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:27.541169 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01f856-9bd6-4d57-bc73-e78bf360ec39 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:27.542918 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 24/47] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:27.548326 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb1422-31ec-4ce1-9472-2bb1b5eec5f8 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:27.548740 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb1422-31ec-4ce1-9472-2bb1b5eec5f8 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:27.548894 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb1422-31ec-4ce1-9472-2bb1b5eec5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:27.565640 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-4bbb1422-31ec-4ce1-9472-2bb1b5eec5f8 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:27.566805 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-4bbb1422-31ec-4ce1-9472-2bb1b5eec5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:27.629164 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 24/48] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 03:55:27.652110 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01f856-9bd6-4d57-bc73-e78bf360ec39 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:27.749873 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01f856-9bd6-4d57-bc73-e78bf360ec39 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:27.781211 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f701e-415e-45f0-b793-88b755a93dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:27.781996 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f701e-415e-45f0-b793-88b755a93dba None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:27.782280 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f701e-415e-45f0-b793-88b755a93dba None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:27.782555 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f701e-415e-45f0-b793-88b755a93dba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:27.793406 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f701e-415e-45f0-b793-88b755a93dba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:55:27.800383 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-a37f701e-415e-45f0-b793-88b755a93dba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 03:55:27.801591 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 25/49] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:55:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:55:27.807783 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb1422-31ec-4ce1-9472-2bb1b5eec5f8 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:27.899760 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb1422-31ec-4ce1-9472-2bb1b5eec5f8 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:27.933647 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fa7b2-99ed-49af-889f-36a3e739f1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:27.934309 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fa7b2-99ed-49af-889f-36a3e739f1a4 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:27.934594 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fa7b2-99ed-49af-889f-36a3e739f1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:27.934868 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fa7b2-99ed-49af-889f-36a3e739f1a4 None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:27.935610 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0fa7b2-99ed-49af-889f-36a3e739f1a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:27.935945 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0fa7b2-99ed-49af-889f-36a3e739f1a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:27.937345 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0fa7b2-99ed-49af-889f-36a3e739f1a4 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:27.945352 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 25/50] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:55:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:27.950782 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f701e-415e-45f0-b793-88b755a93dba None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:28.044702 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f701e-415e-45f0-b793-88b755a93dba None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:28.054351 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8488a1-fe50-4d45-950f-cab9f3676500 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:28.054647 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8488a1-fe50-4d45-950f-cab9f3676500 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:28.054928 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8488a1-fe50-4d45-950f-cab9f3676500 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:28.056722 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 26/51] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 03:55:28.061545 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bb7ae-e387-4844-b47f-652017fad4fa None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:28.061838 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bb7ae-e387-4844-b47f-652017fad4fa None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:28.062120 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bb7ae-e387-4844-b47f-652017fad4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:28.076757 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d686805-86cc-45d4-ac17-541e41cc91b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:28.077630 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d686805-86cc-45d4-ac17-541e41cc91b8 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:28.077917 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d686805-86cc-45d4-ac17-541e41cc91b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:28.078191 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d686805-86cc-45d4-ac17-541e41cc91b8 None admin] PATH_INFO: `/v3/users/7d6bd1d36bd94be08e18367ce0063fc4` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:28.078531 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-c56bb7ae-e387-4844-b47f-652017fad4fa None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:28.079613 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d686805-86cc-45d4-ac17-541e41cc91b8 None admin] RBAC: Authorizing `identity:get_user(user_id=7d6bd1d36bd94be08e18367ce0063fc4)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:28.079731 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-c56bb7ae-e387-4844-b47f-652017fad4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:28.081092 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d686805-86cc-45d4-ac17-541e41cc91b8 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:28.082759 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 26/52] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:55:27 2022] GET /identity/v3/users/7d6bd1d36bd94be08e18367ce0063fc4 => generated 247 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:28.087930 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d686805-86cc-45d4-ac17-541e41cc91b8 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:28.143994 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 27/53] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 03:55:28.167335 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56bb7ae-e387-4844-b47f-652017fad4fa None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:28.180968 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d686805-86cc-45d4-ac17-541e41cc91b8 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:28.215673 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6d893-34f0-4dc3-bde3-37b6dab1aaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:28.216480 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6d893-34f0-4dc3-bde3-37b6dab1aaaa None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:28.216763 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6d893-34f0-4dc3-bde3-37b6dab1aaaa None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:28.217044 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6d893-34f0-4dc3-bde3-37b6dab1aaaa None admin] PATH_INFO: `/v3/domains/default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:28.218207 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f6d893-34f0-4dc3-bde3-37b6dab1aaaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:28.219653 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f6d893-34f0-4dc3-bde3-37b6dab1aaaa None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:28.221296 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 27/54] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:55:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:55:28.227377 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6d893-34f0-4dc3-bde3-37b6dab1aaaa None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:28.261160 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56bb7ae-e387-4844-b47f-652017fad4fa None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:28.292779 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df676b-e8d6-46be-8368-27e4d39b127b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:28.293559 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df676b-e8d6-46be-8368-27e4d39b127b None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:28.293843 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df676b-e8d6-46be-8368-27e4d39b127b None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:28.294119 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df676b-e8d6-46be-8368-27e4d39b127b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:28.295339 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df676b-e8d6-46be-8368-27e4d39b127b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:28.296754 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df676b-e8d6-46be-8368-27e4d39b127b None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:28.298344 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 28/55] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:55:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:55:28.303925 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df676b-e8d6-46be-8368-27e4d39b127b None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:28.318993 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6d893-34f0-4dc3-bde3-37b6dab1aaaa None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:28.351081 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d2b244-8a1b-4e52-885b-5ffb9e5f3afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:28.351769 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2b244-8a1b-4e52-885b-5ffb9e5f3afc None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:28.352058 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2b244-8a1b-4e52-885b-5ffb9e5f3afc None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:28.352339 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2b244-8a1b-4e52-885b-5ffb9e5f3afc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:28.353166 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d2b244-8a1b-4e52-885b-5ffb9e5f3afc None admin] RBAC: Adding query filter params (role.id=a8b2a5887cec4a31b7304792af3dd3f1, scope.domain.id=default, user.id=7d6bd1d36bd94be08e18367ce0063fc4) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:28.353482 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d2b244-8a1b-4e52-885b-5ffb9e5f3afc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:28.354912 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d2b244-8a1b-4e52-885b-5ffb9e5f3afc None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:28.363190 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 28/56] 10.222.0.15 () {56 vars in 1322 bytes} [Thu Mar 10 03:55:28 2022] GET /identity/v3/role_assignments?user.id=7d6bd1d36bd94be08e18367ce0063fc4&scope.domain.id=default&role.id=a8b2a5887cec4a31b7304792af3dd3f1 => generated 530 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:55:28.403362 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df676b-e8d6-46be-8368-27e4d39b127b None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:28.438073 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cea225-6980-4cf1-9451-30a66372dd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:28.438745 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cea225-6980-4cf1-9451-30a66372dd56 None admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:28.439030 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cea225-6980-4cf1-9451-30a66372dd56 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:28.439308 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cea225-6980-4cf1-9451-30a66372dd56 None admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:28.440061 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cea225-6980-4cf1-9451-30a66372dd56 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:28.441551 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cea225-6980-4cf1-9451-30a66372dd56 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:28.468074 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 29/57] 10.222.0.15 () {60 vars in 1140 bytes} [Thu Mar 10 03:55:28 2022] POST /identity/v3/projects => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 03:55:30.757629 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f3033-4df6-4ae2-a3b8-6342c92c463f None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:30.758134 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f3033-4df6-4ae2-a3b8-6342c92c463f None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:30.758220 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f3033-4df6-4ae2-a3b8-6342c92c463f None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:30.760008 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 29/58] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:30.765072 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e2d2c-06bc-4b5a-ad62-0f894f29fbae None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:30.765452 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e2d2c-06bc-4b5a-ad62-0f894f29fbae None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:30.765644 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e2d2c-06bc-4b5a-ad62-0f894f29fbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:30.782167 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-ed7e2d2c-06bc-4b5a-ad62-0f894f29fbae None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:30.783333 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-ed7e2d2c-06bc-4b5a-ad62-0f894f29fbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:30.845284 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 30/59] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:55:30.870137 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f3033-4df6-4ae2-a3b8-6342c92c463f None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:30.963529 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f3033-4df6-4ae2-a3b8-6342c92c463f None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:30.994802 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf1c2c-a75d-488b-beb2-e0c1657ab6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:30.995582 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf1c2c-a75d-488b-beb2-e0c1657ab6ae None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:30.995894 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf1c2c-a75d-488b-beb2-e0c1657ab6ae None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:30.996173 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf1c2c-a75d-488b-beb2-e0c1657ab6ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:30.997322 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf1c2c-a75d-488b-beb2-e0c1657ab6ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:30.998752 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf1c2c-a75d-488b-beb2-e0c1657ab6ae None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:31.000343 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 30/60] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:55:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:31.005402 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e2d2c-06bc-4b5a-ad62-0f894f29fbae None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:31.096667 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e2d2c-06bc-4b5a-ad62-0f894f29fbae None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:31.128721 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e918a52-dd08-458d-bdbf-a621182c2203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:31.129382 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e918a52-dd08-458d-bdbf-a621182c2203 None admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:31.129669 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e918a52-dd08-458d-bdbf-a621182c2203 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:31.129950 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e918a52-dd08-458d-bdbf-a621182c2203 None admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:31.130660 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e918a52-dd08-458d-bdbf-a621182c2203 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:31.132175 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e918a52-dd08-458d-bdbf-a621182c2203 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:31.157496 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 31/61] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Mar 10 03:55:31 2022] POST /identity/v3/users => generated 275 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 03:55:34.692450 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5673b-b445-4b4e-a0e8-6be8a8c37491 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:34.693542 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5673b-b445-4b4e-a0e8-6be8a8c37491 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:34.694280 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5673b-b445-4b4e-a0e8-6be8a8c37491 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:34.696293 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 31/62] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:34.702054 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636991a-7ce6-4ec8-8d46-36b59efea78b None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:34.702966 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636991a-7ce6-4ec8-8d46-36b59efea78b None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:34.703443 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636991a-7ce6-4ec8-8d46-36b59efea78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:34.728649 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-7636991a-7ce6-4ec8-8d46-36b59efea78b None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:34.730137 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-7636991a-7ce6-4ec8-8d46-36b59efea78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:34.737918 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb458f-b3c2-4a90-a325-542f6f3bd5fc None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:34.738452 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb458f-b3c2-4a90-a325-542f6f3bd5fc None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:34.738945 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb458f-b3c2-4a90-a325-542f6f3bd5fc None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:34.741492 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 32/63] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 03:55:34.746331 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f7086-a058-48fa-9741-c123279ad335 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:34.746623 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f7086-a058-48fa-9741-c123279ad335 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:34.746909 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f7086-a058-48fa-9741-c123279ad335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:34.771747 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-c53f7086-a058-48fa-9741-c123279ad335 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:34.772965 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-c53f7086-a058-48fa-9741-c123279ad335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:34.862118 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 33/64] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 03:55:34.878222 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 32/65] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:55:34.916074 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f7086-a058-48fa-9741-c123279ad335 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:34.925282 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636991a-7ce6-4ec8-8d46-36b59efea78b None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:35.034641 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f7086-a058-48fa-9741-c123279ad335 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:35.035361 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636991a-7ce6-4ec8-8d46-36b59efea78b None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:35.069805 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97304db4-fd5a-4031-8c30-4f744767da7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:35.070617 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97304db4-fd5a-4031-8c30-4f744767da7a None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:35.070904 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97304db4-fd5a-4031-8c30-4f744767da7a None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:35.071180 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97304db4-fd5a-4031-8c30-4f744767da7a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:35.072221 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae0810-8335-4049-88e8-9b0c700a2d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:35.073028 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae0810-8335-4049-88e8-9b0c700a2d3e None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:35.073315 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae0810-8335-4049-88e8-9b0c700a2d3e None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:35.073862 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae0810-8335-4049-88e8-9b0c700a2d3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:35.081309 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97304db4-fd5a-4031-8c30-4f744767da7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:55:35.083488 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae0810-8335-4049-88e8-9b0c700a2d3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:55:35.089148 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-97304db4-fd5a-4031-8c30-4f744767da7a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 10 03:55:35.090327 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 33/66] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Mar 10 03:55:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:55:35.092397 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-42ae0810-8335-4049-88e8-9b0c700a2d3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 03:55:35.092483 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5446fc-48e7-409c-aad7-924ae9bec446 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:35.092483 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5446fc-48e7-409c-aad7-924ae9bec446 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:35.092621 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 34/67] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:55:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:55:35.092690 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5446fc-48e7-409c-aad7-924ae9bec446 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:35.093300 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505db28-126c-4804-a3d3-6627bc90e8f2 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:35.093727 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505db28-126c-4804-a3d3-6627bc90e8f2 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:35.094132 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505db28-126c-4804-a3d3-6627bc90e8f2 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:35.095971 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 34/68] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:35.097196 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d50f0-d6b6-4f00-973f-fe9c058705fe None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:35.097708 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d50f0-d6b6-4f00-973f-fe9c058705fe None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:35.098187 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d50f0-d6b6-4f00-973f-fe9c058705fe None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:35.098322 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 35/69] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:35.099116 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505db28-126c-4804-a3d3-6627bc90e8f2 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:35.100501 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 35/70] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:35.101205 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d50f0-d6b6-4f00-973f-fe9c058705fe None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:35.195076 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505db28-126c-4804-a3d3-6627bc90e8f2 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:35.197263 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d50f0-d6b6-4f00-973f-fe9c058705fe None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:35.226211 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccce85-e17a-4165-934f-85cf50c94a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:35.227049 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccce85-e17a-4165-934f-85cf50c94a3e None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:35.227497 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccce85-e17a-4165-934f-85cf50c94a3e None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:35.227873 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccce85-e17a-4165-934f-85cf50c94a3e None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:35.228619 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eccce85-e17a-4165-934f-85cf50c94a3e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:35.228925 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eccce85-e17a-4165-934f-85cf50c94a3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:35.229451 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2543f7-7d4d-4872-80d4-ced2b32400b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:35.230113 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2543f7-7d4d-4872-80d4-ced2b32400b3 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:35.230295 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eccce85-e17a-4165-934f-85cf50c94a3e None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:35.230402 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2543f7-7d4d-4872-80d4-ced2b32400b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:35.230683 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2543f7-7d4d-4872-80d4-ced2b32400b3 None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:35.231427 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2543f7-7d4d-4872-80d4-ced2b32400b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:35.231769 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2543f7-7d4d-4872-80d4-ced2b32400b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:35.233143 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2543f7-7d4d-4872-80d4-ced2b32400b3 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:35.246271 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 36/71] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:55:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:35.246435 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 36/72] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:55:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:35.246522 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5356681-10d5-4277-839d-b31b2e5e1092 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:35.246589 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa03db-5b57-44c9-a450-423c4c7ebb1f None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:35.246664 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5356681-10d5-4277-839d-b31b2e5e1092 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:35.246740 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa03db-5b57-44c9-a450-423c4c7ebb1f None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:35.246823 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5356681-10d5-4277-839d-b31b2e5e1092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:35.246900 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa03db-5b57-44c9-a450-423c4c7ebb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:35.260216 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-f5356681-10d5-4277-839d-b31b2e5e1092 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:35.260352 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-8efa03db-5b57-44c9-a450-423c4c7ebb1f None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:35.261380 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-f5356681-10d5-4277-839d-b31b2e5e1092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:35.261497 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-8efa03db-5b57-44c9-a450-423c4c7ebb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:35.322659 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 37/73] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:55:35.323986 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ac243-3b81-4c4b-9978-bd75862c4452 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:35.335826 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ac243-3b81-4c4b-9978-bd75862c4452 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:35.335953 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 37/74] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:55:35.336055 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ac243-3b81-4c4b-9978-bd75862c4452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:35.336126 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa03db-5b57-44c9-a450-423c4c7ebb1f None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:35.340518 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-8b4ac243-3b81-4c4b-9978-bd75862c4452 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:35.341678 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-8b4ac243-3b81-4c4b-9978-bd75862c4452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:35.403543 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 38/75] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:55:35.410732 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ac243-3b81-4c4b-9978-bd75862c4452 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:35.434577 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa03db-5b57-44c9-a450-423c4c7ebb1f None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:35.467253 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66185ba-7e2a-4183-a1c4-498eeb347b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:35.468142 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66185ba-7e2a-4183-a1c4-498eeb347b5b None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:35.468429 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66185ba-7e2a-4183-a1c4-498eeb347b5b None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:35.468711 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66185ba-7e2a-4183-a1c4-498eeb347b5b None admin] PATH_INFO: `/v3/users/96a9b787ace2448a9a22c86d6847863f` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:35.481103 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66185ba-7e2a-4183-a1c4-498eeb347b5b None admin] RBAC: Authorizing `identity:get_user(user_id=96a9b787ace2448a9a22c86d6847863f)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:35.482560 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66185ba-7e2a-4183-a1c4-498eeb347b5b None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:35.484226 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 38/76] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:55:35 2022] GET /identity/v3/users/96a9b787ace2448a9a22c86d6847863f => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:35.484986 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66185ba-7e2a-4183-a1c4-498eeb347b5b None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:35.497194 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ac243-3b81-4c4b-9978-bd75862c4452 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:35.529424 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90e9cf-3cce-4582-b3e7-39c52a6382c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:35.530292 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90e9cf-3cce-4582-b3e7-39c52a6382c1 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:35.530580 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90e9cf-3cce-4582-b3e7-39c52a6382c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:35.530859 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90e9cf-3cce-4582-b3e7-39c52a6382c1 None admin] PATH_INFO: `/v3/users/7d6bd1d36bd94be08e18367ce0063fc4` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:35.532123 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90e9cf-3cce-4582-b3e7-39c52a6382c1 None admin] RBAC: Authorizing `identity:get_user(user_id=7d6bd1d36bd94be08e18367ce0063fc4)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:35.533574 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90e9cf-3cce-4582-b3e7-39c52a6382c1 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:35.535180 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 39/77] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:55:35 2022] GET /identity/v3/users/7d6bd1d36bd94be08e18367ce0063fc4 => generated 247 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:35.535964 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90e9cf-3cce-4582-b3e7-39c52a6382c1 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:35.580795 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66185ba-7e2a-4183-a1c4-498eeb347b5b None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:35.612413 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de156ca1-e964-4ee3-a9dd-6caa580b8241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:35.613216 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de156ca1-e964-4ee3-a9dd-6caa580b8241 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:35.613485 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de156ca1-e964-4ee3-a9dd-6caa580b8241 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:35.613764 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de156ca1-e964-4ee3-a9dd-6caa580b8241 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:35.623389 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de156ca1-e964-4ee3-a9dd-6caa580b8241 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:55:35.626993 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90e9cf-3cce-4582-b3e7-39c52a6382c1 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:35.630319 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-de156ca1-e964-4ee3-a9dd-6caa580b8241 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 03:55:35.632046 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 39/78] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:55:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:55:35.632808 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de156ca1-e964-4ee3-a9dd-6caa580b8241 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:35.659513 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a9492-e4ee-4d70-bfb7-15deb78b9eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:35.660351 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a9492-e4ee-4d70-bfb7-15deb78b9eb2 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:35.660635 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a9492-e4ee-4d70-bfb7-15deb78b9eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:35.660907 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a9492-e4ee-4d70-bfb7-15deb78b9eb2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:35.670430 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a9492-e4ee-4d70-bfb7-15deb78b9eb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:55:35.677413 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-695a9492-e4ee-4d70-bfb7-15deb78b9eb2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 03:55:35.679071 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 40/79] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:55:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:55:35.679893 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a9492-e4ee-4d70-bfb7-15deb78b9eb2 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:35.729111 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de156ca1-e964-4ee3-a9dd-6caa580b8241 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:35.760633 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e26eee-c6c9-4149-8392-2617164fea5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:35.761407 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e26eee-c6c9-4149-8392-2617164fea5e None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:35.761689 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e26eee-c6c9-4149-8392-2617164fea5e None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:35.761965 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e26eee-c6c9-4149-8392-2617164fea5e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:35.763117 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e26eee-c6c9-4149-8392-2617164fea5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:35.764597 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e26eee-c6c9-4149-8392-2617164fea5e None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:35.766177 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 40/80] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:55:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:35.766931 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e26eee-c6c9-4149-8392-2617164fea5e None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:35.772276 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a9492-e4ee-4d70-bfb7-15deb78b9eb2 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:35.803789 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bb92b-8679-4d21-af53-b513a60ce275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:35.804430 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bb92b-8679-4d21-af53-b513a60ce275 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:35.804719 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bb92b-8679-4d21-af53-b513a60ce275 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:35.805362 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bb92b-8679-4d21-af53-b513a60ce275 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:35.858324 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e26eee-c6c9-4149-8392-2617164fea5e None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:35.867008 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bb92b-8679-4d21-af53-b513a60ce275 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:35.868510 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bb92b-8679-4d21-af53-b513a60ce275 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:35.889981 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcc80b-987c-49d7-9f00-cc8fc7fa36ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:35.890617 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcc80b-987c-49d7-9f00-cc8fc7fa36ac None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:35.890902 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcc80b-987c-49d7-9f00-cc8fc7fa36ac None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:35.891178 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcc80b-987c-49d7-9f00-cc8fc7fa36ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:35.953529 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efcc80b-987c-49d7-9f00-cc8fc7fa36ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:35.954983 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efcc80b-987c-49d7-9f00-cc8fc7fa36ac None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:35.958953 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 41/81] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:55:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:55:35.959777 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bb92b-8679-4d21-af53-b513a60ce275 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:36.046709 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 41/82] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:55:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:55:36.047546 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcc80b-987c-49d7-9f00-cc8fc7fa36ac None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:36.052485 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bb92b-8679-4d21-af53-b513a60ce275 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:36.084992 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275cc9ae-151f-454e-9243-7d95ca1f1ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:36.085659 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cc9ae-151f-454e-9243-7d95ca1f1ed8 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:36.085949 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cc9ae-151f-454e-9243-7d95ca1f1ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:36.086231 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275cc9ae-151f-454e-9243-7d95ca1f1ed8 None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:36.086981 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275cc9ae-151f-454e-9243-7d95ca1f1ed8 None admin] RBAC: Adding query filter params (name=member) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:36.087292 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275cc9ae-151f-454e-9243-7d95ca1f1ed8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:36.088688 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275cc9ae-151f-454e-9243-7d95ca1f1ed8 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:36.096349 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 42/83] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Mar 10 03:55:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:36.097108 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275cc9ae-151f-454e-9243-7d95ca1f1ed8 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:36.140172 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcc80b-987c-49d7-9f00-cc8fc7fa36ac None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:36.171727 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879b688-4fe7-4e73-b971-daaefb9c1329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:36.172393 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879b688-4fe7-4e73-b971-daaefb9c1329 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:36.172675 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879b688-4fe7-4e73-b971-daaefb9c1329 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:36.172956 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879b688-4fe7-4e73-b971-daaefb9c1329 None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:36.173699 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879b688-4fe7-4e73-b971-daaefb9c1329 None admin] RBAC: Adding query filter params (name=member) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:36.174011 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879b688-4fe7-4e73-b971-daaefb9c1329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:36.175372 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879b688-4fe7-4e73-b971-daaefb9c1329 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:36.183562 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 42/84] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Mar 10 03:55:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:36.184363 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879b688-4fe7-4e73-b971-daaefb9c1329 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:36.188136 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275cc9ae-151f-454e-9243-7d95ca1f1ed8 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:36.218734 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34b772-d43a-495c-b7fa-8abad7cf12b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:36.219388 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34b772-d43a-495c-b7fa-8abad7cf12b4 None admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:36.219671 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34b772-d43a-495c-b7fa-8abad7cf12b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:36.219973 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34b772-d43a-495c-b7fa-8abad7cf12b4 None admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:36.220680 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd34b772-d43a-495c-b7fa-8abad7cf12b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:36.222096 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd34b772-d43a-495c-b7fa-8abad7cf12b4 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:36.247703 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 43/85] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Mar 10 03:55:36 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 03:55:36.256745 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34b772-d43a-495c-b7fa-8abad7cf12b4 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:36.284911 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879b688-4fe7-4e73-b971-daaefb9c1329 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:36.321755 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa6277-ea02-4e3d-8798-f989effebfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:36.322643 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa6277-ea02-4e3d-8798-f989effebfde None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:36.322931 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa6277-ea02-4e3d-8798-f989effebfde None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:36.323208 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa6277-ea02-4e3d-8798-f989effebfde None admin] PATH_INFO: `/v3/projects/296b04835db8494cbdfa27b87fe62760` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:36.324522 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa6277-ea02-4e3d-8798-f989effebfde None admin] RBAC: Authorizing `identity:get_project(project_id=296b04835db8494cbdfa27b87fe62760)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:36.326015 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa6277-ea02-4e3d-8798-f989effebfde None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:36.327802 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 43/86] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:55:36 2022] GET /identity/v3/projects/296b04835db8494cbdfa27b87fe62760 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:36.333526 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa6277-ea02-4e3d-8798-f989effebfde None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:36.361355 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34b772-d43a-495c-b7fa-8abad7cf12b4 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:36.397457 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6da21e-4f64-4510-925b-bd69f415fb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:36.398246 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6da21e-4f64-4510-925b-bd69f415fb0a None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:36.398586 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6da21e-4f64-4510-925b-bd69f415fb0a None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:36.398868 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6da21e-4f64-4510-925b-bd69f415fb0a None admin] PATH_INFO: `/v3/projects/296b04835db8494cbdfa27b87fe62760` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:36.400161 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6da21e-4f64-4510-925b-bd69f415fb0a None admin] RBAC: Authorizing `identity:get_project(project_id=296b04835db8494cbdfa27b87fe62760)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:36.401659 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6da21e-4f64-4510-925b-bd69f415fb0a None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:36.403433 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 44/87] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:55:36 2022] GET /identity/v3/projects/296b04835db8494cbdfa27b87fe62760 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:36.404260 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6da21e-4f64-4510-925b-bd69f415fb0a None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:36.440635 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa6277-ea02-4e3d-8798-f989effebfde None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:36.474271 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af21ea-4929-4568-99e6-a2c681cd4ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:36.475756 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af21ea-4929-4568-99e6-a2c681cd4ae9 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:36.476048 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af21ea-4929-4568-99e6-a2c681cd4ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:36.476328 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af21ea-4929-4568-99e6-a2c681cd4ae9 None admin] PATH_INFO: `/v3/users/96a9b787ace2448a9a22c86d6847863f` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:36.477641 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af21ea-4929-4568-99e6-a2c681cd4ae9 None admin] RBAC: Authorizing `identity:get_user(user_id=96a9b787ace2448a9a22c86d6847863f)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:36.479139 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af21ea-4929-4568-99e6-a2c681cd4ae9 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:36.481034 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 44/88] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:55:36 2022] GET /identity/v3/users/96a9b787ace2448a9a22c86d6847863f => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:36.481645 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af21ea-4929-4568-99e6-a2c681cd4ae9 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:36.506048 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6da21e-4f64-4510-925b-bd69f415fb0a None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:36.543899 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e96500-b2ef-469c-b8f2-209bec6934e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:36.544792 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e96500-b2ef-469c-b8f2-209bec6934e9 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:36.545079 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e96500-b2ef-469c-b8f2-209bec6934e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:36.545356 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e96500-b2ef-469c-b8f2-209bec6934e9 None admin] PATH_INFO: `/v3/users/96a9b787ace2448a9a22c86d6847863f` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:36.547251 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e96500-b2ef-469c-b8f2-209bec6934e9 None admin] RBAC: Authorizing `identity:get_user(user_id=96a9b787ace2448a9a22c86d6847863f)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:36.548742 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e96500-b2ef-469c-b8f2-209bec6934e9 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:36.550448 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 45/89] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:55:36 2022] GET /identity/v3/users/96a9b787ace2448a9a22c86d6847863f => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:36.551161 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e96500-b2ef-469c-b8f2-209bec6934e9 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:36.584615 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af21ea-4929-4568-99e6-a2c681cd4ae9 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:36.625403 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a08c29-3097-469e-aeaf-e899dc2ad984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:36.626428 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a08c29-3097-469e-aeaf-e899dc2ad984 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:36.626940 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a08c29-3097-469e-aeaf-e899dc2ad984 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:36.627419 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a08c29-3097-469e-aeaf-e899dc2ad984 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:36.628493 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a08c29-3097-469e-aeaf-e899dc2ad984 None admin] RBAC: Adding query filter params (role.id=c38b04db9cd34eeaaaa8d2a6425c05ad, scope.project.id=296b04835db8494cbdfa27b87fe62760, user.id=96a9b787ace2448a9a22c86d6847863f) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:36.629029 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a08c29-3097-469e-aeaf-e899dc2ad984 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:36.630729 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a08c29-3097-469e-aeaf-e899dc2ad984 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:36.637184 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 45/90] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:55:36 2022] GET /identity/v3/role_assignments?user.id=96a9b787ace2448a9a22c86d6847863f&scope.project.id=296b04835db8494cbdfa27b87fe62760&role.id=c38b04db9cd34eeaaaa8d2a6425c05ad => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:36.638217 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a08c29-3097-469e-aeaf-e899dc2ad984 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:36.661117 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e96500-b2ef-469c-b8f2-209bec6934e9 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:36.718012 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52bdadc-cf55-4afe-b9ab-30877412da22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:36.718991 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bdadc-cf55-4afe-b9ab-30877412da22 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:36.718991 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bdadc-cf55-4afe-b9ab-30877412da22 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:36.719295 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bdadc-cf55-4afe-b9ab-30877412da22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:36.720104 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52bdadc-cf55-4afe-b9ab-30877412da22 None admin] RBAC: Adding query filter params (role.id=a8b2a5887cec4a31b7304792af3dd3f1, scope.project.id=296b04835db8494cbdfa27b87fe62760, user.id=7d6bd1d36bd94be08e18367ce0063fc4) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:36.720413 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52bdadc-cf55-4afe-b9ab-30877412da22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:36.721864 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52bdadc-cf55-4afe-b9ab-30877412da22 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:36.728536 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 46/91] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:55:36 2022] GET /identity/v3/role_assignments?user.id=7d6bd1d36bd94be08e18367ce0063fc4&scope.project.id=296b04835db8494cbdfa27b87fe62760&role.id=a8b2a5887cec4a31b7304792af3dd3f1 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:36.729103 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52bdadc-cf55-4afe-b9ab-30877412da22 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:36.747659 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a08c29-3097-469e-aeaf-e899dc2ad984 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:36.794726 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38771c88-a6e0-49e1-a7cb-e79dae526ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:36.795838 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38771c88-a6e0-49e1-a7cb-e79dae526ecc None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:36.796356 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38771c88-a6e0-49e1-a7cb-e79dae526ecc None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:36.797791 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38771c88-a6e0-49e1-a7cb-e79dae526ecc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:36.956860 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52bdadc-cf55-4afe-b9ab-30877412da22 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:36.958320 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38771c88-a6e0-49e1-a7cb-e79dae526ecc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:36.962194 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38771c88-a6e0-49e1-a7cb-e79dae526ecc None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:37.015571 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321936b-a0d0-4d80-b499-051c4dc442fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:37.016599 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321936b-a0d0-4d80-b499-051c4dc442fb None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:37.017098 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321936b-a0d0-4d80-b499-051c4dc442fb None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:37.017567 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321936b-a0d0-4d80-b499-051c4dc442fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:37.088079 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321936b-a0d0-4d80-b499-051c4dc442fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:37.089865 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321936b-a0d0-4d80-b499-051c4dc442fb None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:37.102055 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 46/92] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:55:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:55:37.108657 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38771c88-a6e0-49e1-a7cb-e79dae526ecc None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:37.188492 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 47/93] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:55:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:55:37.196647 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321936b-a0d0-4d80-b499-051c4dc442fb None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:37.217023 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38771c88-a6e0-49e1-a7cb-e79dae526ecc None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:37.261363 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866ef08-b4b7-47c5-bdd1-09bcc01f1b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:37.262242 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866ef08-b4b7-47c5-bdd1-09bcc01f1b67 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:37.262523 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866ef08-b4b7-47c5-bdd1-09bcc01f1b67 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:37.262798 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866ef08-b4b7-47c5-bdd1-09bcc01f1b67 None admin] PATH_INFO: `/v3/projects/296b04835db8494cbdfa27b87fe62760` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:37.268480 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866ef08-b4b7-47c5-bdd1-09bcc01f1b67 None admin] RBAC: Authorizing `identity:get_project(project_id=296b04835db8494cbdfa27b87fe62760)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:37.270046 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866ef08-b4b7-47c5-bdd1-09bcc01f1b67 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:37.272274 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 47/94] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:55:37 2022] GET /identity/v3/projects/296b04835db8494cbdfa27b87fe62760 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:37.277877 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866ef08-b4b7-47c5-bdd1-09bcc01f1b67 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:37.307886 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321936b-a0d0-4d80-b499-051c4dc442fb None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:37.350279 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38379b3-47c2-4298-b636-1a1e96f71c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:37.351512 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38379b3-47c2-4298-b636-1a1e96f71c55 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:37.352005 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38379b3-47c2-4298-b636-1a1e96f71c55 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:37.352493 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38379b3-47c2-4298-b636-1a1e96f71c55 None admin] PATH_INFO: `/v3/projects/5c1ee3b04f6343f1a44e57e4f26f7361` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:37.353893 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38379b3-47c2-4298-b636-1a1e96f71c55 None admin] RBAC: Authorizing `identity:get_project(project_id=5c1ee3b04f6343f1a44e57e4f26f7361)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:37.355619 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38379b3-47c2-4298-b636-1a1e96f71c55 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:37.357590 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 48/95] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:55:37 2022] GET /identity/v3/projects/5c1ee3b04f6343f1a44e57e4f26f7361 => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:37.363395 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38379b3-47c2-4298-b636-1a1e96f71c55 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:37.404562 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866ef08-b4b7-47c5-bdd1-09bcc01f1b67 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:37.480591 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38379b3-47c2-4298-b636-1a1e96f71c55 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:37.488455 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3f3b4-52c0-42af-a338-b85d23a7ec0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:37.489032 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3f3b4-52c0-42af-a338-b85d23a7ec0e None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:37.489315 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3f3b4-52c0-42af-a338-b85d23a7ec0e None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:37.489591 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3f3b4-52c0-42af-a338-b85d23a7ec0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:37.490468 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba3f3b4-52c0-42af-a338-b85d23a7ec0e None admin] RBAC: Adding query filter params (role.id=73b2aee45a2d4be19addaf4a33414295, scope.project.id=296b04835db8494cbdfa27b87fe62760, user.id=96a9b787ace2448a9a22c86d6847863f) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:37.490777 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba3f3b4-52c0-42af-a338-b85d23a7ec0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:37.492265 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba3f3b4-52c0-42af-a338-b85d23a7ec0e None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:37.506375 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 48/96] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:55:37 2022] GET /identity/v3/role_assignments?user.id=96a9b787ace2448a9a22c86d6847863f&scope.project.id=296b04835db8494cbdfa27b87fe62760&role.id=73b2aee45a2d4be19addaf4a33414295 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:55:37.526163 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258447c-ffa8-4489-a062-179ba8237007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:37.526846 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258447c-ffa8-4489-a062-179ba8237007 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:37.527127 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258447c-ffa8-4489-a062-179ba8237007 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:37.527406 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258447c-ffa8-4489-a062-179ba8237007 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:37.528300 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258447c-ffa8-4489-a062-179ba8237007 None admin] RBAC: Adding query filter params (role.id=73b2aee45a2d4be19addaf4a33414295, scope.project.id=5c1ee3b04f6343f1a44e57e4f26f7361, user.id=96a9b787ace2448a9a22c86d6847863f) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:37.528618 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258447c-ffa8-4489-a062-179ba8237007 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:37.530089 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258447c-ffa8-4489-a062-179ba8237007 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:37.540813 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 49/97] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:55:37 2022] GET /identity/v3/role_assignments?user.id=96a9b787ace2448a9a22c86d6847863f&scope.project.id=5c1ee3b04f6343f1a44e57e4f26f7361&role.id=73b2aee45a2d4be19addaf4a33414295 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:55:39.350375 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f59b2-3dfa-4e47-ac20-a0f1e753d374 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:39.350959 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f59b2-3dfa-4e47-ac20-a0f1e753d374 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:39.350959 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f59b2-3dfa-4e47-ac20-a0f1e753d374 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:39.353001 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 49/98] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:39.353136 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00a85f-aeda-4e22-8ff9-17c0e4aa015a None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:39.353536 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00a85f-aeda-4e22-8ff9-17c0e4aa015a None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:39.353536 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00a85f-aeda-4e22-8ff9-17c0e4aa015a None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:39.355311 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 50/99] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 03:55:39.357994 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282acf53-95ae-443d-8e8d-e26a4f854fd1 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:39.358542 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282acf53-95ae-443d-8e8d-e26a4f854fd1 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:39.359025 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282acf53-95ae-443d-8e8d-e26a4f854fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:39.360539 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f936755-c915-44b5-88c9-aebc0195639d None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:39.361045 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f936755-c915-44b5-88c9-aebc0195639d None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:39.361519 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f936755-c915-44b5-88c9-aebc0195639d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:39.397463 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-282acf53-95ae-443d-8e8d-e26a4f854fd1 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:39.399089 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-282acf53-95ae-443d-8e8d-e26a4f854fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:39.403197 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-9f936755-c915-44b5-88c9-aebc0195639d None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:39.404809 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-9f936755-c915-44b5-88c9-aebc0195639d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:39.546135 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 50/100] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:55:39.570804 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 51/101] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:55:39.600167 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282acf53-95ae-443d-8e8d-e26a4f854fd1 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:39.623303 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f936755-c915-44b5-88c9-aebc0195639d None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:39.791421 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282acf53-95ae-443d-8e8d-e26a4f854fd1 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:39.833936 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f936755-c915-44b5-88c9-aebc0195639d None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:39.865899 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5df4f5-96a6-4473-868c-d91940b239d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:39.867092 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5df4f5-96a6-4473-868c-d91940b239d1 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:39.867578 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5df4f5-96a6-4473-868c-d91940b239d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:39.868104 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5df4f5-96a6-4473-868c-d91940b239d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:39.869809 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5df4f5-96a6-4473-868c-d91940b239d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:39.871472 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5df4f5-96a6-4473-868c-d91940b239d1 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:39.873652 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 51/102] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:55:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:39.878760 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5df4f5-96a6-4473-868c-d91940b239d1 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:39.910482 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b20a9-028c-44ad-b9a3-fd8900ff95aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:39.911270 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b20a9-028c-44ad-b9a3-fd8900ff95aa None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:39.911556 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b20a9-028c-44ad-b9a3-fd8900ff95aa None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:39.912538 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b20a9-028c-44ad-b9a3-fd8900ff95aa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:39.940610 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b20a9-028c-44ad-b9a3-fd8900ff95aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:55:39.949196 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-328b20a9-028c-44ad-b9a3-fd8900ff95aa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 10 03:55:39.955845 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 52/103] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:55:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:55:39.957913 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b20a9-028c-44ad-b9a3-fd8900ff95aa None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:40.091453 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5df4f5-96a6-4473-868c-d91940b239d1 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:40.123102 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b20a9-028c-44ad-b9a3-fd8900ff95aa None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:40.157176 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929426d9-1f53-47c0-ba5b-655b907e15be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:40.157850 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929426d9-1f53-47c0-ba5b-655b907e15be None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:40.158170 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929426d9-1f53-47c0-ba5b-655b907e15be None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:40.158452 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929426d9-1f53-47c0-ba5b-655b907e15be None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:40.159202 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929426d9-1f53-47c0-ba5b-655b907e15be None admin] RBAC: Adding query filter params (name=reader) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:40.159507 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929426d9-1f53-47c0-ba5b-655b907e15be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:40.160909 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929426d9-1f53-47c0-ba5b-655b907e15be None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:40.169298 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 53/104] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Mar 10 03:55:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:55:40.174997 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda17651-206d-4314-88b6-37210bcc960e None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:40.175288 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda17651-206d-4314-88b6-37210bcc960e None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:40.175666 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda17651-206d-4314-88b6-37210bcc960e None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:40.178048 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 54/105] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:40.179022 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda17651-206d-4314-88b6-37210bcc960e None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:40.179561 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b7cd7-a66c-40a1-9c85-9e18ed82f9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:40.180255 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b7cd7-a66c-40a1-9c85-9e18ed82f9aa None admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:40.180544 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b7cd7-a66c-40a1-9c85-9e18ed82f9aa None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:40.180826 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b7cd7-a66c-40a1-9c85-9e18ed82f9aa None admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:40.181557 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b7cd7-a66c-40a1-9c85-9e18ed82f9aa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:40.183021 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b7cd7-a66c-40a1-9c85-9e18ed82f9aa None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:40.249631 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 52/106] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Mar 10 03:55:39 2022] POST /identity/v3/projects => generated 302 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 03:55:40.250959 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1ad6a-bee1-4419-98dd-0f537caa635d None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:40.251251 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1ad6a-bee1-4419-98dd-0f537caa635d None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:40.251539 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1ad6a-bee1-4419-98dd-0f537caa635d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:40.283911 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-39a1ad6a-bee1-4419-98dd-0f537caa635d None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:40.285107 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-39a1ad6a-bee1-4419-98dd-0f537caa635d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:40.300779 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda17651-206d-4314-88b6-37210bcc960e None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:40.336951 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8eebb9-b58f-4293-93e3-2bf81a438603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:40.337963 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8eebb9-b58f-4293-93e3-2bf81a438603 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:40.338247 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8eebb9-b58f-4293-93e3-2bf81a438603 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:40.338517 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8eebb9-b58f-4293-93e3-2bf81a438603 None admin] PATH_INFO: `/v3/users/0d455a3b0b5344c48eae404262081862` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:40.356412 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8eebb9-b58f-4293-93e3-2bf81a438603 None admin] RBAC: Authorizing `identity:get_user(user_id=0d455a3b0b5344c48eae404262081862)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:40.357828 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8eebb9-b58f-4293-93e3-2bf81a438603 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:40.359796 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 55/107] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:55:40 2022] GET /identity/v3/users/0d455a3b0b5344c48eae404262081862 => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:55:40.366326 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8eebb9-b58f-4293-93e3-2bf81a438603 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:40.400326 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 53/108] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:55:40.423824 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1ad6a-bee1-4419-98dd-0f537caa635d None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:40.471522 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8eebb9-b58f-4293-93e3-2bf81a438603 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:40.507075 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86a5f1-e40d-4628-8c6a-a02533682bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:40.508087 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86a5f1-e40d-4628-8c6a-a02533682bae None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:40.508524 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86a5f1-e40d-4628-8c6a-a02533682bae None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:40.508973 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86a5f1-e40d-4628-8c6a-a02533682bae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:40.532994 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1ad6a-bee1-4419-98dd-0f537caa635d None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:40.588417 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa86a5f1-e40d-4628-8c6a-a02533682bae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:40.590315 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa86a5f1-e40d-4628-8c6a-a02533682bae None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:40.611298 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd175ee2-420c-4d66-8a6b-2006eb7d9777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:40.612236 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd175ee2-420c-4d66-8a6b-2006eb7d9777 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:40.612646 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd175ee2-420c-4d66-8a6b-2006eb7d9777 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:40.616182 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd175ee2-420c-4d66-8a6b-2006eb7d9777 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:40.647882 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd175ee2-420c-4d66-8a6b-2006eb7d9777 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:55:40.655311 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-dd175ee2-420c-4d66-8a6b-2006eb7d9777 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 10 03:55:40.664834 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 54/109] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Mar 10 03:55:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:55:40.670679 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd175ee2-420c-4d66-8a6b-2006eb7d9777 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:40.698768 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 56/110] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:55:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 10 03:55:40.705372 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86a5f1-e40d-4628-8c6a-a02533682bae None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:40.805770 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86a5f1-e40d-4628-8c6a-a02533682bae None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:40.816599 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd175ee2-420c-4d66-8a6b-2006eb7d9777 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:40.840123 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee9c6d-264a-4f6b-9531-b245b9aaed25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:40.841238 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee9c6d-264a-4f6b-9531-b245b9aaed25 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:40.841672 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee9c6d-264a-4f6b-9531-b245b9aaed25 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:40.842095 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee9c6d-264a-4f6b-9531-b245b9aaed25 None admin] PATH_INFO: `/v3/projects/296b04835db8494cbdfa27b87fe62760` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:40.843543 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee9c6d-264a-4f6b-9531-b245b9aaed25 None admin] RBAC: Authorizing `identity:get_project(project_id=296b04835db8494cbdfa27b87fe62760)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:40.845209 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee9c6d-264a-4f6b-9531-b245b9aaed25 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:40.847132 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 57/111] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:55:40 2022] GET /identity/v3/projects/296b04835db8494cbdfa27b87fe62760 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:55:40.852953 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee9c6d-264a-4f6b-9531-b245b9aaed25 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:40.861504 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79750e64-d184-4752-94a2-865a0472fab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:40.862499 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79750e64-d184-4752-94a2-865a0472fab6 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:40.862499 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79750e64-d184-4752-94a2-865a0472fab6 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:40.862707 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79750e64-d184-4752-94a2-865a0472fab6 None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:40.863426 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79750e64-d184-4752-94a2-865a0472fab6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:40.863761 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79750e64-d184-4752-94a2-865a0472fab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:40.865227 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79750e64-d184-4752-94a2-865a0472fab6 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:40.877878 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 55/112] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:55:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:40.884038 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79750e64-d184-4752-94a2-865a0472fab6 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:40.954673 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee9c6d-264a-4f6b-9531-b245b9aaed25 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:40.989024 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97c2fd-4d60-4501-b4a6-58a0050c3215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:40.990620 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97c2fd-4d60-4501-b4a6-58a0050c3215 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:40.991318 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97c2fd-4d60-4501-b4a6-58a0050c3215 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:40.991782 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97c2fd-4d60-4501-b4a6-58a0050c3215 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:40.992910 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97c2fd-4d60-4501-b4a6-58a0050c3215 None admin] RBAC: Adding query filter params (role.id=5daf615f445643608474ea1432d21e42, scope.project.id=296b04835db8494cbdfa27b87fe62760, user.id=0d455a3b0b5344c48eae404262081862) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:40.993466 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97c2fd-4d60-4501-b4a6-58a0050c3215 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:40.995711 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97c2fd-4d60-4501-b4a6-58a0050c3215 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:40.997857 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79750e64-d184-4752-94a2-865a0472fab6 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:41.002837 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 58/113] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:55:40 2022] GET /identity/v3/role_assignments?user.id=0d455a3b0b5344c48eae404262081862&scope.project.id=296b04835db8494cbdfa27b87fe62760&role.id=5daf615f445643608474ea1432d21e42 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:55:41.004495 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ec9b0-78ff-4aff-af43-96d7f049f6e1 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:41.004927 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ec9b0-78ff-4aff-af43-96d7f049f6e1 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:41.005364 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ec9b0-78ff-4aff-af43-96d7f049f6e1 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:41.008924 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 59/114] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:41.014960 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977e317-14ae-433b-b70f-d6db8ac4a7a3 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:41.015482 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977e317-14ae-433b-b70f-d6db8ac4a7a3 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:41.015944 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977e317-14ae-433b-b70f-d6db8ac4a7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:41.036835 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320790b-f5af-4400-a690-2ecdb69e49a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:41.037651 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-8977e317-14ae-433b-b70f-d6db8ac4a7a3 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:41.038006 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320790b-f5af-4400-a690-2ecdb69e49a5 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:41.038387 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320790b-f5af-4400-a690-2ecdb69e49a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:41.038763 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320790b-f5af-4400-a690-2ecdb69e49a5 None admin] PATH_INFO: `/v3/users/96a9b787ace2448a9a22c86d6847863f` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:41.039526 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-8977e317-14ae-433b-b70f-d6db8ac4a7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:41.040314 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320790b-f5af-4400-a690-2ecdb69e49a5 None admin] RBAC: Authorizing `identity:get_user(user_id=96a9b787ace2448a9a22c86d6847863f)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:41.042167 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320790b-f5af-4400-a690-2ecdb69e49a5 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:41.043975 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 56/115] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:55:40 2022] GET /identity/v3/users/96a9b787ace2448a9a22c86d6847863f => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:55:41.049411 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320790b-f5af-4400-a690-2ecdb69e49a5 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:41.162109 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 60/116] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:55:41.163185 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be3063-5cd1-466e-849c-ce292485b903 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:41.163478 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be3063-5cd1-466e-849c-ce292485b903 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:41.163783 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be3063-5cd1-466e-849c-ce292485b903 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:41.166897 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 61/117] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:41.172556 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b4648-19ca-4883-bde5-c61eb68d37c0 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:41.172846 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b4648-19ca-4883-bde5-c61eb68d37c0 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:41.173128 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b4648-19ca-4883-bde5-c61eb68d37c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:41.207340 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-935b4648-19ca-4883-bde5-c61eb68d37c0 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:41.209029 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-935b4648-19ca-4883-bde5-c61eb68d37c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:41.236380 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320790b-f5af-4400-a690-2ecdb69e49a5 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:41.275322 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa2c78-fac3-428d-8ee6-a45024b4b78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:41.276237 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa2c78-fac3-428d-8ee6-a45024b4b78b None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:41.276648 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa2c78-fac3-428d-8ee6-a45024b4b78b None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:41.276854 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa2c78-fac3-428d-8ee6-a45024b4b78b None admin] PATH_INFO: `/v3/projects/296b04835db8494cbdfa27b87fe62760` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:41.278110 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa2c78-fac3-428d-8ee6-a45024b4b78b None admin] RBAC: Authorizing `identity:get_project(project_id=296b04835db8494cbdfa27b87fe62760)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:41.279650 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa2c78-fac3-428d-8ee6-a45024b4b78b None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:41.281802 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 57/118] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:55:41 2022] GET /identity/v3/projects/296b04835db8494cbdfa27b87fe62760 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:41.282517 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa2c78-fac3-428d-8ee6-a45024b4b78b None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:41.288884 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 62/119] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:55:41.290626 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf4d4e-404c-464a-a14a-1f3608934024 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:41.291142 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf4d4e-404c-464a-a14a-1f3608934024 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:41.291626 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf4d4e-404c-464a-a14a-1f3608934024 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:41.293541 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 63/120] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:41.298351 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf4d4e-404c-464a-a14a-1f3608934024 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:41.389002 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa2c78-fac3-428d-8ee6-a45024b4b78b None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:41.397619 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf4d4e-404c-464a-a14a-1f3608934024 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:41.422650 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98306fe-571c-4f5a-a71c-e14f04b50c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:41.423451 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98306fe-571c-4f5a-a71c-e14f04b50c8c None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:41.423770 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98306fe-571c-4f5a-a71c-e14f04b50c8c None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:41.424063 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98306fe-571c-4f5a-a71c-e14f04b50c8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:41.433347 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f621c-236a-484e-8124-359c6a9c2385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:41.434566 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f621c-236a-484e-8124-359c6a9c2385 None admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:41.435042 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f621c-236a-484e-8124-359c6a9c2385 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:41.435327 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98306fe-571c-4f5a-a71c-e14f04b50c8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:55:41.435739 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f621c-236a-484e-8124-359c6a9c2385 None admin] PATH_INFO: `/v3/projects/296b04835db8494cbdfa27b87fe62760/users/96a9b787ace2448a9a22c86d6847863f/roles/c38b04db9cd34eeaaaa8d2a6425c05ad` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:41.438143 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f621c-236a-484e-8124-359c6a9c2385 None admin] RBAC: Authorizing `identity:create_grant(project_id=296b04835db8494cbdfa27b87fe62760, user_id=96a9b787ace2448a9a22c86d6847863f, role_id=c38b04db9cd34eeaaaa8d2a6425c05ad)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:41.439843 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f621c-236a-484e-8124-359c6a9c2385 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:41.442669 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-b98306fe-571c-4f5a-a71c-e14f04b50c8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 03:55:41.444319 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 58/121] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:55:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:55:41.445494 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78036efd-b0b9-4426-84f9-8a443ee108f3 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:41.445784 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78036efd-b0b9-4426-84f9-8a443ee108f3 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:41.446066 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78036efd-b0b9-4426-84f9-8a443ee108f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:41.457729 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 64/122] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Mar 10 03:55:41 2022] PUT /identity/v3/projects/296b04835db8494cbdfa27b87fe62760/users/96a9b787ace2448a9a22c86d6847863f/roles/c38b04db9cd34eeaaaa8d2a6425c05ad => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 03:55:41.459113 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f621c-236a-484e-8124-359c6a9c2385 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:41.476900 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-78036efd-b0b9-4426-84f9-8a443ee108f3 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:41.478152 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-78036efd-b0b9-4426-84f9-8a443ee108f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:41.602884 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f621c-236a-484e-8124-359c6a9c2385 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:41.634148 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 59/123] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:55:41.640080 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78036efd-b0b9-4426-84f9-8a443ee108f3 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:41.661063 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7c4bc-55a2-4fd7-ae13-378ef01f8008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:41.662306 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7c4bc-55a2-4fd7-ae13-378ef01f8008 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:41.662780 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7c4bc-55a2-4fd7-ae13-378ef01f8008 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:41.663243 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7c4bc-55a2-4fd7-ae13-378ef01f8008 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:41.676725 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7c4bc-55a2-4fd7-ae13-378ef01f8008 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:55:41.689023 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-08c7c4bc-55a2-4fd7-ae13-378ef01f8008 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 03:55:41.690564 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 65/124] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:55:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:55:41.696712 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7c4bc-55a2-4fd7-ae13-378ef01f8008 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:41.840969 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78036efd-b0b9-4426-84f9-8a443ee108f3 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:41.858385 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7c4bc-55a2-4fd7-ae13-378ef01f8008 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:41.899631 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b373d2-0503-43c0-b4f6-c69f864db9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:41.901402 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b373d2-0503-43c0-b4f6-c69f864db9c2 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:41.901692 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b373d2-0503-43c0-b4f6-c69f864db9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:41.901973 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b373d2-0503-43c0-b4f6-c69f864db9c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:41.919014 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18ece4-796c-4b00-8bbe-68dc76f93114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:41.919714 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18ece4-796c-4b00-8bbe-68dc76f93114 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:41.920007 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18ece4-796c-4b00-8bbe-68dc76f93114 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:41.922424 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18ece4-796c-4b00-8bbe-68dc76f93114 None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:41.923208 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18ece4-796c-4b00-8bbe-68dc76f93114 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:41.923521 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18ece4-796c-4b00-8bbe-68dc76f93114 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:41.924640 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b373d2-0503-43c0-b4f6-c69f864db9c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:55:41.925103 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18ece4-796c-4b00-8bbe-68dc76f93114 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:41.936285 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 60/125] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:55:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:41.936940 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18ece4-796c-4b00-8bbe-68dc76f93114 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:41.937777 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-46b373d2-0503-43c0-b4f6-c69f864db9c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 03:55:41.939256 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 66/126] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:55:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:55:41.947662 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b373d2-0503-43c0-b4f6-c69f864db9c2 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:42.050867 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18ece4-796c-4b00-8bbe-68dc76f93114 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:42.108529 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6394f-775f-495b-9d21-0233f0249401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:42.109815 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6394f-775f-495b-9d21-0233f0249401 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:42.110108 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6394f-775f-495b-9d21-0233f0249401 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:42.110393 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6394f-775f-495b-9d21-0233f0249401 None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:42.111161 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6394f-775f-495b-9d21-0233f0249401 None admin] RBAC: Adding query filter params (name=member) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:42.111473 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6394f-775f-495b-9d21-0233f0249401 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:42.112902 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6394f-775f-495b-9d21-0233f0249401 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:42.127561 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 61/127] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Mar 10 03:55:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:42.128209 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6394f-775f-495b-9d21-0233f0249401 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:42.164338 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b373d2-0503-43c0-b4f6-c69f864db9c2 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:42.243123 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499a6de-926f-453a-aabb-93638004dbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:42.244040 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499a6de-926f-453a-aabb-93638004dbd1 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:42.244324 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499a6de-926f-453a-aabb-93638004dbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:42.244603 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499a6de-926f-453a-aabb-93638004dbd1 None admin] PATH_INFO: `/v3/users/7d6bd1d36bd94be08e18367ce0063fc4` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:42.248410 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499a6de-926f-453a-aabb-93638004dbd1 None admin] RBAC: Authorizing `identity:get_user(user_id=7d6bd1d36bd94be08e18367ce0063fc4)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:42.249892 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499a6de-926f-453a-aabb-93638004dbd1 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:42.251555 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 67/128] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:55:41 2022] GET /identity/v3/users/7d6bd1d36bd94be08e18367ce0063fc4 => generated 247 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:42.252421 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499a6de-926f-453a-aabb-93638004dbd1 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:42.260669 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6394f-775f-495b-9d21-0233f0249401 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:42.299700 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702dd89-1250-4b01-a27c-eff4e2eef278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:42.300386 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702dd89-1250-4b01-a27c-eff4e2eef278 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:42.300669 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702dd89-1250-4b01-a27c-eff4e2eef278 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:42.300947 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702dd89-1250-4b01-a27c-eff4e2eef278 None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:42.301717 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702dd89-1250-4b01-a27c-eff4e2eef278 None admin] RBAC: Adding query filter params (name=member) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:42.302023 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702dd89-1250-4b01-a27c-eff4e2eef278 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:42.304060 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702dd89-1250-4b01-a27c-eff4e2eef278 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:42.319275 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 62/129] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Mar 10 03:55:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:42.320162 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702dd89-1250-4b01-a27c-eff4e2eef278 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:42.429720 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702dd89-1250-4b01-a27c-eff4e2eef278 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:42.472445 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499a6de-926f-453a-aabb-93638004dbd1 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:42.484143 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a555c-076c-4825-bf8d-3bb533e72f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:42.485284 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a555c-076c-4825-bf8d-3bb533e72f3a None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:42.485776 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a555c-076c-4825-bf8d-3bb533e72f3a None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:42.486241 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a555c-076c-4825-bf8d-3bb533e72f3a None admin] PATH_INFO: `/v3/projects/296b04835db8494cbdfa27b87fe62760` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:42.487635 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a555c-076c-4825-bf8d-3bb533e72f3a None admin] RBAC: Authorizing `identity:get_project(project_id=296b04835db8494cbdfa27b87fe62760)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:42.489300 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a555c-076c-4825-bf8d-3bb533e72f3a None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:42.491209 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 63/130] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:55:42 2022] GET /identity/v3/projects/296b04835db8494cbdfa27b87fe62760 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:42.494519 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a555c-076c-4825-bf8d-3bb533e72f3a None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:42.517401 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751569b-68d2-4e86-8175-4f300e98f4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:42.518568 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751569b-68d2-4e86-8175-4f300e98f4a3 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:42.519063 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751569b-68d2-4e86-8175-4f300e98f4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:42.519526 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751569b-68d2-4e86-8175-4f300e98f4a3 None admin] PATH_INFO: `/v3/users/96a9b787ace2448a9a22c86d6847863f` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:42.520943 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0751569b-68d2-4e86-8175-4f300e98f4a3 None admin] RBAC: Authorizing `identity:get_user(user_id=96a9b787ace2448a9a22c86d6847863f)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:42.523175 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0751569b-68d2-4e86-8175-4f300e98f4a3 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:42.525020 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 68/131] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:55:42 2022] GET /identity/v3/users/96a9b787ace2448a9a22c86d6847863f => generated 275 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:42.526039 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751569b-68d2-4e86-8175-4f300e98f4a3 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:42.665442 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a555c-076c-4825-bf8d-3bb533e72f3a None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:42.709359 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751569b-68d2-4e86-8175-4f300e98f4a3 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:42.729603 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f9434-ea25-48da-a5ff-31e998984be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:42.731019 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f9434-ea25-48da-a5ff-31e998984be1 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:42.732820 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f9434-ea25-48da-a5ff-31e998984be1 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:42.733318 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f9434-ea25-48da-a5ff-31e998984be1 None admin] PATH_INFO: `/v3/users/96a9b787ace2448a9a22c86d6847863f` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:42.735290 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f9434-ea25-48da-a5ff-31e998984be1 None admin] RBAC: Authorizing `identity:get_user(user_id=96a9b787ace2448a9a22c86d6847863f)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:42.737163 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f9434-ea25-48da-a5ff-31e998984be1 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:42.739731 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 64/132] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:55:42 2022] GET /identity/v3/users/96a9b787ace2448a9a22c86d6847863f => generated 275 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:42.746140 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f9434-ea25-48da-a5ff-31e998984be1 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:42.788411 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea0b83-2c18-44bc-bd69-6a0ef66011ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:42.789335 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea0b83-2c18-44bc-bd69-6a0ef66011ca None admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:42.789626 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea0b83-2c18-44bc-bd69-6a0ef66011ca None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:42.789908 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea0b83-2c18-44bc-bd69-6a0ef66011ca None admin] PATH_INFO: `/v3/projects/296b04835db8494cbdfa27b87fe62760/users/7d6bd1d36bd94be08e18367ce0063fc4/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:42.800990 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea0b83-2c18-44bc-bd69-6a0ef66011ca None admin] RBAC: Authorizing `identity:create_grant(project_id=296b04835db8494cbdfa27b87fe62760, user_id=7d6bd1d36bd94be08e18367ce0063fc4, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:42.802306 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea0b83-2c18-44bc-bd69-6a0ef66011ca None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:42.825821 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 69/133] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Mar 10 03:55:42 2022] PUT /identity/v3/projects/296b04835db8494cbdfa27b87fe62760/users/7d6bd1d36bd94be08e18367ce0063fc4/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 03:55:42.832717 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea0b83-2c18-44bc-bd69-6a0ef66011ca None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:42.862666 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f9434-ea25-48da-a5ff-31e998984be1 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:42.910093 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c4b92-4bb0-472a-b576-acf6d31ac4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:42.911353 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c4b92-4bb0-472a-b576-acf6d31ac4ab None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:42.912076 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c4b92-4bb0-472a-b576-acf6d31ac4ab None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:42.912552 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c4b92-4bb0-472a-b576-acf6d31ac4ab None admin] PATH_INFO: `/v3/projects/296b04835db8494cbdfa27b87fe62760` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:42.914040 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c4b92-4bb0-472a-b576-acf6d31ac4ab None admin] RBAC: Authorizing `identity:get_project(project_id=296b04835db8494cbdfa27b87fe62760)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:42.915898 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c4b92-4bb0-472a-b576-acf6d31ac4ab None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:42.917952 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 65/134] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:55:42 2022] GET /identity/v3/projects/296b04835db8494cbdfa27b87fe62760 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:42.923810 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c4b92-4bb0-472a-b576-acf6d31ac4ab None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:43.042644 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c4b92-4bb0-472a-b576-acf6d31ac4ab None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:43.092777 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43a4ee-6b7e-4c03-9168-5b633a4875bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:43.094217 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43a4ee-6b7e-4c03-9168-5b633a4875bb None admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:43.094692 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43a4ee-6b7e-4c03-9168-5b633a4875bb None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:43.095155 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43a4ee-6b7e-4c03-9168-5b633a4875bb None admin] PATH_INFO: `/v3/projects/296b04835db8494cbdfa27b87fe62760/users/96a9b787ace2448a9a22c86d6847863f/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:43.098081 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43a4ee-6b7e-4c03-9168-5b633a4875bb None admin] RBAC: Authorizing `identity:create_grant(project_id=296b04835db8494cbdfa27b87fe62760, user_id=96a9b787ace2448a9a22c86d6847863f, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:43.099529 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea0b83-2c18-44bc-bd69-6a0ef66011ca None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:43.100136 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43a4ee-6b7e-4c03-9168-5b633a4875bb None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:43.115943 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 66/135] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Mar 10 03:55:42 2022] PUT /identity/v3/projects/296b04835db8494cbdfa27b87fe62760/users/96a9b787ace2448a9a22c86d6847863f/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 03:55:43.158607 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623a019-93dd-4967-b9ed-c393f70b57d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:43.159569 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623a019-93dd-4967-b9ed-c393f70b57d7 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:43.159889 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623a019-93dd-4967-b9ed-c393f70b57d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:43.160171 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623a019-93dd-4967-b9ed-c393f70b57d7 None admin] PATH_INFO: `/v3/projects/5c1ee3b04f6343f1a44e57e4f26f7361` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:43.163899 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623a019-93dd-4967-b9ed-c393f70b57d7 None admin] RBAC: Authorizing `identity:get_project(project_id=5c1ee3b04f6343f1a44e57e4f26f7361)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:43.165413 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623a019-93dd-4967-b9ed-c393f70b57d7 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:43.167541 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 70/136] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:55:42 2022] GET /identity/v3/projects/5c1ee3b04f6343f1a44e57e4f26f7361 => generated 312 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:43.173399 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43a4ee-6b7e-4c03-9168-5b633a4875bb None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:43.303553 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43a4ee-6b7e-4c03-9168-5b633a4875bb None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:43.339192 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675e64e-a84c-4f1a-8b17-784fc326b5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:43.340541 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675e64e-a84c-4f1a-8b17-784fc326b5da None admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:43.341018 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675e64e-a84c-4f1a-8b17-784fc326b5da None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:43.341584 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675e64e-a84c-4f1a-8b17-784fc326b5da None admin] PATH_INFO: `/v3/projects/5c1ee3b04f6343f1a44e57e4f26f7361/users/96a9b787ace2448a9a22c86d6847863f/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:43.343790 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675e64e-a84c-4f1a-8b17-784fc326b5da None admin] RBAC: Authorizing `identity:create_grant(project_id=5c1ee3b04f6343f1a44e57e4f26f7361, user_id=96a9b787ace2448a9a22c86d6847863f, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:43.345482 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675e64e-a84c-4f1a-8b17-784fc326b5da None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:43.374627 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 67/137] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Mar 10 03:55:43 2022] PUT /identity/v3/projects/5c1ee3b04f6343f1a44e57e4f26f7361/users/96a9b787ace2448a9a22c86d6847863f/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 03:55:43.433297 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d20ad-0e52-4b2c-a19d-7f224010c7ea None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:43.433629 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d20ad-0e52-4b2c-a19d-7f224010c7ea None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:43.433865 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d20ad-0e52-4b2c-a19d-7f224010c7ea None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:43.435752 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 71/138] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:43.441893 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86799331-4ac3-45c1-baa9-5807e3c4eaed None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:43.442446 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86799331-4ac3-45c1-baa9-5807e3c4eaed None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:43.442702 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86799331-4ac3-45c1-baa9-5807e3c4eaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:43.461899 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-86799331-4ac3-45c1-baa9-5807e3c4eaed None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:43.463184 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-86799331-4ac3-45c1-baa9-5807e3c4eaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:43.556343 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 68/139] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:55:43.598415 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d20ad-0e52-4b2c-a19d-7f224010c7ea None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:43.720397 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d20ad-0e52-4b2c-a19d-7f224010c7ea None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:43.760209 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc442868-909b-4d7a-b01c-5e2cee5f7ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:43.761047 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc442868-909b-4d7a-b01c-5e2cee5f7ad2 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:43.761336 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc442868-909b-4d7a-b01c-5e2cee5f7ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:43.761615 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc442868-909b-4d7a-b01c-5e2cee5f7ad2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:43.762909 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc442868-909b-4d7a-b01c-5e2cee5f7ad2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:43.764469 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc442868-909b-4d7a-b01c-5e2cee5f7ad2 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:43.766366 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 72/140] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:55:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:43.771846 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86799331-4ac3-45c1-baa9-5807e3c4eaed None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:43.877255 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86799331-4ac3-45c1-baa9-5807e3c4eaed None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:43.916665 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d2dc0-8337-4ff9-990e-30baf24f9107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:43.917353 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d2dc0-8337-4ff9-990e-30baf24f9107 None admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:43.917636 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d2dc0-8337-4ff9-990e-30baf24f9107 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:43.917912 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d2dc0-8337-4ff9-990e-30baf24f9107 None admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:43.918645 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d2dc0-8337-4ff9-990e-30baf24f9107 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:43.920129 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d2dc0-8337-4ff9-990e-30baf24f9107 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:43.949474 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 69/141] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Mar 10 03:55:43 2022] POST /identity/v3/users => generated 283 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 03:55:44.233229 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab50de5-503d-4838-ad21-ad7987c3b3b4 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:44.233579 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab50de5-503d-4838-ad21-ad7987c3b3b4 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:44.233753 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab50de5-503d-4838-ad21-ad7987c3b3b4 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:44.235749 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 73/142] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:44.240951 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b849238-2590-434f-8ba8-f5ab3356a23e None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:44.241249 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b849238-2590-434f-8ba8-f5ab3356a23e None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:44.241533 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b849238-2590-434f-8ba8-f5ab3356a23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:44.264042 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-5b849238-2590-434f-8ba8-f5ab3356a23e None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:44.265227 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-5b849238-2590-434f-8ba8-f5ab3356a23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:44.351348 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 70/143] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:55:44.385431 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ae12e-d3f7-4351-9503-052c1805a8b8 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:44.385730 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ae12e-d3f7-4351-9503-052c1805a8b8 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:44.385998 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ae12e-d3f7-4351-9503-052c1805a8b8 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:44.387919 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 74/144] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:44.388810 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b849238-2590-434f-8ba8-f5ab3356a23e None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:44.394845 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4479e-f7be-4abc-91a7-ba369a525a41 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:44.395136 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4479e-f7be-4abc-91a7-ba369a525a41 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:44.395414 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4479e-f7be-4abc-91a7-ba369a525a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:44.424707 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-9eb4479e-f7be-4abc-91a7-ba369a525a41 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:44.425992 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-9eb4479e-f7be-4abc-91a7-ba369a525a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:44.546548 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 75/145] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 03:55:44.562620 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b849238-2590-434f-8ba8-f5ab3356a23e None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:44.604071 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900a1ea-fdc2-4a70-95c7-eb62e834ede6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:44.604875 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900a1ea-fdc2-4a70-95c7-eb62e834ede6 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:44.605158 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900a1ea-fdc2-4a70-95c7-eb62e834ede6 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:44.605438 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900a1ea-fdc2-4a70-95c7-eb62e834ede6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:44.620375 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900a1ea-fdc2-4a70-95c7-eb62e834ede6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:55:44.627412 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-f900a1ea-fdc2-4a70-95c7-eb62e834ede6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 10 03:55:44.628844 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 71/146] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:55:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:55:44.632747 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4479e-f7be-4abc-91a7-ba369a525a41 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:44.640560 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900a1ea-fdc2-4a70-95c7-eb62e834ede6 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:44.758796 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4479e-f7be-4abc-91a7-ba369a525a41 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:44.799515 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19333da0-935e-480f-a37e-8cd1e05273fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:44.800296 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19333da0-935e-480f-a37e-8cd1e05273fd None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:44.800579 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19333da0-935e-480f-a37e-8cd1e05273fd None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:44.800860 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19333da0-935e-480f-a37e-8cd1e05273fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:44.813135 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19333da0-935e-480f-a37e-8cd1e05273fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:55:44.822999 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-19333da0-935e-480f-a37e-8cd1e05273fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 10 03:55:44.826373 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 76/147] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Mar 10 03:55:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:55:44.832111 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19333da0-935e-480f-a37e-8cd1e05273fd None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:44.897875 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900a1ea-fdc2-4a70-95c7-eb62e834ede6 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:44.944063 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19333da0-935e-480f-a37e-8cd1e05273fd None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:44.966174 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739beab-1179-4483-be26-5c920c102366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:44.966861 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739beab-1179-4483-be26-5c920c102366 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:44.967148 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739beab-1179-4483-be26-5c920c102366 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:44.967427 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739beab-1179-4483-be26-5c920c102366 None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:44.968235 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b739beab-1179-4483-be26-5c920c102366 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:44.968543 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b739beab-1179-4483-be26-5c920c102366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:44.969962 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b739beab-1179-4483-be26-5c920c102366 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:44.981069 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389d9e3-8acf-4c8e-96a2-1c5298120006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:44.981751 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389d9e3-8acf-4c8e-96a2-1c5298120006 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:44.982040 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389d9e3-8acf-4c8e-96a2-1c5298120006 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:44.982323 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389d9e3-8acf-4c8e-96a2-1c5298120006 None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:44.983148 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389d9e3-8acf-4c8e-96a2-1c5298120006 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:44.983456 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389d9e3-8acf-4c8e-96a2-1c5298120006 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:44.985036 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389d9e3-8acf-4c8e-96a2-1c5298120006 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:44.985901 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 72/148] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Mar 10 03:55:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:44.992143 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739beab-1179-4483-be26-5c920c102366 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:44.994313 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 77/149] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:55:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:44.999611 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389d9e3-8acf-4c8e-96a2-1c5298120006 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:45.101595 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389d9e3-8acf-4c8e-96a2-1c5298120006 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:45.126289 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739beab-1179-4483-be26-5c920c102366 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:45.137310 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5ad84-501c-4810-b07a-1002eb1216b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:45.138239 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5ad84-501c-4810-b07a-1002eb1216b7 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:45.138529 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5ad84-501c-4810-b07a-1002eb1216b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:45.138810 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab5ad84-501c-4810-b07a-1002eb1216b7 None admin] PATH_INFO: `/v3/users/96a9b787ace2448a9a22c86d6847863f` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:45.140044 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab5ad84-501c-4810-b07a-1002eb1216b7 None admin] RBAC: Authorizing `identity:get_user(user_id=96a9b787ace2448a9a22c86d6847863f)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:45.141514 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab5ad84-501c-4810-b07a-1002eb1216b7 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:45.143354 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 78/150] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:55:44 2022] GET /identity/v3/users/96a9b787ace2448a9a22c86d6847863f => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:45.149655 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5ad84-501c-4810-b07a-1002eb1216b7 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:45.200998 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f02207-c382-4015-8686-335e8b733463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:45.201890 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f02207-c382-4015-8686-335e8b733463 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:45.202170 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f02207-c382-4015-8686-335e8b733463 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:45.202446 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f02207-c382-4015-8686-335e8b733463 None admin] PATH_INFO: `/v3/users/0d455a3b0b5344c48eae404262081862` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:45.209053 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f02207-c382-4015-8686-335e8b733463 None admin] RBAC: Authorizing `identity:get_user(user_id=0d455a3b0b5344c48eae404262081862)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:45.210536 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f02207-c382-4015-8686-335e8b733463 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:45.212448 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 73/151] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:55:44 2022] GET /identity/v3/users/0d455a3b0b5344c48eae404262081862 => generated 289 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:55:45.217678 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f02207-c382-4015-8686-335e8b733463 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:45.254106 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab5ad84-501c-4810-b07a-1002eb1216b7 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:45.292945 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63b2c4-7738-48a3-9ea9-9479bbf1f578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:45.293624 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63b2c4-7738-48a3-9ea9-9479bbf1f578 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:45.293914 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63b2c4-7738-48a3-9ea9-9479bbf1f578 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:45.294199 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63b2c4-7738-48a3-9ea9-9479bbf1f578 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:45.365718 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc63b2c4-7738-48a3-9ea9-9479bbf1f578 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:45.367137 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc63b2c4-7738-48a3-9ea9-9479bbf1f578 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:45.401409 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f02207-c382-4015-8686-335e8b733463 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:45.435454 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46179b2c-81a2-4bfe-9d27-5483a389a1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:45.436368 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46179b2c-81a2-4bfe-9d27-5483a389a1df None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:45.436646 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46179b2c-81a2-4bfe-9d27-5483a389a1df None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:45.436916 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46179b2c-81a2-4bfe-9d27-5483a389a1df None admin] PATH_INFO: `/v3/projects/296b04835db8494cbdfa27b87fe62760` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:45.438104 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46179b2c-81a2-4bfe-9d27-5483a389a1df None admin] RBAC: Authorizing `identity:get_project(project_id=296b04835db8494cbdfa27b87fe62760)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:45.439551 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46179b2c-81a2-4bfe-9d27-5483a389a1df None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:45.441272 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 74/152] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:55:45 2022] GET /identity/v3/projects/296b04835db8494cbdfa27b87fe62760 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:55:45.447870 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46179b2c-81a2-4bfe-9d27-5483a389a1df None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:45.468084 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 79/153] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:55:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 10 03:55:45.473627 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63b2c4-7738-48a3-9ea9-9479bbf1f578 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:45.555116 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46179b2c-81a2-4bfe-9d27-5483a389a1df None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:45.573159 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63b2c4-7738-48a3-9ea9-9479bbf1f578 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:45.589712 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709733f-af1e-4b3c-80af-bc8e630a418c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:45.590606 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709733f-af1e-4b3c-80af-bc8e630a418c None admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:45.590885 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709733f-af1e-4b3c-80af-bc8e630a418c None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:45.591160 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709733f-af1e-4b3c-80af-bc8e630a418c None admin] PATH_INFO: `/v3/projects/296b04835db8494cbdfa27b87fe62760/users/0d455a3b0b5344c48eae404262081862/roles/5daf615f445643608474ea1432d21e42` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:45.593180 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4709733f-af1e-4b3c-80af-bc8e630a418c None admin] RBAC: Authorizing `identity:create_grant(project_id=296b04835db8494cbdfa27b87fe62760, user_id=0d455a3b0b5344c48eae404262081862, role_id=5daf615f445643608474ea1432d21e42)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:45.594619 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4709733f-af1e-4b3c-80af-bc8e630a418c None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:45.606966 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e7d40-e8ed-4ced-b79d-a157da2d607a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:45.607851 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e7d40-e8ed-4ced-b79d-a157da2d607a None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:45.608138 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e7d40-e8ed-4ced-b79d-a157da2d607a None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:45.608417 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e7d40-e8ed-4ced-b79d-a157da2d607a None admin] PATH_INFO: `/v3/projects/296b04835db8494cbdfa27b87fe62760` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:45.609830 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e7d40-e8ed-4ced-b79d-a157da2d607a None admin] RBAC: Authorizing `identity:get_project(project_id=296b04835db8494cbdfa27b87fe62760)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:45.611334 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e7d40-e8ed-4ced-b79d-a157da2d607a None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:45.613197 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 80/154] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:55:45 2022] GET /identity/v3/projects/296b04835db8494cbdfa27b87fe62760 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:55:45.618126 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 75/155] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Mar 10 03:55:45 2022] PUT /identity/v3/projects/296b04835db8494cbdfa27b87fe62760/users/0d455a3b0b5344c48eae404262081862/roles/5daf615f445643608474ea1432d21e42 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 03:55:45.625143 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e7d40-e8ed-4ced-b79d-a157da2d607a None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:45.752112 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e7d40-e8ed-4ced-b79d-a157da2d607a None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:45.789689 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe6252-22ee-4222-b9a9-3d2c7b1bea08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:45.790376 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe6252-22ee-4222-b9a9-3d2c7b1bea08 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:45.790663 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe6252-22ee-4222-b9a9-3d2c7b1bea08 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:45.790943 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe6252-22ee-4222-b9a9-3d2c7b1bea08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:45.791833 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe6252-22ee-4222-b9a9-3d2c7b1bea08 None admin] RBAC: Adding query filter params (role.id=c38b04db9cd34eeaaaa8d2a6425c05ad, scope.project.id=296b04835db8494cbdfa27b87fe62760, user.id=96a9b787ace2448a9a22c86d6847863f) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:45.792147 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe6252-22ee-4222-b9a9-3d2c7b1bea08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:45.793613 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe6252-22ee-4222-b9a9-3d2c7b1bea08 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:45.800220 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 81/156] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:55:45 2022] GET /identity/v3/role_assignments?user.id=96a9b787ace2448a9a22c86d6847863f&scope.project.id=296b04835db8494cbdfa27b87fe62760&role.id=c38b04db9cd34eeaaaa8d2a6425c05ad => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:46.263225 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8b6cf-032d-4dfa-90c7-55fd0c61752f None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:46.263581 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8b6cf-032d-4dfa-90c7-55fd0c61752f None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:46.263798 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8b6cf-032d-4dfa-90c7-55fd0c61752f None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:46.265583 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 76/157] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:46.272875 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc8025-a1bb-49b9-8062-c3e30888b12a None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:46.273167 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc8025-a1bb-49b9-8062-c3e30888b12a None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:46.273453 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc8025-a1bb-49b9-8062-c3e30888b12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:46.290928 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-57bc8025-a1bb-49b9-8062-c3e30888b12a None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:46.292191 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-57bc8025-a1bb-49b9-8062-c3e30888b12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:46.371406 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 82/158] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 03:55:46.407152 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8b6cf-032d-4dfa-90c7-55fd0c61752f None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:46.533357 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8b6cf-032d-4dfa-90c7-55fd0c61752f None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:46.570764 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7532e-d72e-479f-aa47-5b6ecf0591c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:46.571713 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7532e-d72e-479f-aa47-5b6ecf0591c0 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:46.571997 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7532e-d72e-479f-aa47-5b6ecf0591c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:46.572421 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7532e-d72e-479f-aa47-5b6ecf0591c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:46.586515 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7532e-d72e-479f-aa47-5b6ecf0591c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:55:46.593391 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-c6f7532e-d72e-479f-aa47-5b6ecf0591c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 03:55:46.594882 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 77/159] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:55:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:55:46.600828 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc8025-a1bb-49b9-8062-c3e30888b12a None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:46.722117 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc8025-a1bb-49b9-8062-c3e30888b12a None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:46.760855 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76433f99-e244-4b03-bd80-013d49281347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:46.761620 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76433f99-e244-4b03-bd80-013d49281347 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:46.761795 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76433f99-e244-4b03-bd80-013d49281347 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:46.762073 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76433f99-e244-4b03-bd80-013d49281347 None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:46.762818 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76433f99-e244-4b03-bd80-013d49281347 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:46.763117 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76433f99-e244-4b03-bd80-013d49281347 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:46.764522 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76433f99-e244-4b03-bd80-013d49281347 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:46.778769 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 83/160] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:55:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:55:46.784436 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7532e-d72e-479f-aa47-5b6ecf0591c0 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:46.882864 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7532e-d72e-479f-aa47-5b6ecf0591c0 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:46.917479 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90591ca7-ff9c-4233-bae3-460b39bc14a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:46.918352 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90591ca7-ff9c-4233-bae3-460b39bc14a2 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:46.918630 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90591ca7-ff9c-4233-bae3-460b39bc14a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:46.924341 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90591ca7-ff9c-4233-bae3-460b39bc14a2 None admin] PATH_INFO: `/v3/users/7d6bd1d36bd94be08e18367ce0063fc4` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:46.924341 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90591ca7-ff9c-4233-bae3-460b39bc14a2 None admin] RBAC: Authorizing `identity:get_user(user_id=7d6bd1d36bd94be08e18367ce0063fc4)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:46.924341 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90591ca7-ff9c-4233-bae3-460b39bc14a2 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:46.924341 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 78/161] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:55:46 2022] GET /identity/v3/users/7d6bd1d36bd94be08e18367ce0063fc4 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:46.937007 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76433f99-e244-4b03-bd80-013d49281347 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:47.223302 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76433f99-e244-4b03-bd80-013d49281347 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:47.289836 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3627365-9721-485a-9164-0ffa52f2b832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:47.290491 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3627365-9721-485a-9164-0ffa52f2b832 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:47.290770 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3627365-9721-485a-9164-0ffa52f2b832 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:47.291047 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3627365-9721-485a-9164-0ffa52f2b832 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:47.423092 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3627365-9721-485a-9164-0ffa52f2b832 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:47.424525 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3627365-9721-485a-9164-0ffa52f2b832 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:47.553198 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b74524-8ac6-40e7-86ea-49911dfeffa0 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:47.553507 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b74524-8ac6-40e7-86ea-49911dfeffa0 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:47.553752 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b74524-8ac6-40e7-86ea-49911dfeffa0 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:47.555512 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 79/162] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:47.560622 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736f66a-b4c4-4464-957f-447a0102f4ab None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:47.560908 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736f66a-b4c4-4464-957f-447a0102f4ab None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:47.561182 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736f66a-b4c4-4464-957f-447a0102f4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:47.590143 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 84/163] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:55:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:55:47.590823 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-5736f66a-b4c4-4464-957f-447a0102f4ab None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:47.592280 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-5736f66a-b4c4-4464-957f-447a0102f4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:47.595393 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3627365-9721-485a-9164-0ffa52f2b832 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:47.697543 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 80/164] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 03:55:47.699899 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec6502-a4ae-4770-aec3-30edba879c05 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:47.700648 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec6502-a4ae-4770-aec3-30edba879c05 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:47.701140 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec6502-a4ae-4770-aec3-30edba879c05 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:47.703191 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 81/165] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:47.708932 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504e654-0eb2-465f-9030-6fb87f960c6e None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:47.709440 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504e654-0eb2-465f-9030-6fb87f960c6e None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:47.709906 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504e654-0eb2-465f-9030-6fb87f960c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:47.727951 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-b504e654-0eb2-465f-9030-6fb87f960c6e None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:47.729424 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-b504e654-0eb2-465f-9030-6fb87f960c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:47.800435 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3627365-9721-485a-9164-0ffa52f2b832 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:47.805460 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 82/166] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:55:47.806554 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504e654-0eb2-465f-9030-6fb87f960c6e None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:47.894040 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e12a1d-f2a1-4fe4-97be-e56a3d339cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:47.894921 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e12a1d-f2a1-4fe4-97be-e56a3d339cdd None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:47.895364 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e12a1d-f2a1-4fe4-97be-e56a3d339cdd None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:47.895891 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e12a1d-f2a1-4fe4-97be-e56a3d339cdd None admin] PATH_INFO: `/v3/projects/296b04835db8494cbdfa27b87fe62760` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:47.900444 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e12a1d-f2a1-4fe4-97be-e56a3d339cdd None admin] RBAC: Authorizing `identity:get_project(project_id=296b04835db8494cbdfa27b87fe62760)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:47.902166 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e12a1d-f2a1-4fe4-97be-e56a3d339cdd None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:47.904053 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 85/167] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:55:47 2022] GET /identity/v3/projects/296b04835db8494cbdfa27b87fe62760 => generated 298 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:47.904990 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e12a1d-f2a1-4fe4-97be-e56a3d339cdd None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:47.937112 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504e654-0eb2-465f-9030-6fb87f960c6e None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:47.974026 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19a9cd-bf2c-453c-acb7-3500b8c74bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:47.974743 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19a9cd-bf2c-453c-acb7-3500b8c74bd0 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:47.975028 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19a9cd-bf2c-453c-acb7-3500b8c74bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:47.975303 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19a9cd-bf2c-453c-acb7-3500b8c74bd0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:47.986231 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19a9cd-bf2c-453c-acb7-3500b8c74bd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:55:47.994516 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-bb19a9cd-bf2c-453c-acb7-3500b8c74bd0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 03:55:47.996111 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 83/168] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:55:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:55:47.996898 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19a9cd-bf2c-453c-acb7-3500b8c74bd0 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:48.105101 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19a9cd-bf2c-453c-acb7-3500b8c74bd0 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:48.141891 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e12a1d-f2a1-4fe4-97be-e56a3d339cdd None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:48.142295 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815401aa-2983-4bfd-9e7e-335521c54745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:48.142960 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815401aa-2983-4bfd-9e7e-335521c54745 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:48.143239 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815401aa-2983-4bfd-9e7e-335521c54745 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:48.143708 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815401aa-2983-4bfd-9e7e-335521c54745 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:48.144555 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815401aa-2983-4bfd-9e7e-335521c54745 None admin] RBAC: Adding query filter params (role.id=a8b2a5887cec4a31b7304792af3dd3f1, scope.project.id=296b04835db8494cbdfa27b87fe62760, user.id=7d6bd1d36bd94be08e18367ce0063fc4) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:48.144864 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815401aa-2983-4bfd-9e7e-335521c54745 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:48.146427 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815401aa-2983-4bfd-9e7e-335521c54745 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:48.154354 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 84/169] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:55:47 2022] GET /identity/v3/role_assignments?user.id=7d6bd1d36bd94be08e18367ce0063fc4&scope.project.id=296b04835db8494cbdfa27b87fe62760&role.id=a8b2a5887cec4a31b7304792af3dd3f1 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:48.155842 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815401aa-2983-4bfd-9e7e-335521c54745 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:48.224876 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a656127-b252-48a4-a0cf-e8c2e3054326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:48.225611 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a656127-b252-48a4-a0cf-e8c2e3054326 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:48.225901 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a656127-b252-48a4-a0cf-e8c2e3054326 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:48.226177 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a656127-b252-48a4-a0cf-e8c2e3054326 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:48.246136 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a656127-b252-48a4-a0cf-e8c2e3054326 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:55:48.257691 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-0a656127-b252-48a4-a0cf-e8c2e3054326 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 03:55:48.259287 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 86/170] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:55:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:55:48.274348 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815401aa-2983-4bfd-9e7e-335521c54745 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:48.281436 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a656127-b252-48a4-a0cf-e8c2e3054326 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:48.310154 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155cee3-50ba-4ce1-814d-dff2fc278b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:48.310828 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155cee3-50ba-4ce1-814d-dff2fc278b2e None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:48.311107 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155cee3-50ba-4ce1-814d-dff2fc278b2e None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:48.311385 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155cee3-50ba-4ce1-814d-dff2fc278b2e None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:48.312174 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155cee3-50ba-4ce1-814d-dff2fc278b2e None admin] RBAC: Adding query filter params (name=member) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:48.312479 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155cee3-50ba-4ce1-814d-dff2fc278b2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:48.313907 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155cee3-50ba-4ce1-814d-dff2fc278b2e None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:48.323410 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 85/171] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Mar 10 03:55:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:48.329639 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155cee3-50ba-4ce1-814d-dff2fc278b2e None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:48.488960 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a656127-b252-48a4-a0cf-e8c2e3054326 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:48.519002 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155cee3-50ba-4ce1-814d-dff2fc278b2e None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:48.562719 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8a64f-594e-43d0-aa24-ff6ff7e483dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:48.563390 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8a64f-594e-43d0-aa24-ff6ff7e483dc None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:48.563670 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8a64f-594e-43d0-aa24-ff6ff7e483dc None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:48.563966 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8a64f-594e-43d0-aa24-ff6ff7e483dc None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:48.564719 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8a64f-594e-43d0-aa24-ff6ff7e483dc None admin] RBAC: Adding query filter params (name=member) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:48.565021 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8a64f-594e-43d0-aa24-ff6ff7e483dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:48.566705 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8a64f-594e-43d0-aa24-ff6ff7e483dc None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:48.574728 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a9eaf-0485-4803-868e-c1272f2a75ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:48.575254 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a9eaf-0485-4803-868e-c1272f2a75ea None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:48.575536 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a9eaf-0485-4803-868e-c1272f2a75ea None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:48.575843 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a9eaf-0485-4803-868e-c1272f2a75ea None admin] PATH_INFO: `/v3/users/96a9b787ace2448a9a22c86d6847863f` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:48.577072 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a9eaf-0485-4803-868e-c1272f2a75ea None admin] RBAC: Authorizing `identity:get_user(user_id=96a9b787ace2448a9a22c86d6847863f)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:48.578520 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a9eaf-0485-4803-868e-c1272f2a75ea None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:48.580504 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 86/172] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:55:48 2022] GET /identity/v3/users/96a9b787ace2448a9a22c86d6847863f => generated 275 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:48.582882 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 87/173] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Mar 10 03:55:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:55:48.587127 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a9eaf-0485-4803-868e-c1272f2a75ea None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:48.588730 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8a64f-594e-43d0-aa24-ff6ff7e483dc None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:48.686885 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a9eaf-0485-4803-868e-c1272f2a75ea None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:48.701363 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8a64f-594e-43d0-aa24-ff6ff7e483dc None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:48.723243 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44230a05-5d67-439a-b0b0-aa8e99c2ec0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:48.724004 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44230a05-5d67-439a-b0b0-aa8e99c2ec0f None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:48.724752 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44230a05-5d67-439a-b0b0-aa8e99c2ec0f None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:48.725030 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44230a05-5d67-439a-b0b0-aa8e99c2ec0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:48.739595 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32f16f-a57f-4256-af60-2c2d1317c90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:48.740461 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32f16f-a57f-4256-af60-2c2d1317c90d None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:48.740740 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32f16f-a57f-4256-af60-2c2d1317c90d None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:48.741015 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32f16f-a57f-4256-af60-2c2d1317c90d None admin] PATH_INFO: `/v3/users/96a9b787ace2448a9a22c86d6847863f` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:48.742213 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32f16f-a57f-4256-af60-2c2d1317c90d None admin] RBAC: Authorizing `identity:get_user(user_id=96a9b787ace2448a9a22c86d6847863f)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:48.743668 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32f16f-a57f-4256-af60-2c2d1317c90d None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:48.745624 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 88/174] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:55:48 2022] GET /identity/v3/users/96a9b787ace2448a9a22c86d6847863f => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:48.751068 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32f16f-a57f-4256-af60-2c2d1317c90d None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:48.795117 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44230a05-5d67-439a-b0b0-aa8e99c2ec0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:48.796641 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44230a05-5d67-439a-b0b0-aa8e99c2ec0f None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:48.851335 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32f16f-a57f-4256-af60-2c2d1317c90d None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:48.884141 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2fc17-f89b-4379-a325-2e1950c8172b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:48.884789 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2fc17-f89b-4379-a325-2e1950c8172b None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:48.885076 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2fc17-f89b-4379-a325-2e1950c8172b None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:48.885351 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2fc17-f89b-4379-a325-2e1950c8172b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:48.894862 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 87/175] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:55:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:55:48.900924 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44230a05-5d67-439a-b0b0-aa8e99c2ec0f None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:48.958147 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2fc17-f89b-4379-a325-2e1950c8172b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:48.960233 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2fc17-f89b-4379-a325-2e1950c8172b None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:49.001471 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44230a05-5d67-439a-b0b0-aa8e99c2ec0f None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:49.036272 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107d544-14f4-4ab8-a16c-fd559ea1110a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:49.037564 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107d544-14f4-4ab8-a16c-fd559ea1110a None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:49.038041 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107d544-14f4-4ab8-a16c-fd559ea1110a None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:49.038508 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107d544-14f4-4ab8-a16c-fd559ea1110a None admin] PATH_INFO: `/v3/projects/296b04835db8494cbdfa27b87fe62760` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:49.039918 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107d544-14f4-4ab8-a16c-fd559ea1110a None admin] RBAC: Authorizing `identity:get_project(project_id=296b04835db8494cbdfa27b87fe62760)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:49.041581 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107d544-14f4-4ab8-a16c-fd559ea1110a None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:49.043524 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 88/176] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:55:48 2022] GET /identity/v3/projects/296b04835db8494cbdfa27b87fe62760 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:49.049651 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107d544-14f4-4ab8-a16c-fd559ea1110a None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:49.078783 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 89/177] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:55:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:55:49.084761 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2fc17-f89b-4379-a325-2e1950c8172b None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:49.159607 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107d544-14f4-4ab8-a16c-fd559ea1110a None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:49.201396 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76665b6-2412-4a78-a170-a754fc2bebfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:49.202463 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76665b6-2412-4a78-a170-a754fc2bebfd None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:49.202988 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76665b6-2412-4a78-a170-a754fc2bebfd None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:49.203461 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76665b6-2412-4a78-a170-a754fc2bebfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:49.204785 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76665b6-2412-4a78-a170-a754fc2bebfd None admin] RBAC: Adding query filter params (role.id=73b2aee45a2d4be19addaf4a33414295, scope.project.id=296b04835db8494cbdfa27b87fe62760, user.id=96a9b787ace2448a9a22c86d6847863f) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:49.205321 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76665b6-2412-4a78-a170-a754fc2bebfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:49.207210 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76665b6-2412-4a78-a170-a754fc2bebfd None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:49.214528 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 89/178] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:55:49 2022] GET /identity/v3/role_assignments?user.id=96a9b787ace2448a9a22c86d6847863f&scope.project.id=296b04835db8494cbdfa27b87fe62760&role.id=73b2aee45a2d4be19addaf4a33414295 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:55:49.216846 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884a015-aded-4dd1-8547-b07696bc1db4 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:49.217388 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884a015-aded-4dd1-8547-b07696bc1db4 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:49.217860 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884a015-aded-4dd1-8547-b07696bc1db4 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:49.219900 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 90/179] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:49.225682 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac46c8-18bc-4dc0-8605-dc5e1c2f641d None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:49.226333 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac46c8-18bc-4dc0-8605-dc5e1c2f641d None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:49.226802 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac46c8-18bc-4dc0-8605-dc5e1c2f641d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:49.247119 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-26ac46c8-18bc-4dc0-8605-dc5e1c2f641d None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:49.248937 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-26ac46c8-18bc-4dc0-8605-dc5e1c2f641d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:49.330772 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 91/180] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 03:55:49.347351 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2fc17-f89b-4379-a325-2e1950c8172b None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:49.368695 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac46c8-18bc-4dc0-8605-dc5e1c2f641d None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:49.428470 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710714d-72bb-4857-8835-7b0c84c2a934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:49.429367 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710714d-72bb-4857-8835-7b0c84c2a934 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:49.429646 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710714d-72bb-4857-8835-7b0c84c2a934 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:49.429916 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710714d-72bb-4857-8835-7b0c84c2a934 None admin] PATH_INFO: `/v3/projects/5c1ee3b04f6343f1a44e57e4f26f7361` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:49.431227 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c710714d-72bb-4857-8835-7b0c84c2a934 None admin] RBAC: Authorizing `identity:get_project(project_id=5c1ee3b04f6343f1a44e57e4f26f7361)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:49.432722 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c710714d-72bb-4857-8835-7b0c84c2a934 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:49.434485 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 90/181] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:55:49 2022] GET /identity/v3/projects/5c1ee3b04f6343f1a44e57e4f26f7361 => generated 312 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:55:49.440174 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710714d-72bb-4857-8835-7b0c84c2a934 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:49.487551 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac46c8-18bc-4dc0-8605-dc5e1c2f641d None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:49.531180 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834820a-0b49-4b0d-8e25-d863e93a8d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:49.532525 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834820a-0b49-4b0d-8e25-d863e93a8d42 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:49.533003 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834820a-0b49-4b0d-8e25-d863e93a8d42 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:49.533483 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834820a-0b49-4b0d-8e25-d863e93a8d42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:49.546900 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834820a-0b49-4b0d-8e25-d863e93a8d42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:55:49.556051 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-1834820a-0b49-4b0d-8e25-d863e93a8d42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 03:55:49.557698 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 92/182] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:55:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:55:49.563752 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834820a-0b49-4b0d-8e25-d863e93a8d42 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:49.663538 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710714d-72bb-4857-8835-7b0c84c2a934 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:49.670752 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834820a-0b49-4b0d-8e25-d863e93a8d42 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:49.705171 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38f46a-ab4c-4c3e-8cb5-ee2ab3f3490e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:49.706168 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38f46a-ab4c-4c3e-8cb5-ee2ab3f3490e None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:49.706645 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38f46a-ab4c-4c3e-8cb5-ee2ab3f3490e None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:49.707113 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38f46a-ab4c-4c3e-8cb5-ee2ab3f3490e None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:49.708295 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38f46a-ab4c-4c3e-8cb5-ee2ab3f3490e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:49.708917 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38f46a-ab4c-4c3e-8cb5-ee2ab3f3490e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:49.710621 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38f46a-ab4c-4c3e-8cb5-ee2ab3f3490e None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:49.717349 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4258a-4023-4132-bc91-7ee7615ffb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:49.718018 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4258a-4023-4132-bc91-7ee7615ffb83 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:49.718306 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4258a-4023-4132-bc91-7ee7615ffb83 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:49.718582 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4258a-4023-4132-bc91-7ee7615ffb83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:49.719404 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4258a-4023-4132-bc91-7ee7615ffb83 None admin] RBAC: Adding query filter params (role.id=73b2aee45a2d4be19addaf4a33414295, scope.project.id=5c1ee3b04f6343f1a44e57e4f26f7361, user.id=96a9b787ace2448a9a22c86d6847863f) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:49.719724 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4258a-4023-4132-bc91-7ee7615ffb83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:49.721095 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 93/183] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:55:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:55:49.721198 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4258a-4023-4132-bc91-7ee7615ffb83 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:49.727440 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38f46a-ab4c-4c3e-8cb5-ee2ab3f3490e None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:49.727950 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 91/184] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:55:49 2022] GET /identity/v3/role_assignments?user.id=96a9b787ace2448a9a22c86d6847863f&scope.project.id=5c1ee3b04f6343f1a44e57e4f26f7361&role.id=73b2aee45a2d4be19addaf4a33414295 => generated 608 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:55:49.808096 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55929b-a48f-4903-825d-8188046807bd None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:49.808096 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55929b-a48f-4903-825d-8188046807bd None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:49.808467 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55929b-a48f-4903-825d-8188046807bd None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:49.810385 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 92/185] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:49.815734 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3688e3c-e557-4c8d-b3e5-01f7c7b6622b None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:49.815734 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3688e3c-e557-4c8d-b3e5-01f7c7b6622b None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:49.816045 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3688e3c-e557-4c8d-b3e5-01f7c7b6622b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:49.840515 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38f46a-ab4c-4c3e-8cb5-ee2ab3f3490e None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:49.856703 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-f3688e3c-e557-4c8d-b3e5-01f7c7b6622b None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:49.857891 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-f3688e3c-e557-4c8d-b3e5-01f7c7b6622b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:49.878228 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23025b4-4c6b-4e49-89f8-d4d7516c500d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:49.879451 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23025b4-4c6b-4e49-89f8-d4d7516c500d None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:49.879962 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23025b4-4c6b-4e49-89f8-d4d7516c500d None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:49.880506 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23025b4-4c6b-4e49-89f8-d4d7516c500d None admin] PATH_INFO: `/v3/users/cde4d31ddb254c7397e53e0ea9e03da0` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:49.895373 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23025b4-4c6b-4e49-89f8-d4d7516c500d None admin] RBAC: Authorizing `identity:get_user(user_id=cde4d31ddb254c7397e53e0ea9e03da0)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:49.897336 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23025b4-4c6b-4e49-89f8-d4d7516c500d None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:49.899296 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 94/186] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:55:49 2022] GET /identity/v3/users/cde4d31ddb254c7397e53e0ea9e03da0 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:55:49.902453 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddb293-cc6d-4202-9a01-49cb58c06570 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:49.902724 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddb293-cc6d-4202-9a01-49cb58c06570 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:49.903005 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddb293-cc6d-4202-9a01-49cb58c06570 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:49.905039 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 95/187] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:49.905684 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deddb293-cc6d-4202-9a01-49cb58c06570 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:49.960602 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 93/188] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 03:55:49.962264 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce863ec-ed43-4d4b-97ba-88a66b74a31d None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:49.962264 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce863ec-ed43-4d4b-97ba-88a66b74a31d None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:49.962532 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce863ec-ed43-4d4b-97ba-88a66b74a31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:49.980284 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-2ce863ec-ed43-4d4b-97ba-88a66b74a31d None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:49.981466 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-2ce863ec-ed43-4d4b-97ba-88a66b74a31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:50.047388 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deddb293-cc6d-4202-9a01-49cb58c06570 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:50.061620 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 94/189] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:55:50.062773 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce863ec-ed43-4d4b-97ba-88a66b74a31d None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:50.083188 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eac052-fdc7-481d-993b-fe00248204f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:50.084424 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eac052-fdc7-481d-993b-fe00248204f9 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:50.084676 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eac052-fdc7-481d-993b-fe00248204f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:50.084950 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eac052-fdc7-481d-993b-fe00248204f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:50.174747 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eac052-fdc7-481d-993b-fe00248204f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:50.177387 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eac052-fdc7-481d-993b-fe00248204f9 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:50.180489 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce863ec-ed43-4d4b-97ba-88a66b74a31d None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:50.212322 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad0db9-cc9a-43ea-a73b-673977cbc0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:50.213058 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad0db9-cc9a-43ea-a73b-673977cbc0d2 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:50.213337 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad0db9-cc9a-43ea-a73b-673977cbc0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:50.213608 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad0db9-cc9a-43ea-a73b-673977cbc0d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:50.222956 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad0db9-cc9a-43ea-a73b-673977cbc0d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:55:50.230808 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-95ad0db9-cc9a-43ea-a73b-673977cbc0d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 10 03:55:50.232165 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 95/190] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Mar 10 03:55:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:55:50.232746 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad0db9-cc9a-43ea-a73b-673977cbc0d2 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:50.279232 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 96/191] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:55:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:55:50.279232 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729908f-2185-4290-908a-b6b291a1e2c1 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:50.279232 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729908f-2185-4290-908a-b6b291a1e2c1 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:50.279232 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729908f-2185-4290-908a-b6b291a1e2c1 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:50.279232 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 97/192] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:50.279232 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729908f-2185-4290-908a-b6b291a1e2c1 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:50.323954 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad0db9-cc9a-43ea-a73b-673977cbc0d2 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:50.354497 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e36e3b-dcc3-4cb1-a20c-9eb98c20c16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:50.355274 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e36e3b-dcc3-4cb1-a20c-9eb98c20c16d None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:50.355553 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e36e3b-dcc3-4cb1-a20c-9eb98c20c16d None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:50.355855 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e36e3b-dcc3-4cb1-a20c-9eb98c20c16d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:50.357027 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e36e3b-dcc3-4cb1-a20c-9eb98c20c16d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:50.358469 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e36e3b-dcc3-4cb1-a20c-9eb98c20c16d None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:50.360094 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 96/193] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:55:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:50.360836 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e36e3b-dcc3-4cb1-a20c-9eb98c20c16d None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:50.373167 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729908f-2185-4290-908a-b6b291a1e2c1 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:50.405086 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226de9ee-eccf-43df-9e64-67b14c6705fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:50.405743 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226de9ee-eccf-43df-9e64-67b14c6705fd None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:50.406023 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226de9ee-eccf-43df-9e64-67b14c6705fd None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:50.406300 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226de9ee-eccf-43df-9e64-67b14c6705fd None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:50.407037 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226de9ee-eccf-43df-9e64-67b14c6705fd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:50.407340 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226de9ee-eccf-43df-9e64-67b14c6705fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:50.408734 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226de9ee-eccf-43df-9e64-67b14c6705fd None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:50.416224 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 98/194] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:55:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:50.417343 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e9aa7-c417-41d5-a586-99d029942e1f None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:50.417628 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e9aa7-c417-41d5-a586-99d029942e1f None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:50.417903 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e9aa7-c417-41d5-a586-99d029942e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:50.433031 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-429e9aa7-c417-41d5-a586-99d029942e1f None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:50.434204 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-429e9aa7-c417-41d5-a586-99d029942e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:50.456537 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e36e3b-dcc3-4cb1-a20c-9eb98c20c16d None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:50.487311 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143faaf2-58ed-4280-b7e0-05465d88bd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:50.488128 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143faaf2-58ed-4280-b7e0-05465d88bd41 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:50.488410 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143faaf2-58ed-4280-b7e0-05465d88bd41 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:50.488684 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143faaf2-58ed-4280-b7e0-05465d88bd41 None admin] PATH_INFO: `/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:50.489878 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143faaf2-58ed-4280-b7e0-05465d88bd41 None admin] RBAC: Authorizing `identity:get_project(project_id=fdcba3bc2cf94d4683c633c879cc7d25)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:50.491303 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143faaf2-58ed-4280-b7e0-05465d88bd41 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:50.493004 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 97/195] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:55:50 2022] GET /identity/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25 => generated 302 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:50.494573 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143faaf2-58ed-4280-b7e0-05465d88bd41 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:50.495940 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 99/196] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:55:50.496881 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e9aa7-c417-41d5-a586-99d029942e1f None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:50.587018 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143faaf2-58ed-4280-b7e0-05465d88bd41 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:50.597134 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e9aa7-c417-41d5-a586-99d029942e1f None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:50.617579 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2220843-ded1-4835-b0ab-e27a86b15775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:50.618238 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2220843-ded1-4835-b0ab-e27a86b15775 None admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:50.618520 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2220843-ded1-4835-b0ab-e27a86b15775 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:50.618801 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2220843-ded1-4835-b0ab-e27a86b15775 None admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:50.619504 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2220843-ded1-4835-b0ab-e27a86b15775 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:50.620963 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2220843-ded1-4835-b0ab-e27a86b15775 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:50.628149 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a46cdd-b4eb-49ea-aeb2-65883c4268e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:50.629012 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a46cdd-b4eb-49ea-aeb2-65883c4268e8 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:50.629295 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a46cdd-b4eb-49ea-aeb2-65883c4268e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:50.629811 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a46cdd-b4eb-49ea-aeb2-65883c4268e8 None admin] PATH_INFO: `/v3/users/cde4d31ddb254c7397e53e0ea9e03da0` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:50.631987 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a46cdd-b4eb-49ea-aeb2-65883c4268e8 None admin] RBAC: Authorizing `identity:get_user(user_id=cde4d31ddb254c7397e53e0ea9e03da0)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:50.633605 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a46cdd-b4eb-49ea-aeb2-65883c4268e8 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:50.639907 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 100/197] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:55:50 2022] GET /identity/v3/users/cde4d31ddb254c7397e53e0ea9e03da0 => generated 283 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:50.639907 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a46cdd-b4eb-49ea-aeb2-65883c4268e8 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:50.640238 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 98/198] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Mar 10 03:55:50 2022] POST /identity/v3/users => generated 297 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 03:55:50.640762 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2220843-ded1-4835-b0ab-e27a86b15775 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:50.742225 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a46cdd-b4eb-49ea-aeb2-65883c4268e8 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:50.743858 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2220843-ded1-4835-b0ab-e27a86b15775 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:50.777461 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3ced5-1082-4f46-a996-d7c0fd16f446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:50.777716 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf49e5-461b-4eef-8419-05c840916b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:50.778146 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3ced5-1082-4f46-a996-d7c0fd16f446 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:50.778320 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf49e5-461b-4eef-8419-05c840916b99 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:50.778488 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3ced5-1082-4f46-a996-d7c0fd16f446 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:50.778603 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf49e5-461b-4eef-8419-05c840916b99 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:50.778770 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3ced5-1082-4f46-a996-d7c0fd16f446 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:50.778858 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf49e5-461b-4eef-8419-05c840916b99 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:50.779618 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3ced5-1082-4f46-a996-d7c0fd16f446 None admin] RBAC: Adding query filter params (role.id=a8b2a5887cec4a31b7304792af3dd3f1, scope.project.id=fdcba3bc2cf94d4683c633c879cc7d25, user.id=cde4d31ddb254c7397e53e0ea9e03da0) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:50.779962 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3ced5-1082-4f46-a996-d7c0fd16f446 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:50.781486 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3ced5-1082-4f46-a996-d7c0fd16f446 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:50.787454 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 101/199] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:55:50 2022] GET /identity/v3/role_assignments?user.id=cde4d31ddb254c7397e53e0ea9e03da0&scope.project.id=fdcba3bc2cf94d4683c633c879cc7d25&role.id=a8b2a5887cec4a31b7304792af3dd3f1 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:50.788341 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3ced5-1082-4f46-a996-d7c0fd16f446 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:50.791914 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf49e5-461b-4eef-8419-05c840916b99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:55:50.798378 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-7cbf49e5-461b-4eef-8419-05c840916b99 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 10 03:55:50.805118 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 99/200] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:55:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:55:50.806714 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf49e5-461b-4eef-8419-05c840916b99 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:50.912345 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3ced5-1082-4f46-a996-d7c0fd16f446 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:50.919803 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf49e5-461b-4eef-8419-05c840916b99 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:50.952391 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f297d16-6cb6-4c67-9c1c-f37e896202d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:50.953052 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f297d16-6cb6-4c67-9c1c-f37e896202d6 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:50.953331 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f297d16-6cb6-4c67-9c1c-f37e896202d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:50.953616 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f297d16-6cb6-4c67-9c1c-f37e896202d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:50.959376 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd5a5d-eb44-4966-8356-b0b9ff104097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:50.960415 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd5a5d-eb44-4966-8356-b0b9ff104097 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:50.960926 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd5a5d-eb44-4966-8356-b0b9ff104097 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:50.961400 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd5a5d-eb44-4966-8356-b0b9ff104097 None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:50.962369 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd5a5d-eb44-4966-8356-b0b9ff104097 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:50.962878 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd5a5d-eb44-4966-8356-b0b9ff104097 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:50.964545 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd5a5d-eb44-4966-8356-b0b9ff104097 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:50.973900 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 100/201] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Mar 10 03:55:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:50.979806 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd5a5d-eb44-4966-8356-b0b9ff104097 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:51.028564 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f297d16-6cb6-4c67-9c1c-f37e896202d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:51.029961 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f297d16-6cb6-4c67-9c1c-f37e896202d6 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:51.101203 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd5a5d-eb44-4966-8356-b0b9ff104097 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:51.142842 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657d267-7c32-4e52-b021-98c82907fec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:51.143821 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657d267-7c32-4e52-b021-98c82907fec4 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:51.144107 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657d267-7c32-4e52-b021-98c82907fec4 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:51.144386 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657d267-7c32-4e52-b021-98c82907fec4 None admin] PATH_INFO: `/v3/users/0d455a3b0b5344c48eae404262081862` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:51.145717 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5657d267-7c32-4e52-b021-98c82907fec4 None admin] RBAC: Authorizing `identity:get_user(user_id=0d455a3b0b5344c48eae404262081862)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:51.147199 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5657d267-7c32-4e52-b021-98c82907fec4 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:51.148903 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 101/202] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:55:50 2022] GET /identity/v3/users/0d455a3b0b5344c48eae404262081862 => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:55:51.154266 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657d267-7c32-4e52-b021-98c82907fec4 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:51.158859 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 102/203] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:55:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:55:51.165558 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f297d16-6cb6-4c67-9c1c-f37e896202d6 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:51.280035 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f297d16-6cb6-4c67-9c1c-f37e896202d6 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:51.317557 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be4caa-01c3-44a7-8c3d-f79f30f8c5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:51.318998 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be4caa-01c3-44a7-8c3d-f79f30f8c5e9 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:51.319477 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be4caa-01c3-44a7-8c3d-f79f30f8c5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:51.320023 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be4caa-01c3-44a7-8c3d-f79f30f8c5e9 None admin] PATH_INFO: `/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:51.321665 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be4caa-01c3-44a7-8c3d-f79f30f8c5e9 None admin] RBAC: Authorizing `identity:get_project(project_id=fdcba3bc2cf94d4683c633c879cc7d25)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:51.323472 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be4caa-01c3-44a7-8c3d-f79f30f8c5e9 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:51.327428 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 103/204] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:55:51 2022] GET /identity/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:51.333765 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be4caa-01c3-44a7-8c3d-f79f30f8c5e9 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:51.350306 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657d267-7c32-4e52-b021-98c82907fec4 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:51.389739 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db95f31-4730-4dbd-b019-85ef3c453cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:51.390708 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db95f31-4730-4dbd-b019-85ef3c453cd3 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:51.392158 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db95f31-4730-4dbd-b019-85ef3c453cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:51.393694 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db95f31-4730-4dbd-b019-85ef3c453cd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:51.480427 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db95f31-4730-4dbd-b019-85ef3c453cd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:51.482357 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db95f31-4730-4dbd-b019-85ef3c453cd3 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:51.566029 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be4caa-01c3-44a7-8c3d-f79f30f8c5e9 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:51.591279 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 102/205] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:55:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:55:51.597848 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db95f31-4730-4dbd-b019-85ef3c453cd3 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:51.632570 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069d501-cda2-44c6-8f04-c256bc9f7989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:51.633235 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069d501-cda2-44c6-8f04-c256bc9f7989 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:51.633516 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069d501-cda2-44c6-8f04-c256bc9f7989 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:51.633790 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069d501-cda2-44c6-8f04-c256bc9f7989 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:51.634626 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069d501-cda2-44c6-8f04-c256bc9f7989 None admin] RBAC: Adding query filter params (role.id=c38b04db9cd34eeaaaa8d2a6425c05ad, scope.project.id=fdcba3bc2cf94d4683c633c879cc7d25, user.id=cde4d31ddb254c7397e53e0ea9e03da0) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:51.634935 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069d501-cda2-44c6-8f04-c256bc9f7989 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:51.636457 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069d501-cda2-44c6-8f04-c256bc9f7989 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:51.642366 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 104/206] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:55:51 2022] GET /identity/v3/role_assignments?user.id=cde4d31ddb254c7397e53e0ea9e03da0&scope.project.id=fdcba3bc2cf94d4683c633c879cc7d25&role.id=c38b04db9cd34eeaaaa8d2a6425c05ad => generated 259 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:51.773170 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db95f31-4730-4dbd-b019-85ef3c453cd3 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:51.822529 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a8adf-0bb2-48fb-afc7-c29a4c8724aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:51.823325 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a8adf-0bb2-48fb-afc7-c29a4c8724aa None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:51.823613 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a8adf-0bb2-48fb-afc7-c29a4c8724aa None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:51.823915 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a8adf-0bb2-48fb-afc7-c29a4c8724aa None admin] PATH_INFO: `/v3/projects/296b04835db8494cbdfa27b87fe62760` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:51.825129 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a8adf-0bb2-48fb-afc7-c29a4c8724aa None admin] RBAC: Authorizing `identity:get_project(project_id=296b04835db8494cbdfa27b87fe62760)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:51.826594 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a8adf-0bb2-48fb-afc7-c29a4c8724aa None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:51.828673 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 103/207] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:55:51 2022] GET /identity/v3/projects/296b04835db8494cbdfa27b87fe62760 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:51.835229 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069d501-cda2-44c6-8f04-c256bc9f7989 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:51.961217 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069d501-cda2-44c6-8f04-c256bc9f7989 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:52.012403 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cad77-f6d7-4668-9522-1f4a1dbdb094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:52.013071 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cad77-f6d7-4668-9522-1f4a1dbdb094 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:52.013356 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cad77-f6d7-4668-9522-1f4a1dbdb094 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:52.013634 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cad77-f6d7-4668-9522-1f4a1dbdb094 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:52.014472 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cad77-f6d7-4668-9522-1f4a1dbdb094 None admin] RBAC: Adding query filter params (role.id=5daf615f445643608474ea1432d21e42, scope.project.id=296b04835db8494cbdfa27b87fe62760, user.id=0d455a3b0b5344c48eae404262081862) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:52.014784 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cad77-f6d7-4668-9522-1f4a1dbdb094 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:52.016264 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cad77-f6d7-4668-9522-1f4a1dbdb094 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:52.023402 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 105/208] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:55:51 2022] GET /identity/v3/role_assignments?user.id=0d455a3b0b5344c48eae404262081862&scope.project.id=296b04835db8494cbdfa27b87fe62760&role.id=5daf615f445643608474ea1432d21e42 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:53.225649 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667691f-5fb6-40be-bb89-edd670dfd3b6 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:53.226481 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667691f-5fb6-40be-bb89-edd670dfd3b6 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:53.226922 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667691f-5fb6-40be-bb89-edd670dfd3b6 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:53.229107 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 104/209] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:53.235182 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f58d13-5d5c-40b8-8b82-db0cf32fd222 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:53.236008 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f58d13-5d5c-40b8-8b82-db0cf32fd222 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:53.236478 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f58d13-5d5c-40b8-8b82-db0cf32fd222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:53.253538 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-55f58d13-5d5c-40b8-8b82-db0cf32fd222 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:53.255010 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-55f58d13-5d5c-40b8-8b82-db0cf32fd222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:53.307753 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac8506-8536-4844-a740-569bbda41c2f None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:53.308365 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac8506-8536-4844-a740-569bbda41c2f None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:53.308854 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac8506-8536-4844-a740-569bbda41c2f None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:53.311160 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 105/210] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:53.317213 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c0a92-007e-40a1-b02a-be40783ccffa None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:53.318357 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c0a92-007e-40a1-b02a-be40783ccffa None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:53.319098 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c0a92-007e-40a1-b02a-be40783ccffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:53.326439 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 106/211] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:55:53.338486 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-305c0a92-007e-40a1-b02a-be40783ccffa None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:53.341968 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-305c0a92-007e-40a1-b02a-be40783ccffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:53.348582 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f58d13-5d5c-40b8-8b82-db0cf32fd222 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:53.410783 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 106/212] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 03:55:53.434063 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c0a92-007e-40a1-b02a-be40783ccffa None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:53.453468 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f58d13-5d5c-40b8-8b82-db0cf32fd222 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:53.489060 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e90225-0ee0-4d89-bcb6-c30fb766ebd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:53.490753 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e90225-0ee0-4d89-bcb6-c30fb766ebd6 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:53.491233 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e90225-0ee0-4d89-bcb6-c30fb766ebd6 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:53.491875 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e90225-0ee0-4d89-bcb6-c30fb766ebd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:53.505546 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e90225-0ee0-4d89-bcb6-c30fb766ebd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:55:53.514872 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-a2e90225-0ee0-4d89-bcb6-c30fb766ebd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 03:55:53.516856 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 107/213] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:55:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:55:53.522677 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e90225-0ee0-4d89-bcb6-c30fb766ebd6 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:53.539079 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c0a92-007e-40a1-b02a-be40783ccffa None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:53.582910 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda6e6e-3bf4-4918-bbc3-f9b3b0de11c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:53.585152 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda6e6e-3bf4-4918-bbc3-f9b3b0de11c3 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:53.585630 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda6e6e-3bf4-4918-bbc3-f9b3b0de11c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:53.586094 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda6e6e-3bf4-4918-bbc3-f9b3b0de11c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:53.599867 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda6e6e-3bf4-4918-bbc3-f9b3b0de11c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:55:53.609430 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-dfda6e6e-3bf4-4918-bbc3-f9b3b0de11c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 03:55:53.615993 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 107/214] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:55:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:55:53.617476 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda6e6e-3bf4-4918-bbc3-f9b3b0de11c3 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:53.626521 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e90225-0ee0-4d89-bcb6-c30fb766ebd6 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:53.660763 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11a2bd-b510-4755-801b-8dc0a6438374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:53.661525 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11a2bd-b510-4755-801b-8dc0a6438374 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:53.661750 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11a2bd-b510-4755-801b-8dc0a6438374 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:53.662036 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11a2bd-b510-4755-801b-8dc0a6438374 None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:53.662931 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11a2bd-b510-4755-801b-8dc0a6438374 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:53.663097 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11a2bd-b510-4755-801b-8dc0a6438374 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:53.664521 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11a2bd-b510-4755-801b-8dc0a6438374 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:53.672989 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 108/215] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:55:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:55:53.678958 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11a2bd-b510-4755-801b-8dc0a6438374 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:53.731976 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda6e6e-3bf4-4918-bbc3-f9b3b0de11c3 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:53.765556 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb95f5e-7d55-446c-b086-93ed03ad1c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:53.766509 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb95f5e-7d55-446c-b086-93ed03ad1c7c None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:53.766509 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb95f5e-7d55-446c-b086-93ed03ad1c7c None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:53.766791 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb95f5e-7d55-446c-b086-93ed03ad1c7c None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:53.767565 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb95f5e-7d55-446c-b086-93ed03ad1c7c None admin] RBAC: Adding query filter params (name=member) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:53.767927 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb95f5e-7d55-446c-b086-93ed03ad1c7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:53.769416 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb95f5e-7d55-446c-b086-93ed03ad1c7c None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:53.778488 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 108/216] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Mar 10 03:55:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:53.779896 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153308a-1b3c-4db2-8924-bc949a2ca0aa None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:53.780185 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153308a-1b3c-4db2-8924-bc949a2ca0aa None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:53.780462 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153308a-1b3c-4db2-8924-bc949a2ca0aa None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:53.782444 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 109/217] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:53.787066 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11a2bd-b510-4755-801b-8dc0a6438374 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:53.787299 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153308a-1b3c-4db2-8924-bc949a2ca0aa None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:53.823083 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa415bfb-04c8-4b50-84e6-5c127667253a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:53.824131 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa415bfb-04c8-4b50-84e6-5c127667253a None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:53.824411 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa415bfb-04c8-4b50-84e6-5c127667253a None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:53.824686 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa415bfb-04c8-4b50-84e6-5c127667253a None admin] PATH_INFO: `/v3/users/cde4d31ddb254c7397e53e0ea9e03da0` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:53.825876 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa415bfb-04c8-4b50-84e6-5c127667253a None admin] RBAC: Authorizing `identity:get_user(user_id=cde4d31ddb254c7397e53e0ea9e03da0)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:53.827314 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa415bfb-04c8-4b50-84e6-5c127667253a None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:53.833393 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 109/218] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:55:53 2022] GET /identity/v3/users/cde4d31ddb254c7397e53e0ea9e03da0 => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:53.833393 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0184a0-cd8e-473a-9623-ada3e484ddc8 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:53.833393 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0184a0-cd8e-473a-9623-ada3e484ddc8 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:53.833393 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0184a0-cd8e-473a-9623-ada3e484ddc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:53.847190 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-1f0184a0-cd8e-473a-9623-ada3e484ddc8 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:53.848482 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-1f0184a0-cd8e-473a-9623-ada3e484ddc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:53.894994 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153308a-1b3c-4db2-8924-bc949a2ca0aa None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:53.913746 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 110/219] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:55:53.914326 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0184a0-cd8e-473a-9623-ada3e484ddc8 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:53.938447 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff7d4e-c4d3-4d09-8fa2-e84a0ae1eb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:53.940138 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff7d4e-c4d3-4d09-8fa2-e84a0ae1eb6f None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:53.940616 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff7d4e-c4d3-4d09-8fa2-e84a0ae1eb6f None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:53.941181 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff7d4e-c4d3-4d09-8fa2-e84a0ae1eb6f None admin] PATH_INFO: `/v3/users/4d79bbec2ba94fcf9ef2b8d988da76b1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:53.956314 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff7d4e-c4d3-4d09-8fa2-e84a0ae1eb6f None admin] RBAC: Authorizing `identity:get_user(user_id=4d79bbec2ba94fcf9ef2b8d988da76b1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:53.957967 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff7d4e-c4d3-4d09-8fa2-e84a0ae1eb6f None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:53.964110 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 110/220] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:55:53 2022] GET /identity/v3/users/4d79bbec2ba94fcf9ef2b8d988da76b1 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:53.965099 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff7d4e-c4d3-4d09-8fa2-e84a0ae1eb6f None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:54.011833 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0184a0-cd8e-473a-9623-ada3e484ddc8 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:54.044058 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3d882-91d1-4ddd-b659-b51e8e861202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:54.044924 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3d882-91d1-4ddd-b659-b51e8e861202 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:54.045203 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3d882-91d1-4ddd-b659-b51e8e861202 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:54.045480 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3d882-91d1-4ddd-b659-b51e8e861202 None admin] PATH_INFO: `/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:54.046643 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3d882-91d1-4ddd-b659-b51e8e861202 None admin] RBAC: Authorizing `identity:get_project(project_id=fdcba3bc2cf94d4683c633c879cc7d25)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:54.048125 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3d882-91d1-4ddd-b659-b51e8e861202 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:54.054921 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 111/221] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:55:53 2022] GET /identity/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25 => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:54.054921 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3d882-91d1-4ddd-b659-b51e8e861202 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:54.070460 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff7d4e-c4d3-4d09-8fa2-e84a0ae1eb6f None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:54.104094 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42b3ef-33bb-40b4-8c71-f7c4ae7894e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:54.104874 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42b3ef-33bb-40b4-8c71-f7c4ae7894e1 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:54.105159 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42b3ef-33bb-40b4-8c71-f7c4ae7894e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:54.105437 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42b3ef-33bb-40b4-8c71-f7c4ae7894e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:54.106609 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c42b3ef-33bb-40b4-8c71-f7c4ae7894e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:54.108083 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c42b3ef-33bb-40b4-8c71-f7c4ae7894e1 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:54.109697 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 111/222] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:55:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:54.110424 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42b3ef-33bb-40b4-8c71-f7c4ae7894e1 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:54.159541 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3d882-91d1-4ddd-b659-b51e8e861202 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:54.191483 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc72e0f-5238-4858-8fd6-11063c2c4b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:54.192095 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc72e0f-5238-4858-8fd6-11063c2c4b56 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:54.192374 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc72e0f-5238-4858-8fd6-11063c2c4b56 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:54.192673 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc72e0f-5238-4858-8fd6-11063c2c4b56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:54.207299 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42b3ef-33bb-40b4-8c71-f7c4ae7894e1 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:54.238414 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc531c9a-937d-487c-8839-9f026bd7e922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:54.239292 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc531c9a-937d-487c-8839-9f026bd7e922 None admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:54.240221 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc531c9a-937d-487c-8839-9f026bd7e922 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:54.240498 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc531c9a-937d-487c-8839-9f026bd7e922 None admin] PATH_INFO: `/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25/users/cde4d31ddb254c7397e53e0ea9e03da0/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:54.242476 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc531c9a-937d-487c-8839-9f026bd7e922 None admin] RBAC: Authorizing `identity:create_grant(project_id=fdcba3bc2cf94d4683c633c879cc7d25, user_id=cde4d31ddb254c7397e53e0ea9e03da0, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:54.243950 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc531c9a-937d-487c-8839-9f026bd7e922 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:54.255504 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 112/223] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Mar 10 03:55:54 2022] PUT /identity/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25/users/cde4d31ddb254c7397e53e0ea9e03da0/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 03:55:54.256293 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc531c9a-937d-487c-8839-9f026bd7e922 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:54.260721 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc72e0f-5238-4858-8fd6-11063c2c4b56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:54.262245 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc72e0f-5238-4858-8fd6-11063c2c4b56 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:54.360452 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc531c9a-937d-487c-8839-9f026bd7e922 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:54.367533 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 112/224] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:55:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:55:54.369197 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8773a2-6511-4a00-ad30-4ef2e551066e None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:54.369696 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8773a2-6511-4a00-ad30-4ef2e551066e None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:54.370147 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8773a2-6511-4a00-ad30-4ef2e551066e None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:54.372382 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 113/225] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:54.376992 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8773a2-6511-4a00-ad30-4ef2e551066e None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:54.403605 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2a0dc-a23c-45b6-9d5a-98737f5895ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:54.404414 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2a0dc-a23c-45b6-9d5a-98737f5895ac None admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:54.404699 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2a0dc-a23c-45b6-9d5a-98737f5895ac None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:54.404972 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2a0dc-a23c-45b6-9d5a-98737f5895ac None admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:54.405694 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2a0dc-a23c-45b6-9d5a-98737f5895ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:54.407139 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2a0dc-a23c-45b6-9d5a-98737f5895ac None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:54.429983 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 113/226] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Mar 10 03:55:54 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 03:55:54.430171 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02047633-9f52-4599-a1f7-bd0b6a568d23 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:54.430416 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02047633-9f52-4599-a1f7-bd0b6a568d23 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:54.431026 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02047633-9f52-4599-a1f7-bd0b6a568d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:54.453462 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-02047633-9f52-4599-a1f7-bd0b6a568d23 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:54.454604 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-02047633-9f52-4599-a1f7-bd0b6a568d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:54.492764 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8773a2-6511-4a00-ad30-4ef2e551066e None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:54.536878 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56597a75-c12b-4267-b3e6-50ae0e1c52ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:54.538245 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56597a75-c12b-4267-b3e6-50ae0e1c52ab None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:54.538593 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56597a75-c12b-4267-b3e6-50ae0e1c52ab None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:54.539131 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56597a75-c12b-4267-b3e6-50ae0e1c52ab None admin] PATH_INFO: `/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:54.540623 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56597a75-c12b-4267-b3e6-50ae0e1c52ab None admin] RBAC: Authorizing `identity:get_project(project_id=fdcba3bc2cf94d4683c633c879cc7d25)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:54.542255 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56597a75-c12b-4267-b3e6-50ae0e1c52ab None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:54.542463 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 114/227] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:55:54.552112 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 114/228] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:55:54 2022] GET /identity/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:54.554215 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02047633-9f52-4599-a1f7-bd0b6a568d23 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:54.570258 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56597a75-c12b-4267-b3e6-50ae0e1c52ab None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:54.691593 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02047633-9f52-4599-a1f7-bd0b6a568d23 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:54.707556 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56597a75-c12b-4267-b3e6-50ae0e1c52ab None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:54.729007 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec722f-3560-4772-be2e-d298f04aa7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:54.729838 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec722f-3560-4772-be2e-d298f04aa7dc None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:54.730121 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec722f-3560-4772-be2e-d298f04aa7dc None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:54.730394 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec722f-3560-4772-be2e-d298f04aa7dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:54.731219 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec722f-3560-4772-be2e-d298f04aa7dc None admin] RBAC: Adding query filter params (role.id=73b2aee45a2d4be19addaf4a33414295, scope.project.id=fdcba3bc2cf94d4683c633c879cc7d25, user.id=4d79bbec2ba94fcf9ef2b8d988da76b1) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:54.731840 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec722f-3560-4772-be2e-d298f04aa7dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:54.733046 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec722f-3560-4772-be2e-d298f04aa7dc None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:54.739116 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 115/229] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:55:54 2022] GET /identity/v3/role_assignments?user.id=4d79bbec2ba94fcf9ef2b8d988da76b1&scope.project.id=fdcba3bc2cf94d4683c633c879cc7d25&role.id=73b2aee45a2d4be19addaf4a33414295 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:54.749571 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbefbc6-cea5-4877-a895-8121442f882a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:54.750443 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbefbc6-cea5-4877-a895-8121442f882a None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:54.750726 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbefbc6-cea5-4877-a895-8121442f882a None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:54.750999 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbefbc6-cea5-4877-a895-8121442f882a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:54.762723 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbefbc6-cea5-4877-a895-8121442f882a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:55:54.770475 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-8fbefbc6-cea5-4877-a895-8121442f882a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 10 03:55:54.772794 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 115/230] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Mar 10 03:55:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:55:54.778748 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec722f-3560-4772-be2e-d298f04aa7dc None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:54.889992 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec722f-3560-4772-be2e-d298f04aa7dc None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:54.925692 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e76c5b-f035-4b20-b59a-01e2d3aa1de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:54.926365 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e76c5b-f035-4b20-b59a-01e2d3aa1de6 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:54.926643 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e76c5b-f035-4b20-b59a-01e2d3aa1de6 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:54.926953 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e76c5b-f035-4b20-b59a-01e2d3aa1de6 None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:54.927801 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e76c5b-f035-4b20-b59a-01e2d3aa1de6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:54.928100 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e76c5b-f035-4b20-b59a-01e2d3aa1de6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:54.929629 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e76c5b-f035-4b20-b59a-01e2d3aa1de6 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:54.938490 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 116/231] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:55:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:54.945011 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbefbc6-cea5-4877-a895-8121442f882a None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:55.068673 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbefbc6-cea5-4877-a895-8121442f882a None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:55.118977 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d872b-3c37-48cb-b60a-744bee83e966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:55.119890 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d872b-3c37-48cb-b60a-744bee83e966 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:55.120177 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d872b-3c37-48cb-b60a-744bee83e966 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:55.120456 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d872b-3c37-48cb-b60a-744bee83e966 None admin] PATH_INFO: `/v3/users/cde4d31ddb254c7397e53e0ea9e03da0` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:55.124427 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d872b-3c37-48cb-b60a-744bee83e966 None admin] RBAC: Authorizing `identity:get_user(user_id=cde4d31ddb254c7397e53e0ea9e03da0)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:55.125949 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d872b-3c37-48cb-b60a-744bee83e966 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:55.127924 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 116/232] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:55:54 2022] GET /identity/v3/users/cde4d31ddb254c7397e53e0ea9e03da0 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:55.133532 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e76c5b-f035-4b20-b59a-01e2d3aa1de6 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:55.277927 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e76c5b-f035-4b20-b59a-01e2d3aa1de6 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:55.320026 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765d960-182c-4a82-8e4e-01e635992dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:55.320812 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765d960-182c-4a82-8e4e-01e635992dba None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:55.321090 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765d960-182c-4a82-8e4e-01e635992dba None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:55.321363 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765d960-182c-4a82-8e4e-01e635992dba None admin] PATH_INFO: `/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:55.322540 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765d960-182c-4a82-8e4e-01e635992dba None admin] RBAC: Authorizing `identity:get_project(project_id=fdcba3bc2cf94d4683c633c879cc7d25)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:55.324004 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765d960-182c-4a82-8e4e-01e635992dba None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:55.325683 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 117/233] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:55:55 2022] GET /identity/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:55.331245 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d872b-3c37-48cb-b60a-744bee83e966 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:55.441276 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d872b-3c37-48cb-b60a-744bee83e966 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:55.474974 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e6722-cce5-45ec-8fb3-504720b90e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:55.475898 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e6722-cce5-45ec-8fb3-504720b90e19 None admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:55.476184 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e6722-cce5-45ec-8fb3-504720b90e19 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:55.476466 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e6722-cce5-45ec-8fb3-504720b90e19 None admin] PATH_INFO: `/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25/users/cde4d31ddb254c7397e53e0ea9e03da0/roles/c38b04db9cd34eeaaaa8d2a6425c05ad` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:55.478713 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e6722-cce5-45ec-8fb3-504720b90e19 None admin] RBAC: Authorizing `identity:create_grant(project_id=fdcba3bc2cf94d4683c633c879cc7d25, user_id=cde4d31ddb254c7397e53e0ea9e03da0, role_id=c38b04db9cd34eeaaaa8d2a6425c05ad)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:55.480207 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e6722-cce5-45ec-8fb3-504720b90e19 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:55.495230 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 117/234] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Mar 10 03:55:55 2022] PUT /identity/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25/users/cde4d31ddb254c7397e53e0ea9e03da0/roles/c38b04db9cd34eeaaaa8d2a6425c05ad => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 03:55:56.912476 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51420b36-5651-4ca8-828b-2b05b7704f6e None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:56.913166 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51420b36-5651-4ca8-828b-2b05b7704f6e None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:56.913166 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51420b36-5651-4ca8-828b-2b05b7704f6e None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:56.915058 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 118/235] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:56.920962 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cac873-3037-4b92-9d3c-94dc294eb99c None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:56.921793 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cac873-3037-4b92-9d3c-94dc294eb99c None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:56.922279 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cac873-3037-4b92-9d3c-94dc294eb99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:56.952985 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-51cac873-3037-4b92-9d3c-94dc294eb99c None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:56.954495 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-51cac873-3037-4b92-9d3c-94dc294eb99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:57.042360 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 118/236] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:55:57.085237 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51420b36-5651-4ca8-828b-2b05b7704f6e None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:57.213290 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51420b36-5651-4ca8-828b-2b05b7704f6e None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:57.258866 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869ee1a-5067-40ee-a848-cc0136e12614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:57.260095 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869ee1a-5067-40ee-a848-cc0136e12614 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:57.260592 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869ee1a-5067-40ee-a848-cc0136e12614 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:57.261056 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869ee1a-5067-40ee-a848-cc0136e12614 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:57.281056 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869ee1a-5067-40ee-a848-cc0136e12614 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:55:57.288877 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-a869ee1a-5067-40ee-a848-cc0136e12614 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 03:55:57.290336 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 119/237] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:55:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:55:57.296240 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cac873-3037-4b92-9d3c-94dc294eb99c None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:57.319393 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b9958-fc31-4bde-92b7-d4fccfdc74b9 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:57.319710 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b9958-fc31-4bde-92b7-d4fccfdc74b9 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:57.320154 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b9958-fc31-4bde-92b7-d4fccfdc74b9 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:57.323284 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 120/238] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 03:55:57.327487 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936c248-914d-4071-a01a-2a1de74978a8 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:57.327983 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936c248-914d-4071-a01a-2a1de74978a8 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:57.328428 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936c248-914d-4071-a01a-2a1de74978a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:57.364912 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-9936c248-914d-4071-a01a-2a1de74978a8 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:57.366372 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-9936c248-914d-4071-a01a-2a1de74978a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:57.469335 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 121/239] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 03:55:57.474765 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c779ac8-a2c5-4abf-b7e7-e35e0b57c0b1 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:57.475084 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c779ac8-a2c5-4abf-b7e7-e35e0b57c0b1 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:57.475325 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c779ac8-a2c5-4abf-b7e7-e35e0b57c0b1 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:57.477177 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 122/240] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:57.485234 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78966d9-4cd0-4af3-8ce3-abb60e6a7a14 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:57.485543 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78966d9-4cd0-4af3-8ce3-abb60e6a7a14 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:57.485789 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78966d9-4cd0-4af3-8ce3-abb60e6a7a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:57.488694 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cac873-3037-4b92-9d3c-94dc294eb99c None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:57.506309 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-b78966d9-4cd0-4af3-8ce3-abb60e6a7a14 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:57.507529 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-b78966d9-4cd0-4af3-8ce3-abb60e6a7a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:57.527496 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cd349-d982-4b42-b681-5dd454f67651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:57.528220 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cd349-d982-4b42-b681-5dd454f67651 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:57.528554 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cd349-d982-4b42-b681-5dd454f67651 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:57.528832 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cd349-d982-4b42-b681-5dd454f67651 None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:57.529652 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242cd349-d982-4b42-b681-5dd454f67651 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:57.529963 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242cd349-d982-4b42-b681-5dd454f67651 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:57.531398 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242cd349-d982-4b42-b681-5dd454f67651 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:57.541146 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 119/241] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:55:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:57.541965 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cd349-d982-4b42-b681-5dd454f67651 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:57.586681 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 123/242] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:55:57.588387 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78966d9-4cd0-4af3-8ce3-abb60e6a7a14 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:57.678328 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cd349-d982-4b42-b681-5dd454f67651 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:57.689402 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78966d9-4cd0-4af3-8ce3-abb60e6a7a14 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:57.724242 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ab61f-abc4-4d79-bbee-f9a7412dee20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:57.724469 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ffe74-c824-493d-86ee-681cf4c8a122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:57.725240 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ab61f-abc4-4d79-bbee-f9a7412dee20 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:57.725596 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ffe74-c824-493d-86ee-681cf4c8a122 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:57.725705 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ab61f-abc4-4d79-bbee-f9a7412dee20 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:57.726048 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ab61f-abc4-4d79-bbee-f9a7412dee20 None admin] PATH_INFO: `/v3/users/cde4d31ddb254c7397e53e0ea9e03da0` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:57.726248 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ffe74-c824-493d-86ee-681cf4c8a122 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:57.726660 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ffe74-c824-493d-86ee-681cf4c8a122 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:57.727546 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ab61f-abc4-4d79-bbee-f9a7412dee20 None admin] RBAC: Authorizing `identity:get_user(user_id=cde4d31ddb254c7397e53e0ea9e03da0)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:57.729177 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ab61f-abc4-4d79-bbee-f9a7412dee20 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:57.731212 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 124/243] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:55:57 2022] GET /identity/v3/users/cde4d31ddb254c7397e53e0ea9e03da0 => generated 283 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:57.732167 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ab61f-abc4-4d79-bbee-f9a7412dee20 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:57.740595 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ffe74-c824-493d-86ee-681cf4c8a122 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:55:57.750582 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-0c8ffe74-c824-493d-86ee-681cf4c8a122 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 10 03:55:57.752467 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 120/244] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:55:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:55:57.754420 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ffe74-c824-493d-86ee-681cf4c8a122 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:57.852494 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ab61f-abc4-4d79-bbee-f9a7412dee20 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:57.868695 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ffe74-c824-493d-86ee-681cf4c8a122 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:57.885274 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43204f6f-860e-4772-9d67-9deb018a07bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:57.886070 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43204f6f-860e-4772-9d67-9deb018a07bc None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:57.886346 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43204f6f-860e-4772-9d67-9deb018a07bc None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:57.886612 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43204f6f-860e-4772-9d67-9deb018a07bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:57.897549 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43204f6f-860e-4772-9d67-9deb018a07bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:55:57.904341 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9c423-dd22-430a-b20d-ef8a1857995e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:57.904610 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-43204f6f-860e-4772-9d67-9deb018a07bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 03:55:57.905040 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9c423-dd22-430a-b20d-ef8a1857995e None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:57.905327 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9c423-dd22-430a-b20d-ef8a1857995e None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:57.905605 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9c423-dd22-430a-b20d-ef8a1857995e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:57.905805 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 125/245] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:55:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:55:57.906539 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43204f6f-860e-4772-9d67-9deb018a07bc None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:57.975292 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9c423-dd22-430a-b20d-ef8a1857995e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:57.976709 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa9c423-dd22-430a-b20d-ef8a1857995e None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:58.004636 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43204f6f-860e-4772-9d67-9deb018a07bc None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:58.037769 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e2e14-b666-403d-8a04-72d28640fb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:58.038432 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e2e14-b666-403d-8a04-72d28640fb6b None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:58.038718 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e2e14-b666-403d-8a04-72d28640fb6b None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:58.038999 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e2e14-b666-403d-8a04-72d28640fb6b None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:58.039764 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e2e14-b666-403d-8a04-72d28640fb6b None admin] RBAC: Adding query filter params (name=reader) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:58.040090 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e2e14-b666-403d-8a04-72d28640fb6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:58.041463 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e2e14-b666-403d-8a04-72d28640fb6b None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:58.053935 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 126/246] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Mar 10 03:55:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:58.053935 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea1a6a-6b61-4d0d-b7eb-7f278966d76d None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:58.053935 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea1a6a-6b61-4d0d-b7eb-7f278966d76d None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:58.053935 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea1a6a-6b61-4d0d-b7eb-7f278966d76d None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:58.053935 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 127/247] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:58.053935 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea1a6a-6b61-4d0d-b7eb-7f278966d76d None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:58.079669 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 121/248] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:55:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:55:58.080904 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9c423-dd22-430a-b20d-ef8a1857995e None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:58.160106 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea1a6a-6b61-4d0d-b7eb-7f278966d76d None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:58.183980 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9c423-dd22-430a-b20d-ef8a1857995e None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:58.195380 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6b41b-0e99-4714-94c5-1de4c2cee767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:58.196086 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6b41b-0e99-4714-94c5-1de4c2cee767 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:58.196372 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6b41b-0e99-4714-94c5-1de4c2cee767 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:58.196648 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6b41b-0e99-4714-94c5-1de4c2cee767 None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:58.197395 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6b41b-0e99-4714-94c5-1de4c2cee767 None admin] RBAC: Adding query filter params (name=member) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:58.197701 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6b41b-0e99-4714-94c5-1de4c2cee767 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:58.199092 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6b41b-0e99-4714-94c5-1de4c2cee767 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:58.211978 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 128/249] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Mar 10 03:55:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:58.213116 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accf6d8-fc6f-4649-b39f-9c924e53dade None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:58.213395 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accf6d8-fc6f-4649-b39f-9c924e53dade None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:58.213672 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accf6d8-fc6f-4649-b39f-9c924e53dade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:58.220180 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2293805-4eab-4829-8548-92795b6150e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:58.220970 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2293805-4eab-4829-8548-92795b6150e2 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:58.221251 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2293805-4eab-4829-8548-92795b6150e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:58.221518 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2293805-4eab-4829-8548-92795b6150e2 None admin] PATH_INFO: `/v3/users/e84fbaf6d66b40f8b781837929bba502` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:58.230496 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-1accf6d8-fc6f-4649-b39f-9c924e53dade None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:58.231869 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-1accf6d8-fc6f-4649-b39f-9c924e53dade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:58.234147 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2293805-4eab-4829-8548-92795b6150e2 None admin] RBAC: Authorizing `identity:get_user(user_id=e84fbaf6d66b40f8b781837929bba502)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:58.235608 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2293805-4eab-4829-8548-92795b6150e2 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:58.237288 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 122/250] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:55:58 2022] GET /identity/v3/users/e84fbaf6d66b40f8b781837929bba502 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:58.238034 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2293805-4eab-4829-8548-92795b6150e2 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:58.300162 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 129/251] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:55:58.300994 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accf6d8-fc6f-4649-b39f-9c924e53dade None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:58.347028 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2293805-4eab-4829-8548-92795b6150e2 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:58.398714 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accf6d8-fc6f-4649-b39f-9c924e53dade None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:58.433478 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff21d2-badd-40e7-90b1-d5aa0ad991f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:58.434371 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff21d2-badd-40e7-90b1-d5aa0ad991f3 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:58.434655 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff21d2-badd-40e7-90b1-d5aa0ad991f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:58.434929 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff21d2-badd-40e7-90b1-d5aa0ad991f3 None admin] PATH_INFO: `/v3/users/4d79bbec2ba94fcf9ef2b8d988da76b1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:58.436204 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff21d2-badd-40e7-90b1-d5aa0ad991f3 None admin] RBAC: Authorizing `identity:get_user(user_id=4d79bbec2ba94fcf9ef2b8d988da76b1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:58.437686 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff21d2-badd-40e7-90b1-d5aa0ad991f3 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:58.439564 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 130/252] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:55:58 2022] GET /identity/v3/users/4d79bbec2ba94fcf9ef2b8d988da76b1 => generated 297 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:58.441702 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff21d2-badd-40e7-90b1-d5aa0ad991f3 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:58.497161 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329abd9-eb3d-41ad-80e3-64b876c8c853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:58.497935 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329abd9-eb3d-41ad-80e3-64b876c8c853 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:58.498211 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329abd9-eb3d-41ad-80e3-64b876c8c853 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:58.498484 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329abd9-eb3d-41ad-80e3-64b876c8c853 None admin] PATH_INFO: `/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:58.499647 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d329abd9-eb3d-41ad-80e3-64b876c8c853 None admin] RBAC: Authorizing `identity:get_project(project_id=fdcba3bc2cf94d4683c633c879cc7d25)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:58.501112 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d329abd9-eb3d-41ad-80e3-64b876c8c853 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:58.502792 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 123/253] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:55:58 2022] GET /identity/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:58.503620 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329abd9-eb3d-41ad-80e3-64b876c8c853 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:58.543841 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff21d2-badd-40e7-90b1-d5aa0ad991f3 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:58.576246 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c76bfc-7a7e-405b-97fe-6709b20c01e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:58.576881 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c76bfc-7a7e-405b-97fe-6709b20c01e5 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:58.577166 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c76bfc-7a7e-405b-97fe-6709b20c01e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:58.577440 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c76bfc-7a7e-405b-97fe-6709b20c01e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:58.600595 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329abd9-eb3d-41ad-80e3-64b876c8c853 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:58.632418 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e7a3e-96a9-4302-b351-550715633eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:58.633196 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e7a3e-96a9-4302-b351-550715633eee None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:58.633478 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e7a3e-96a9-4302-b351-550715633eee None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:58.633753 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e7a3e-96a9-4302-b351-550715633eee None admin] PATH_INFO: `/v3/domains/default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:58.634903 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e7a3e-96a9-4302-b351-550715633eee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:58.636369 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e7a3e-96a9-4302-b351-550715633eee None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:58.637958 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 124/254] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:55:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:58.638709 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e7a3e-96a9-4302-b351-550715633eee None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:58.639281 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c76bfc-7a7e-405b-97fe-6709b20c01e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:58.640769 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c76bfc-7a7e-405b-97fe-6709b20c01e5 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:58.732186 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 131/255] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:55:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:55:58.733290 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e7a3e-96a9-4302-b351-550715633eee None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:58.733464 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1752ecf-6b35-4fd8-a534-0ef165f5a0b9 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:58.733754 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1752ecf-6b35-4fd8-a534-0ef165f5a0b9 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:58.734030 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1752ecf-6b35-4fd8-a534-0ef165f5a0b9 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:58.735722 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 132/256] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:55:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:55:58.740517 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1752ecf-6b35-4fd8-a534-0ef165f5a0b9 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:58.765887 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd604585-7737-4bca-8a73-657c9bd172f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:58.766675 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd604585-7737-4bca-8a73-657c9bd172f3 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:58.766953 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd604585-7737-4bca-8a73-657c9bd172f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:58.767225 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd604585-7737-4bca-8a73-657c9bd172f3 None admin] PATH_INFO: `/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:58.768420 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd604585-7737-4bca-8a73-657c9bd172f3 None admin] RBAC: Authorizing `identity:get_project(project_id=fdcba3bc2cf94d4683c633c879cc7d25)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:58.769878 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd604585-7737-4bca-8a73-657c9bd172f3 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:58.771583 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 125/257] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:55:58 2022] GET /identity/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25 => generated 302 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:58.772342 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd604585-7737-4bca-8a73-657c9bd172f3 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:58.833243 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1752ecf-6b35-4fd8-a534-0ef165f5a0b9 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:58.865767 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21df86-2313-4423-b079-c62355713475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:58.866410 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21df86-2313-4423-b079-c62355713475 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:58.866687 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21df86-2313-4423-b079-c62355713475 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:58.866959 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21df86-2313-4423-b079-c62355713475 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:58.867798 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21df86-2313-4423-b079-c62355713475 None admin] RBAC: Adding query filter params (role.id=a8b2a5887cec4a31b7304792af3dd3f1, scope.project.id=fdcba3bc2cf94d4683c633c879cc7d25, user.id=cde4d31ddb254c7397e53e0ea9e03da0) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:58.868104 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21df86-2313-4423-b079-c62355713475 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:58.869538 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21df86-2313-4423-b079-c62355713475 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:58.871425 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd604585-7737-4bca-8a73-657c9bd172f3 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:58.874996 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 133/258] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:55:58 2022] GET /identity/v3/role_assignments?user.id=cde4d31ddb254c7397e53e0ea9e03da0&scope.project.id=fdcba3bc2cf94d4683c633c879cc7d25&role.id=a8b2a5887cec4a31b7304792af3dd3f1 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:58.875875 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21df86-2313-4423-b079-c62355713475 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:58.907670 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823a168-f5a0-4323-ab2d-a6c082cde80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:58.908414 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823a168-f5a0-4323-ab2d-a6c082cde80a None admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:58.908700 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823a168-f5a0-4323-ab2d-a6c082cde80a None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:58.908977 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823a168-f5a0-4323-ab2d-a6c082cde80a None admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:58.909712 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5823a168-f5a0-4323-ab2d-a6c082cde80a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:58.911729 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5823a168-f5a0-4323-ab2d-a6c082cde80a None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:58.932285 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 126/259] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Mar 10 03:55:58 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 03:55:58.937468 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d90064-68e2-4895-aae9-f5a304910505 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:58.938149 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d90064-68e2-4895-aae9-f5a304910505 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:58.938628 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d90064-68e2-4895-aae9-f5a304910505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:58.960057 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-d3d90064-68e2-4895-aae9-f5a304910505 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:55:58.961851 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-d3d90064-68e2-4895-aae9-f5a304910505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:55:58.986478 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21df86-2313-4423-b079-c62355713475 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:59.024584 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bf554-18ba-425b-a15a-d86b192f05fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:59.025384 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bf554-18ba-425b-a15a-d86b192f05fe None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:59.025661 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bf554-18ba-425b-a15a-d86b192f05fe None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:59.025936 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bf554-18ba-425b-a15a-d86b192f05fe None admin] PATH_INFO: `/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:59.027294 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16bf554-18ba-425b-a15a-d86b192f05fe None admin] RBAC: Authorizing `identity:get_project(project_id=fdcba3bc2cf94d4683c633c879cc7d25)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:59.029294 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16bf554-18ba-425b-a15a-d86b192f05fe None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:59.036702 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 134/260] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:55:58 2022] GET /identity/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:59.038074 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bf554-18ba-425b-a15a-d86b192f05fe None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:59.047150 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 127/261] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:55:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:55:59.048923 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d90064-68e2-4895-aae9-f5a304910505 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:59.158029 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bf554-18ba-425b-a15a-d86b192f05fe None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:59.178062 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d90064-68e2-4895-aae9-f5a304910505 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:59.196280 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ff262-d7ae-42cd-aac1-aeadc3cec8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:59.197141 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ff262-d7ae-42cd-aac1-aeadc3cec8f4 None admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:59.197425 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ff262-d7ae-42cd-aac1-aeadc3cec8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:59.197690 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ff262-d7ae-42cd-aac1-aeadc3cec8f4 None admin] PATH_INFO: `/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25/users/4d79bbec2ba94fcf9ef2b8d988da76b1/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:59.199644 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ff262-d7ae-42cd-aac1-aeadc3cec8f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=fdcba3bc2cf94d4683c633c879cc7d25, user_id=4d79bbec2ba94fcf9ef2b8d988da76b1, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:59.201387 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ff262-d7ae-42cd-aac1-aeadc3cec8f4 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:59.215964 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769823fb-7e62-4c50-8a05-47629fc48ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:59.216623 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769823fb-7e62-4c50-8a05-47629fc48ccd None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:59.216906 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769823fb-7e62-4c50-8a05-47629fc48ccd None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:59.217084 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 135/262] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Mar 10 03:55:59 2022] PUT /identity/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25/users/4d79bbec2ba94fcf9ef2b8d988da76b1/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 03:55:59.217498 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769823fb-7e62-4c50-8a05-47629fc48ccd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:59.217900 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ff262-d7ae-42cd-aac1-aeadc3cec8f4 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:59.218410 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769823fb-7e62-4c50-8a05-47629fc48ccd None admin] RBAC: Adding query filter params (role.id=5daf615f445643608474ea1432d21e42, scope.project.id=fdcba3bc2cf94d4683c633c879cc7d25, user.id=e84fbaf6d66b40f8b781837929bba502) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:59.218719 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769823fb-7e62-4c50-8a05-47629fc48ccd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:59.220251 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769823fb-7e62-4c50-8a05-47629fc48ccd None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:59.226438 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 128/263] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:55:59 2022] GET /identity/v3/role_assignments?user.id=e84fbaf6d66b40f8b781837929bba502&scope.project.id=fdcba3bc2cf94d4683c633c879cc7d25&role.id=5daf615f445643608474ea1432d21e42 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:59.335600 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ff262-d7ae-42cd-aac1-aeadc3cec8f4 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:59.375411 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008b450-bf7d-4d6e-9689-21b7d82e3f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:59.376300 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008b450-bf7d-4d6e-9689-21b7d82e3f04 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:59.376599 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008b450-bf7d-4d6e-9689-21b7d82e3f04 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:59.376866 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008b450-bf7d-4d6e-9689-21b7d82e3f04 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:59.389665 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008b450-bf7d-4d6e-9689-21b7d82e3f04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:55:59.397497 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-f008b450-bf7d-4d6e-9689-21b7d82e3f04 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 10 03:55:59.399122 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 136/264] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Mar 10 03:55:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:55:59.405137 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769823fb-7e62-4c50-8a05-47629fc48ccd None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:59.513694 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769823fb-7e62-4c50-8a05-47629fc48ccd None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:59.549385 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7eecb-8cea-4bc7-8ec6-f09e35e48f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:59.550347 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7eecb-8cea-4bc7-8ec6-f09e35e48f2c None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:59.550840 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7eecb-8cea-4bc7-8ec6-f09e35e48f2c None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:59.551288 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7eecb-8cea-4bc7-8ec6-f09e35e48f2c None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:59.552893 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b7eecb-8cea-4bc7-8ec6-f09e35e48f2c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:55:59.553415 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b7eecb-8cea-4bc7-8ec6-f09e35e48f2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:59.554962 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b7eecb-8cea-4bc7-8ec6-f09e35e48f2c None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:59.563729 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 129/265] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:55:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:59.569778 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008b450-bf7d-4d6e-9689-21b7d82e3f04 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:59.671750 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008b450-bf7d-4d6e-9689-21b7d82e3f04 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:59.705586 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027af96-16fe-4fbc-aa59-ac81806a6f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:59.706734 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027af96-16fe-4fbc-aa59-ac81806a6f99 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:59.707189 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027af96-16fe-4fbc-aa59-ac81806a6f99 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:59.707634 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027af96-16fe-4fbc-aa59-ac81806a6f99 None admin] PATH_INFO: `/v3/users/cde4d31ddb254c7397e53e0ea9e03da0` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:59.709566 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2027af96-16fe-4fbc-aa59-ac81806a6f99 None admin] RBAC: Authorizing `identity:get_user(user_id=cde4d31ddb254c7397e53e0ea9e03da0)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:59.711179 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2027af96-16fe-4fbc-aa59-ac81806a6f99 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:55:59.713299 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 137/266] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:55:59 2022] GET /identity/v3/users/cde4d31ddb254c7397e53e0ea9e03da0 => generated 283 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:55:59.718825 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7eecb-8cea-4bc7-8ec6-f09e35e48f2c None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:55:59.844840 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7eecb-8cea-4bc7-8ec6-f09e35e48f2c None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:55:59.888320 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3eaca-4c86-4c2e-a225-cdddc97f8ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:55:59.889303 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3eaca-4c86-4c2e-a225-cdddc97f8ff4 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:55:59.889763 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3eaca-4c86-4c2e-a225-cdddc97f8ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:55:59.890212 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3eaca-4c86-4c2e-a225-cdddc97f8ff4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:55:59.970811 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3eaca-4c86-4c2e-a225-cdddc97f8ff4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:55:59.972563 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3eaca-4c86-4c2e-a225-cdddc97f8ff4 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:00.104705 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 130/267] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:55:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:56:00.111281 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027af96-16fe-4fbc-aa59-ac81806a6f99 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:00.239321 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027af96-16fe-4fbc-aa59-ac81806a6f99 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:00.273536 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e88b10-87c3-436a-aad7-520ef974ae19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:00.274769 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e88b10-87c3-436a-aad7-520ef974ae19 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:00.275261 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e88b10-87c3-436a-aad7-520ef974ae19 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:00.275764 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e88b10-87c3-436a-aad7-520ef974ae19 None admin] PATH_INFO: `/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:00.277182 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e88b10-87c3-436a-aad7-520ef974ae19 None admin] RBAC: Authorizing `identity:get_project(project_id=fdcba3bc2cf94d4683c633c879cc7d25)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:00.278844 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e88b10-87c3-436a-aad7-520ef974ae19 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:00.281064 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 138/268] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:56:00 2022] GET /identity/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:00.286968 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3eaca-4c86-4c2e-a225-cdddc97f8ff4 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:00.405871 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3eaca-4c86-4c2e-a225-cdddc97f8ff4 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:00.450265 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4b87d-2783-495e-8480-2353b27ef671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:00.451305 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4b87d-2783-495e-8480-2353b27ef671 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:00.451988 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4b87d-2783-495e-8480-2353b27ef671 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:00.452538 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4b87d-2783-495e-8480-2353b27ef671 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:00.453587 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf4b87d-2783-495e-8480-2353b27ef671 None admin] RBAC: Adding query filter params (role.id=c38b04db9cd34eeaaaa8d2a6425c05ad, scope.project.id=fdcba3bc2cf94d4683c633c879cc7d25, user.id=cde4d31ddb254c7397e53e0ea9e03da0) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:00.454093 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf4b87d-2783-495e-8480-2353b27ef671 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:00.455755 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf4b87d-2783-495e-8480-2353b27ef671 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:00.462135 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 131/269] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:56:00 2022] GET /identity/v3/role_assignments?user.id=cde4d31ddb254c7397e53e0ea9e03da0&scope.project.id=fdcba3bc2cf94d4683c633c879cc7d25&role.id=c38b04db9cd34eeaaaa8d2a6425c05ad => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:01.799555 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe2a04-b605-410f-9bea-b6d78a45c6a2 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:01.800086 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe2a04-b605-410f-9bea-b6d78a45c6a2 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:01.800159 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe2a04-b605-410f-9bea-b6d78a45c6a2 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:01.802217 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 139/270] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:01.807816 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e7131-e4bc-4e70-821d-c1519d2f57db None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:01.808246 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e7131-e4bc-4e70-821d-c1519d2f57db None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:01.808411 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e7131-e4bc-4e70-821d-c1519d2f57db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:01.810839 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524c794-3162-49f5-96bc-4b696e5cd078 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:01.811238 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524c794-3162-49f5-96bc-4b696e5cd078 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:01.811524 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524c794-3162-49f5-96bc-4b696e5cd078 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:01.813687 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 140/271] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 03:56:01.819471 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef7581-bbd6-4b8a-a665-4e030ce3c016 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:01.819796 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef7581-bbd6-4b8a-a665-4e030ce3c016 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:01.820083 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef7581-bbd6-4b8a-a665-4e030ce3c016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:01.827597 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-320e7131-e4bc-4e70-821d-c1519d2f57db None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:01.828833 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-320e7131-e4bc-4e70-821d-c1519d2f57db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:01.837372 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-6fef7581-bbd6-4b8a-a665-4e030ce3c016 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:01.838539 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-6fef7581-bbd6-4b8a-a665-4e030ce3c016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:01.894806 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 132/272] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:01.896527 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261cc6f-3c48-4a96-8ff4-62bbb8a8be40 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:01.896816 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261cc6f-3c48-4a96-8ff4-62bbb8a8be40 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:01.897093 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261cc6f-3c48-4a96-8ff4-62bbb8a8be40 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:01.898759 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 133/273] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:01.903910 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358b8a5-0c15-487f-a649-3c1fc542da4d None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:01.904200 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358b8a5-0c15-487f-a649-3c1fc542da4d None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:01.904482 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358b8a5-0c15-487f-a649-3c1fc542da4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:01.911788 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 141/274] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 03:56:01.919710 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef7581-bbd6-4b8a-a665-4e030ce3c016 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:01.927053 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-4358b8a5-0c15-487f-a649-3c1fc542da4d None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:01.928270 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-4358b8a5-0c15-487f-a649-3c1fc542da4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:01.994702 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 134/275] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 03:56:01.995565 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358b8a5-0c15-487f-a649-3c1fc542da4d None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:02.025667 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef7581-bbd6-4b8a-a665-4e030ce3c016 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:02.058818 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ca4f6-0a1f-4c70-a621-be1c088b4b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:02.059535 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ca4f6-0a1f-4c70-a621-be1c088b4b57 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:02.060110 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ca4f6-0a1f-4c70-a621-be1c088b4b57 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:02.060110 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ca4f6-0a1f-4c70-a621-be1c088b4b57 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:02.075582 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ca4f6-0a1f-4c70-a621-be1c088b4b57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:02.082712 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-067ca4f6-0a1f-4c70-a621-be1c088b4b57 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 10 03:56:02.083953 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 142/276] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:56:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:56:02.086052 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ca4f6-0a1f-4c70-a621-be1c088b4b57 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:02.101684 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358b8a5-0c15-487f-a649-3c1fc542da4d None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:02.140863 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297113a0-1f07-465d-b0ed-28cc49de30c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:02.142059 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297113a0-1f07-465d-b0ed-28cc49de30c2 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:02.142519 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297113a0-1f07-465d-b0ed-28cc49de30c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:02.143005 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297113a0-1f07-465d-b0ed-28cc49de30c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:02.144735 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297113a0-1f07-465d-b0ed-28cc49de30c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:02.147231 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297113a0-1f07-465d-b0ed-28cc49de30c2 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:02.154168 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 135/277] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:02.154168 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297113a0-1f07-465d-b0ed-28cc49de30c2 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:02.197448 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ca4f6-0a1f-4c70-a621-be1c088b4b57 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:02.227593 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09b5ee-93c1-4fec-8375-a96f688a2257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:02.228389 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09b5ee-93c1-4fec-8375-a96f688a2257 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:02.228669 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09b5ee-93c1-4fec-8375-a96f688a2257 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:02.228938 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09b5ee-93c1-4fec-8375-a96f688a2257 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:02.238363 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09b5ee-93c1-4fec-8375-a96f688a2257 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:02.245869 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-9c09b5ee-93c1-4fec-8375-a96f688a2257 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 03:56:02.247050 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 143/278] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:56:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:02.248696 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fcfa0d-b7a1-4063-b003-ae844ade998d None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:02.248979 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fcfa0d-b7a1-4063-b003-ae844ade998d None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:02.249257 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fcfa0d-b7a1-4063-b003-ae844ade998d None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:02.250919 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 144/279] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:02.251992 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fcfa0d-b7a1-4063-b003-ae844ade998d None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:02.257868 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297113a0-1f07-465d-b0ed-28cc49de30c2 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:02.289610 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17cfb24-37f0-458c-9d74-883bceba6951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:02.290266 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cfb24-37f0-458c-9d74-883bceba6951 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:02.290549 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cfb24-37f0-458c-9d74-883bceba6951 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:02.290826 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cfb24-37f0-458c-9d74-883bceba6951 None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:02.291570 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17cfb24-37f0-458c-9d74-883bceba6951 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:02.291905 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17cfb24-37f0-458c-9d74-883bceba6951 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:02.293276 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17cfb24-37f0-458c-9d74-883bceba6951 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:02.301119 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 136/280] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Mar 10 03:56:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:02.302432 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17cfb24-37f0-458c-9d74-883bceba6951 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:02.346828 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fcfa0d-b7a1-4063-b003-ae844ade998d None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:02.378067 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca7538-5f0e-41ab-95b6-401072028b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:02.378726 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca7538-5f0e-41ab-95b6-401072028b1b None admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:02.379007 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca7538-5f0e-41ab-95b6-401072028b1b None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:02.379282 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca7538-5f0e-41ab-95b6-401072028b1b None admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:02.380043 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca7538-5f0e-41ab-95b6-401072028b1b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:02.381488 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca7538-5f0e-41ab-95b6-401072028b1b None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:02.394326 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17cfb24-37f0-458c-9d74-883bceba6951 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:02.400212 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 145/281] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Mar 10 03:56:02 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 03:56:02.401441 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5becc0-8f90-479c-a9fc-51c21d1b6fe2 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:02.401730 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5becc0-8f90-479c-a9fc-51c21d1b6fe2 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:02.402000 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5becc0-8f90-479c-a9fc-51c21d1b6fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:02.419460 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-af5becc0-8f90-479c-a9fc-51c21d1b6fe2 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:02.420754 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-af5becc0-8f90-479c-a9fc-51c21d1b6fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:02.441854 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c999e-65dd-4d27-8c7d-e0277081baa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:02.442748 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c999e-65dd-4d27-8c7d-e0277081baa7 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:02.443031 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c999e-65dd-4d27-8c7d-e0277081baa7 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:02.443558 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c999e-65dd-4d27-8c7d-e0277081baa7 None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:02.444363 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c999e-65dd-4d27-8c7d-e0277081baa7 None admin] RBAC: Adding query filter params (name=member) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:02.444669 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c999e-65dd-4d27-8c7d-e0277081baa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:02.446072 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c999e-65dd-4d27-8c7d-e0277081baa7 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:02.459339 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 137/282] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Mar 10 03:56:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:02.459339 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c999e-65dd-4d27-8c7d-e0277081baa7 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:02.495731 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 146/283] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:02.496648 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5becc0-8f90-479c-a9fc-51c21d1b6fe2 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:02.570109 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c999e-65dd-4d27-8c7d-e0277081baa7 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:02.602684 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5becc0-8f90-479c-a9fc-51c21d1b6fe2 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:02.607282 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5192c-2978-4d45-b9f4-a685c0fa8c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:02.608261 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5192c-2978-4d45-b9f4-a685c0fa8c4b None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:02.608545 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5192c-2978-4d45-b9f4-a685c0fa8c4b None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:02.608824 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5192c-2978-4d45-b9f4-a685c0fa8c4b None admin] PATH_INFO: `/v3/users/e84fbaf6d66b40f8b781837929bba502` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:02.610029 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5192c-2978-4d45-b9f4-a685c0fa8c4b None admin] RBAC: Authorizing `identity:get_user(user_id=e84fbaf6d66b40f8b781837929bba502)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:02.611476 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5192c-2978-4d45-b9f4-a685c0fa8c4b None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:02.613160 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 138/284] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:56:02 2022] GET /identity/v3/users/e84fbaf6d66b40f8b781837929bba502 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:02.613959 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5192c-2978-4d45-b9f4-a685c0fa8c4b None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:02.637418 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bdba0-fd20-4587-925b-599046f5cd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:02.638303 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bdba0-fd20-4587-925b-599046f5cd84 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:02.638579 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bdba0-fd20-4587-925b-599046f5cd84 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:02.638852 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bdba0-fd20-4587-925b-599046f5cd84 None admin] PATH_INFO: `/v3/users/324edde91cc04fb78de41b8afb513e41` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:02.654552 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7bdba0-fd20-4587-925b-599046f5cd84 None admin] RBAC: Authorizing `identity:get_user(user_id=324edde91cc04fb78de41b8afb513e41)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:02.656408 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7bdba0-fd20-4587-925b-599046f5cd84 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:02.658339 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 147/285] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:56:02 2022] GET /identity/v3/users/324edde91cc04fb78de41b8afb513e41 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:02.661490 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bdba0-fd20-4587-925b-599046f5cd84 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:02.742906 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5192c-2978-4d45-b9f4-a685c0fa8c4b None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:02.758199 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bdba0-fd20-4587-925b-599046f5cd84 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:02.791959 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140dd5b-3922-4c1e-9053-1bdef52ed160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:02.792775 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140dd5b-3922-4c1e-9053-1bdef52ed160 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:02.793058 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140dd5b-3922-4c1e-9053-1bdef52ed160 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:02.793334 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140dd5b-3922-4c1e-9053-1bdef52ed160 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:02.795741 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb97e1-5f79-4d69-bad3-896cb13a84ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:02.796943 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb97e1-5f79-4d69-bad3-896cb13a84ad None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:02.797225 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb97e1-5f79-4d69-bad3-896cb13a84ad None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:02.797501 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb97e1-5f79-4d69-bad3-896cb13a84ad None admin] PATH_INFO: `/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:02.798953 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb97e1-5f79-4d69-bad3-896cb13a84ad None admin] RBAC: Authorizing `identity:get_project(project_id=fdcba3bc2cf94d4683c633c879cc7d25)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:02.800576 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eb97e1-5f79-4d69-bad3-896cb13a84ad None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:02.803011 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 148/286] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:56:02 2022] GET /identity/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:02.803745 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140dd5b-3922-4c1e-9053-1bdef52ed160 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:02.804024 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb97e1-5f79-4d69-bad3-896cb13a84ad None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:02.810855 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-a140dd5b-3922-4c1e-9053-1bdef52ed160 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 03:56:02.812432 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 139/287] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:56:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:02.813209 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140dd5b-3922-4c1e-9053-1bdef52ed160 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:02.901514 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb97e1-5f79-4d69-bad3-896cb13a84ad None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:02.917577 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140dd5b-3922-4c1e-9053-1bdef52ed160 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:02.935300 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f01c47-e759-4332-8538-540d5322dbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:02.936018 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f01c47-e759-4332-8538-540d5322dbbb None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:02.936304 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f01c47-e759-4332-8538-540d5322dbbb None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:02.936577 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f01c47-e759-4332-8538-540d5322dbbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:02.937398 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f01c47-e759-4332-8538-540d5322dbbb None admin] RBAC: Adding query filter params (role.id=73b2aee45a2d4be19addaf4a33414295, user.id=324edde91cc04fb78de41b8afb513e41, scope.system=all) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:02.937703 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f01c47-e759-4332-8538-540d5322dbbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:02.939141 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f01c47-e759-4332-8538-540d5322dbbb None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:02.944791 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 149/288] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Mar 10 03:56:02 2022] GET /identity/v3/role_assignments?user.id=324edde91cc04fb78de41b8afb513e41&scope.system=all&role.id=73b2aee45a2d4be19addaf4a33414295 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:02.945609 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f01c47-e759-4332-8538-540d5322dbbb None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:02.963297 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bebf98-2f63-4f30-b725-a601e1c83ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:02.964273 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bebf98-2f63-4f30-b725-a601e1c83ccb None admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:02.964551 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bebf98-2f63-4f30-b725-a601e1c83ccb None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:02.964824 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bebf98-2f63-4f30-b725-a601e1c83ccb None admin] PATH_INFO: `/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25/users/e84fbaf6d66b40f8b781837929bba502/roles/5daf615f445643608474ea1432d21e42` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:02.966956 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bebf98-2f63-4f30-b725-a601e1c83ccb None admin] RBAC: Authorizing `identity:create_grant(project_id=fdcba3bc2cf94d4683c633c879cc7d25, user_id=e84fbaf6d66b40f8b781837929bba502, role_id=5daf615f445643608474ea1432d21e42)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:02.968481 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bebf98-2f63-4f30-b725-a601e1c83ccb None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:02.996424 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 140/289] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Mar 10 03:56:02 2022] PUT /identity/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25/users/e84fbaf6d66b40f8b781837929bba502/roles/5daf615f445643608474ea1432d21e42 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 03:56:03.086954 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f01c47-e759-4332-8538-540d5322dbbb None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:03.124721 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a3c18-9911-4a58-983a-5a5309c64a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:03.125408 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a3c18-9911-4a58-983a-5a5309c64a56 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:03.125750 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a3c18-9911-4a58-983a-5a5309c64a56 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:03.126030 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a3c18-9911-4a58-983a-5a5309c64a56 None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:03.126788 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a3c18-9911-4a58-983a-5a5309c64a56 None admin] RBAC: Adding query filter params (name=member) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:03.127088 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a3c18-9911-4a58-983a-5a5309c64a56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:03.128498 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a3c18-9911-4a58-983a-5a5309c64a56 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:03.138592 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 150/290] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Mar 10 03:56:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:03.144296 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bebf98-2f63-4f30-b725-a601e1c83ccb None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:03.278173 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bebf98-2f63-4f30-b725-a601e1c83ccb None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:03.315164 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656d832-d07f-44cb-b39d-d5e79a328983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:03.316078 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656d832-d07f-44cb-b39d-d5e79a328983 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:03.316360 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656d832-d07f-44cb-b39d-d5e79a328983 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:03.316635 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656d832-d07f-44cb-b39d-d5e79a328983 None admin] PATH_INFO: `/v3/users/4d79bbec2ba94fcf9ef2b8d988da76b1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:03.318654 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656d832-d07f-44cb-b39d-d5e79a328983 None admin] RBAC: Authorizing `identity:get_user(user_id=4d79bbec2ba94fcf9ef2b8d988da76b1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:03.320258 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656d832-d07f-44cb-b39d-d5e79a328983 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:03.322214 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 141/291] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:56:03 2022] GET /identity/v3/users/4d79bbec2ba94fcf9ef2b8d988da76b1 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:56:03.327277 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a3c18-9911-4a58-983a-5a5309c64a56 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:03.442063 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a3c18-9911-4a58-983a-5a5309c64a56 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:03.479173 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27268d2a-5901-4c11-b27a-2782fa7b7de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:03.479864 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27268d2a-5901-4c11-b27a-2782fa7b7de2 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:03.480146 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27268d2a-5901-4c11-b27a-2782fa7b7de2 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:03.480424 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27268d2a-5901-4c11-b27a-2782fa7b7de2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:03.546418 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27268d2a-5901-4c11-b27a-2782fa7b7de2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:03.547966 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27268d2a-5901-4c11-b27a-2782fa7b7de2 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:03.649225 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 151/292] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:56:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 10 03:56:03.654300 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656d832-d07f-44cb-b39d-d5e79a328983 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:03.778919 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656d832-d07f-44cb-b39d-d5e79a328983 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:03.823853 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039ced6-bb70-43b1-b899-548668a00417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:03.824699 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039ced6-bb70-43b1-b899-548668a00417 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:03.824986 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039ced6-bb70-43b1-b899-548668a00417 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:03.825264 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039ced6-bb70-43b1-b899-548668a00417 None admin] PATH_INFO: `/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:03.832402 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039ced6-bb70-43b1-b899-548668a00417 None admin] RBAC: Authorizing `identity:get_project(project_id=fdcba3bc2cf94d4683c633c879cc7d25)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:03.833893 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039ced6-bb70-43b1-b899-548668a00417 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:03.835701 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 142/293] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:56:03 2022] GET /identity/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:03.841475 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27268d2a-5901-4c11-b27a-2782fa7b7de2 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:03.945504 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27268d2a-5901-4c11-b27a-2782fa7b7de2 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:03.985856 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ede45e-66ff-40d7-8006-549c8de34df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:03.986523 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ede45e-66ff-40d7-8006-549c8de34df7 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:03.986806 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ede45e-66ff-40d7-8006-549c8de34df7 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:03.987081 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ede45e-66ff-40d7-8006-549c8de34df7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:03.987941 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ede45e-66ff-40d7-8006-549c8de34df7 None admin] RBAC: Adding query filter params (role.id=73b2aee45a2d4be19addaf4a33414295, scope.project.id=fdcba3bc2cf94d4683c633c879cc7d25, user.id=4d79bbec2ba94fcf9ef2b8d988da76b1) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:03.988251 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ede45e-66ff-40d7-8006-549c8de34df7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:03.990264 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ede45e-66ff-40d7-8006-549c8de34df7 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:03.996500 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 152/294] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:56:03 2022] GET /identity/v3/role_assignments?user.id=4d79bbec2ba94fcf9ef2b8d988da76b1&scope.project.id=fdcba3bc2cf94d4683c633c879cc7d25&role.id=73b2aee45a2d4be19addaf4a33414295 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:05.194083 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b6342-6de8-426c-ae29-a01db55c042d None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:05.194583 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b6342-6de8-426c-ae29-a01db55c042d None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:05.194656 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b6342-6de8-426c-ae29-a01db55c042d None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:05.196800 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 143/295] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:05.201970 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1f29f-6bd7-405b-a144-317677f4af0f None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:05.202364 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1f29f-6bd7-405b-a144-317677f4af0f None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:05.202527 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1f29f-6bd7-405b-a144-317677f4af0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:05.220197 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-b3c1f29f-6bd7-405b-a144-317677f4af0f None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:05.221366 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-b3c1f29f-6bd7-405b-a144-317677f4af0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:05.232197 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14832df2-cc8a-4b0f-ba60-662511e7d94c None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:05.232483 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14832df2-cc8a-4b0f-ba60-662511e7d94c None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:05.232758 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14832df2-cc8a-4b0f-ba60-662511e7d94c None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:05.234761 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 144/296] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:05.240237 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b857cf2-416d-4443-803a-ae929800e5a3 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:05.240523 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b857cf2-416d-4443-803a-ae929800e5a3 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:05.240804 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b857cf2-416d-4443-803a-ae929800e5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:05.260606 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-0b857cf2-416d-4443-803a-ae929800e5a3 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:05.261793 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-0b857cf2-416d-4443-803a-ae929800e5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:05.298831 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 153/297] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:05.323100 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1f29f-6bd7-405b-a144-317677f4af0f None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:05.333727 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 145/298] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 03:56:05.359007 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b857cf2-416d-4443-803a-ae929800e5a3 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:05.424006 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1f29f-6bd7-405b-a144-317677f4af0f None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:05.461298 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184c399-8645-46d2-883d-690077a550b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:05.462468 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184c399-8645-46d2-883d-690077a550b5 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:05.462964 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184c399-8645-46d2-883d-690077a550b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:05.463257 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b857cf2-416d-4443-803a-ae929800e5a3 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:05.463651 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184c399-8645-46d2-883d-690077a550b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:05.465141 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184c399-8645-46d2-883d-690077a550b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:05.466800 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184c399-8645-46d2-883d-690077a550b5 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:05.473832 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 154/299] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:56:05.475226 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184c399-8645-46d2-883d-690077a550b5 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:05.498760 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18bfc86-2e26-478b-b339-abd1461261b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:05.499563 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bfc86-2e26-478b-b339-abd1461261b1 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:05.499877 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bfc86-2e26-478b-b339-abd1461261b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:05.500154 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bfc86-2e26-478b-b339-abd1461261b1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:05.510590 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18bfc86-2e26-478b-b339-abd1461261b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:05.517600 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-c18bfc86-2e26-478b-b339-abd1461261b1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 10 03:56:05.518919 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 146/300] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:56:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:56:05.525128 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0fa64-988c-4537-884e-174946a6dee0 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:05.525128 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0fa64-988c-4537-884e-174946a6dee0 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:05.525128 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0fa64-988c-4537-884e-174946a6dee0 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:05.525128 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 147/301] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:05.526595 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0fa64-988c-4537-884e-174946a6dee0 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:05.572221 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184c399-8645-46d2-883d-690077a550b5 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:05.605187 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22313da1-de65-456c-b2ff-7efd9571039e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:05.605840 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22313da1-de65-456c-b2ff-7efd9571039e None admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:05.606117 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22313da1-de65-456c-b2ff-7efd9571039e None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:05.606389 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22313da1-de65-456c-b2ff-7efd9571039e None admin] PATH_INFO: `/v3/groups` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:05.607063 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22313da1-de65-456c-b2ff-7efd9571039e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:05.608599 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22313da1-de65-456c-b2ff-7efd9571039e None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:05.626884 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0fa64-988c-4537-884e-174946a6dee0 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:05.627045 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 155/302] 10.222.0.15 () {60 vars in 1134 bytes} [Thu Mar 10 03:56:05 2022] POST /identity/v3/groups => generated 229 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 03:56:05.628405 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce301d58-a884-4909-9f25-5532683a684e None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:05.628692 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce301d58-a884-4909-9f25-5532683a684e None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:05.628959 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce301d58-a884-4909-9f25-5532683a684e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:05.653320 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-ce301d58-a884-4909-9f25-5532683a684e None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:05.654868 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-ce301d58-a884-4909-9f25-5532683a684e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:05.666614 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c9cbf-3cca-44a1-af5f-2e2fca481d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:05.667389 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c9cbf-3cca-44a1-af5f-2e2fca481d8c None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:05.667817 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c9cbf-3cca-44a1-af5f-2e2fca481d8c None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:05.668127 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c9cbf-3cca-44a1-af5f-2e2fca481d8c None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:05.668903 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c9cbf-3cca-44a1-af5f-2e2fca481d8c None admin] RBAC: Adding query filter params (name=reader) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:05.669261 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c9cbf-3cca-44a1-af5f-2e2fca481d8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:05.670682 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c9cbf-3cca-44a1-af5f-2e2fca481d8c None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:05.681452 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 148/303] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Mar 10 03:56:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:05.687283 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c9cbf-3cca-44a1-af5f-2e2fca481d8c None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:05.751441 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 156/304] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:05.768836 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce301d58-a884-4909-9f25-5532683a684e None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:05.825950 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c9cbf-3cca-44a1-af5f-2e2fca481d8c None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:05.862636 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37760721-9478-46e3-a579-c9d1dedc46c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:05.863614 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37760721-9478-46e3-a579-c9d1dedc46c0 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:05.864366 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37760721-9478-46e3-a579-c9d1dedc46c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:05.864656 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37760721-9478-46e3-a579-c9d1dedc46c0 None admin] PATH_INFO: `/v3/users/7670b78bd7f54b51af84f4044769a20a` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:05.878379 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37760721-9478-46e3-a579-c9d1dedc46c0 None admin] RBAC: Authorizing `identity:get_user(user_id=7670b78bd7f54b51af84f4044769a20a)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:05.880050 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37760721-9478-46e3-a579-c9d1dedc46c0 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:05.881761 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 149/305] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:56:05 2022] GET /identity/v3/users/7670b78bd7f54b51af84f4044769a20a => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:05.882995 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfeffa3-78b4-4d14-b683-f687db18abdc None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:05.883284 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfeffa3-78b4-4d14-b683-f687db18abdc None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:05.883565 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfeffa3-78b4-4d14-b683-f687db18abdc None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:05.885235 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 150/306] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:05.886586 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce301d58-a884-4909-9f25-5532683a684e None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:05.889526 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfeffa3-78b4-4d14-b683-f687db18abdc None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:05.919913 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bb38b-9e97-4774-a294-0917ec31967b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:05.920724 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bb38b-9e97-4774-a294-0917ec31967b None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:05.921003 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bb38b-9e97-4774-a294-0917ec31967b None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:05.921273 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bb38b-9e97-4774-a294-0917ec31967b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:05.930895 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169bb38b-9e97-4774-a294-0917ec31967b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:05.937957 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-169bb38b-9e97-4774-a294-0917ec31967b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 03:56:05.939241 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 157/307] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:56:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:56:05.940975 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a13b90-e2e1-4d87-9574-5503ca8de188 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:05.941499 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a13b90-e2e1-4d87-9574-5503ca8de188 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:05.942037 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a13b90-e2e1-4d87-9574-5503ca8de188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:05.959322 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-68a13b90-e2e1-4d87-9574-5503ca8de188 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:05.960548 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-68a13b90-e2e1-4d87-9574-5503ca8de188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:06.002661 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfeffa3-78b4-4d14-b683-f687db18abdc None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:06.024265 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 158/308] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:06.025364 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a13b90-e2e1-4d87-9574-5503ca8de188 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:06.046898 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35cf7bb-9e74-4186-bcb1-c19d3ad248c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:06.048327 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cf7bb-9e74-4186-bcb1-c19d3ad248c3 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:06.048834 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cf7bb-9e74-4186-bcb1-c19d3ad248c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:06.049577 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cf7bb-9e74-4186-bcb1-c19d3ad248c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:06.050763 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35cf7bb-9e74-4186-bcb1-c19d3ad248c3 None admin] RBAC: Adding query filter params (role.id=5daf615f445643608474ea1432d21e42, user.id=7670b78bd7f54b51af84f4044769a20a, scope.system=all) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:06.051631 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35cf7bb-9e74-4186-bcb1-c19d3ad248c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:06.053740 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35cf7bb-9e74-4186-bcb1-c19d3ad248c3 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:06.060348 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 151/309] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Mar 10 03:56:05 2022] GET /identity/v3/role_assignments?user.id=7670b78bd7f54b51af84f4044769a20a&scope.system=all&role.id=5daf615f445643608474ea1432d21e42 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:06.062113 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35cf7bb-9e74-4186-bcb1-c19d3ad248c3 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:06.140583 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a13b90-e2e1-4d87-9574-5503ca8de188 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:06.177622 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84319f-5b77-40cf-8b24-86a60f8d1e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:06.178601 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84319f-5b77-40cf-8b24-86a60f8d1e4a None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:06.179053 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84319f-5b77-40cf-8b24-86a60f8d1e4a None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:06.179496 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84319f-5b77-40cf-8b24-86a60f8d1e4a None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:06.180513 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d84319f-5b77-40cf-8b24-86a60f8d1e4a None admin] RBAC: Adding query filter params (name=member) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:06.181053 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d84319f-5b77-40cf-8b24-86a60f8d1e4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:06.182642 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d84319f-5b77-40cf-8b24-86a60f8d1e4a None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:06.197562 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 159/310] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Mar 10 03:56:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:06.198862 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84319f-5b77-40cf-8b24-86a60f8d1e4a None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:06.205314 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35cf7bb-9e74-4186-bcb1-c19d3ad248c3 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:06.241289 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483cd24-7d57-4f63-9a54-f47695dfbde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:06.242102 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483cd24-7d57-4f63-9a54-f47695dfbde6 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:06.242390 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483cd24-7d57-4f63-9a54-f47695dfbde6 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:06.242667 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483cd24-7d57-4f63-9a54-f47695dfbde6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:06.253360 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483cd24-7d57-4f63-9a54-f47695dfbde6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:06.260973 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-9483cd24-7d57-4f63-9a54-f47695dfbde6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 10 03:56:06.262341 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 152/311] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:56:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:06.268753 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483cd24-7d57-4f63-9a54-f47695dfbde6 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:06.305978 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84319f-5b77-40cf-8b24-86a60f8d1e4a None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:06.339917 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5228d9-56d2-4028-948e-ec7894330844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:06.340822 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5228d9-56d2-4028-948e-ec7894330844 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:06.341102 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5228d9-56d2-4028-948e-ec7894330844 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:06.341377 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5228d9-56d2-4028-948e-ec7894330844 None admin] PATH_INFO: `/v3/users/324edde91cc04fb78de41b8afb513e41` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:06.342582 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5228d9-56d2-4028-948e-ec7894330844 None admin] RBAC: Authorizing `identity:get_user(user_id=324edde91cc04fb78de41b8afb513e41)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:06.344043 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5228d9-56d2-4028-948e-ec7894330844 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:06.345995 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 160/312] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:56:06 2022] GET /identity/v3/users/324edde91cc04fb78de41b8afb513e41 => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:06.352579 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5228d9-56d2-4028-948e-ec7894330844 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:06.369768 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483cd24-7d57-4f63-9a54-f47695dfbde6 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:06.403177 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c48ce-63bd-441e-b6d9-5e1b528ffde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:06.404190 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c48ce-63bd-441e-b6d9-5e1b528ffde2 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:06.404613 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c48ce-63bd-441e-b6d9-5e1b528ffde2 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:06.405028 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c48ce-63bd-441e-b6d9-5e1b528ffde2 None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:06.405915 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c48ce-63bd-441e-b6d9-5e1b528ffde2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:06.406223 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c48ce-63bd-441e-b6d9-5e1b528ffde2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:06.407586 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c48ce-63bd-441e-b6d9-5e1b528ffde2 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:06.419723 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 153/313] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Mar 10 03:56:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:06.421640 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c48ce-63bd-441e-b6d9-5e1b528ffde2 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:06.478442 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5228d9-56d2-4028-948e-ec7894330844 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:06.520884 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12480ef4-9913-4989-9b84-b703c7c0e934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:06.522396 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12480ef4-9913-4989-9b84-b703c7c0e934 None admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:06.523027 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12480ef4-9913-4989-9b84-b703c7c0e934 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:06.523951 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12480ef4-9913-4989-9b84-b703c7c0e934 None admin] PATH_INFO: `/v3/system/users/324edde91cc04fb78de41b8afb513e41/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:06.526323 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12480ef4-9913-4989-9b84-b703c7c0e934 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=324edde91cc04fb78de41b8afb513e41, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:06.528194 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12480ef4-9913-4989-9b84-b703c7c0e934 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:06.529011 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c48ce-63bd-441e-b6d9-5e1b528ffde2 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:06.543941 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 161/314] 10.222.0.15 () {58 vars in 1334 bytes} [Thu Mar 10 03:56:06 2022] PUT /identity/v3/system/users/324edde91cc04fb78de41b8afb513e41/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 03:56:06.574149 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280ab12-fef2-4126-86c6-b21d0f556f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:06.575382 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280ab12-fef2-4126-86c6-b21d0f556f6f None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:06.575755 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280ab12-fef2-4126-86c6-b21d0f556f6f None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:06.576101 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280ab12-fef2-4126-86c6-b21d0f556f6f None admin] PATH_INFO: `/v3/users/e84fbaf6d66b40f8b781837929bba502` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:06.577722 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280ab12-fef2-4126-86c6-b21d0f556f6f None admin] RBAC: Authorizing `identity:get_user(user_id=e84fbaf6d66b40f8b781837929bba502)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:06.579422 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280ab12-fef2-4126-86c6-b21d0f556f6f None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:06.581692 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 154/315] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:56:06 2022] GET /identity/v3/users/e84fbaf6d66b40f8b781837929bba502 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:06.587502 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12480ef4-9913-4989-9b84-b703c7c0e934 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:06.696604 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12480ef4-9913-4989-9b84-b703c7c0e934 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:06.731437 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8cc5e-c8f0-439c-ae9a-d7ebc306974e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:06.732445 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8cc5e-c8f0-439c-ae9a-d7ebc306974e None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:06.732935 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8cc5e-c8f0-439c-ae9a-d7ebc306974e None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:06.733431 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8cc5e-c8f0-439c-ae9a-d7ebc306974e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:06.800416 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8cc5e-c8f0-439c-ae9a-d7ebc306974e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:06.802760 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8cc5e-c8f0-439c-ae9a-d7ebc306974e None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:06.907096 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 162/316] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:56:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:56:06.913263 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280ab12-fef2-4126-86c6-b21d0f556f6f None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:07.012014 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280ab12-fef2-4126-86c6-b21d0f556f6f None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:07.044196 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff85a3-774d-4e53-b29a-f8526e907ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:07.045037 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff85a3-774d-4e53-b29a-f8526e907ed9 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:07.045314 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff85a3-774d-4e53-b29a-f8526e907ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:07.045586 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff85a3-774d-4e53-b29a-f8526e907ed9 None admin] PATH_INFO: `/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:07.046756 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff85a3-774d-4e53-b29a-f8526e907ed9 None admin] RBAC: Authorizing `identity:get_project(project_id=fdcba3bc2cf94d4683c633c879cc7d25)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:07.048223 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff85a3-774d-4e53-b29a-f8526e907ed9 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:07.050049 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 155/317] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:56:06 2022] GET /identity/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25 => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:07.056414 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8cc5e-c8f0-439c-ae9a-d7ebc306974e None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:07.156676 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8cc5e-c8f0-439c-ae9a-d7ebc306974e None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:07.191078 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7e545-3822-4c46-9b45-f2e7411446ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:07.191755 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7e545-3822-4c46-9b45-f2e7411446ed None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:07.192066 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7e545-3822-4c46-9b45-f2e7411446ed None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:07.192335 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7e545-3822-4c46-9b45-f2e7411446ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:07.193150 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7e545-3822-4c46-9b45-f2e7411446ed None admin] RBAC: Adding query filter params (role.id=5daf615f445643608474ea1432d21e42, scope.project.id=fdcba3bc2cf94d4683c633c879cc7d25, user.id=e84fbaf6d66b40f8b781837929bba502) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:07.193705 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7e545-3822-4c46-9b45-f2e7411446ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:07.195128 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7e545-3822-4c46-9b45-f2e7411446ed None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:07.208153 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 163/318] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:56:07 2022] GET /identity/v3/role_assignments?user.id=e84fbaf6d66b40f8b781837929bba502&scope.project.id=fdcba3bc2cf94d4683c633c879cc7d25&role.id=5daf615f445643608474ea1432d21e42 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:56:08.042323 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df2e91-9dfb-4242-ab85-15c70a3eeb47 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:08.042883 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df2e91-9dfb-4242-ab85-15c70a3eeb47 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:08.042883 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df2e91-9dfb-4242-ab85-15c70a3eeb47 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:08.044777 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 156/319] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:08.050695 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95abb3-6ed2-4d3e-8149-72bbad1f8976 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:08.051156 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95abb3-6ed2-4d3e-8149-72bbad1f8976 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:08.051889 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95abb3-6ed2-4d3e-8149-72bbad1f8976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:08.071780 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-6d95abb3-6ed2-4d3e-8149-72bbad1f8976 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:08.072975 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-6d95abb3-6ed2-4d3e-8149-72bbad1f8976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:08.137723 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 164/320] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:08.160376 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df2e91-9dfb-4242-ab85-15c70a3eeb47 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:08.261263 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df2e91-9dfb-4242-ab85-15c70a3eeb47 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:08.294942 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302e674-4aa5-479a-ad2d-adbfa0656195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:08.295660 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302e674-4aa5-479a-ad2d-adbfa0656195 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:08.295969 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302e674-4aa5-479a-ad2d-adbfa0656195 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:08.296245 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302e674-4aa5-479a-ad2d-adbfa0656195 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:08.297411 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302e674-4aa5-479a-ad2d-adbfa0656195 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:08.298850 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302e674-4aa5-479a-ad2d-adbfa0656195 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:08.300645 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 157/321] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:08.306549 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95abb3-6ed2-4d3e-8149-72bbad1f8976 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:08.387536 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb39de-80fc-4a27-9634-ea1fd6d35a29 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:08.387855 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb39de-80fc-4a27-9634-ea1fd6d35a29 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:08.388303 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb39de-80fc-4a27-9634-ea1fd6d35a29 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:08.390064 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 158/322] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 03:56:08.395008 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cdec47-47d7-4144-a6d7-5810cad29a9a None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:08.395293 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cdec47-47d7-4144-a6d7-5810cad29a9a None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:08.395566 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cdec47-47d7-4144-a6d7-5810cad29a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:08.400179 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95abb3-6ed2-4d3e-8149-72bbad1f8976 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:08.412418 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-d6cdec47-47d7-4144-a6d7-5810cad29a9a None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:08.413587 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-d6cdec47-47d7-4144-a6d7-5810cad29a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:08.436017 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd939bde-590c-4e5d-981a-d9885403e8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:08.436674 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd939bde-590c-4e5d-981a-d9885403e8c0 None admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:08.436952 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd939bde-590c-4e5d-981a-d9885403e8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:08.437227 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd939bde-590c-4e5d-981a-d9885403e8c0 None admin] PATH_INFO: `/v3/groups` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:08.437905 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd939bde-590c-4e5d-981a-d9885403e8c0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:08.439329 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd939bde-590c-4e5d-981a-d9885403e8c0 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:08.454162 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 165/323] 10.222.0.15 () {60 vars in 1134 bytes} [Thu Mar 10 03:56:08 2022] POST /identity/v3/groups => generated 226 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 03:56:08.482785 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 159/324] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 03:56:08.506152 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd939bde-590c-4e5d-981a-d9885403e8c0 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:08.612610 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd939bde-590c-4e5d-981a-d9885403e8c0 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:08.649363 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa8fe5-5097-4391-975f-1669086269b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:08.650179 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa8fe5-5097-4391-975f-1669086269b6 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:08.650468 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa8fe5-5097-4391-975f-1669086269b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:08.650745 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa8fe5-5097-4391-975f-1669086269b6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:08.662109 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa8fe5-5097-4391-975f-1669086269b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:08.669158 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-70fa8fe5-5097-4391-975f-1669086269b6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 10 03:56:08.670355 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 166/325] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:56:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:08.676060 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cdec47-47d7-4144-a6d7-5810cad29a9a None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:08.776699 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cdec47-47d7-4144-a6d7-5810cad29a9a None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:08.811108 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5fc64-0968-4278-9ba1-cc274b552132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:08.811817 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5fc64-0968-4278-9ba1-cc274b552132 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:08.812099 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5fc64-0968-4278-9ba1-cc274b552132 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:08.812375 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5fc64-0968-4278-9ba1-cc274b552132 None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:08.813128 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5fc64-0968-4278-9ba1-cc274b552132 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:08.813429 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5fc64-0968-4278-9ba1-cc274b552132 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:08.814813 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5fc64-0968-4278-9ba1-cc274b552132 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:08.823826 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 160/326] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Mar 10 03:56:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:08.829460 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa8fe5-5097-4391-975f-1669086269b6 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:08.904137 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f74bb6-2b54-4757-8b9a-8d709dd2eeea None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:08.904420 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f74bb6-2b54-4757-8b9a-8d709dd2eeea None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:08.904625 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f74bb6-2b54-4757-8b9a-8d709dd2eeea None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:08.906558 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 161/327] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 03:56:08.912290 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4be9a-6546-4dd2-ab02-b7548cc372b3 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:08.912832 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4be9a-6546-4dd2-ab02-b7548cc372b3 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:08.913303 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4be9a-6546-4dd2-ab02-b7548cc372b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:08.934483 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa8fe5-5097-4391-975f-1669086269b6 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:08.941626 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-b2e4be9a-6546-4dd2-ab02-b7548cc372b3 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:08.942878 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-b2e4be9a-6546-4dd2-ab02-b7548cc372b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:08.969154 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e638c2-d9b5-4423-97ce-8c6889f6d6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:08.970039 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e638c2-d9b5-4423-97ce-8c6889f6d6fb None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:08.970340 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e638c2-d9b5-4423-97ce-8c6889f6d6fb None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:08.970599 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e638c2-d9b5-4423-97ce-8c6889f6d6fb None admin] PATH_INFO: `/v3/users/7670b78bd7f54b51af84f4044769a20a` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:08.971861 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e638c2-d9b5-4423-97ce-8c6889f6d6fb None admin] RBAC: Authorizing `identity:get_user(user_id=7670b78bd7f54b51af84f4044769a20a)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:08.973868 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e638c2-d9b5-4423-97ce-8c6889f6d6fb None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:08.975818 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 167/328] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:56:08 2022] GET /identity/v3/users/7670b78bd7f54b51af84f4044769a20a => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:08.981042 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e638c2-d9b5-4423-97ce-8c6889f6d6fb None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:09.061699 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 162/329] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:09.084987 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e638c2-d9b5-4423-97ce-8c6889f6d6fb None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:09.089218 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4be9a-6546-4dd2-ab02-b7548cc372b3 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:09.120610 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca44c65-050c-4190-9875-827a2b493b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:09.121537 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca44c65-050c-4190-9875-827a2b493b9e None admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:09.121799 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca44c65-050c-4190-9875-827a2b493b9e None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:09.122122 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca44c65-050c-4190-9875-827a2b493b9e None admin] PATH_INFO: `/v3/system/users/7670b78bd7f54b51af84f4044769a20a/roles/5daf615f445643608474ea1432d21e42` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:09.123555 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca44c65-050c-4190-9875-827a2b493b9e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7670b78bd7f54b51af84f4044769a20a, role_id=5daf615f445643608474ea1432d21e42)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:09.125029 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca44c65-050c-4190-9875-827a2b493b9e None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:09.139722 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 168/330] 10.222.0.15 () {58 vars in 1334 bytes} [Thu Mar 10 03:56:08 2022] PUT /identity/v3/system/users/7670b78bd7f54b51af84f4044769a20a/roles/5daf615f445643608474ea1432d21e42 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 03:56:09.201295 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4be9a-6546-4dd2-ab02-b7548cc372b3 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:09.238458 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1953c5-5baa-477e-abb9-52a0850c1cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:09.239356 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1953c5-5baa-477e-abb9-52a0850c1cf5 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:09.239641 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1953c5-5baa-477e-abb9-52a0850c1cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:09.239945 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1953c5-5baa-477e-abb9-52a0850c1cf5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:09.251728 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1953c5-5baa-477e-abb9-52a0850c1cf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:09.259851 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-3c1953c5-5baa-477e-abb9-52a0850c1cf5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 03:56:09.261321 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 163/331] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:56:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:56:09.267235 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca44c65-050c-4190-9875-827a2b493b9e None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:09.376820 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca44c65-050c-4190-9875-827a2b493b9e None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:09.410734 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0ec87-a8f2-4f16-8821-3fdb7702517a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:09.411402 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0ec87-a8f2-4f16-8821-3fdb7702517a None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:09.411691 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0ec87-a8f2-4f16-8821-3fdb7702517a None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:09.411982 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0ec87-a8f2-4f16-8821-3fdb7702517a None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:09.412730 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0ec87-a8f2-4f16-8821-3fdb7702517a None admin] RBAC: Adding query filter params (name=member) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:09.413033 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0ec87-a8f2-4f16-8821-3fdb7702517a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:09.414398 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0ec87-a8f2-4f16-8821-3fdb7702517a None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:09.424743 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 169/332] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Mar 10 03:56:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:09.429820 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1953c5-5baa-477e-abb9-52a0850c1cf5 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:09.531142 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1953c5-5baa-477e-abb9-52a0850c1cf5 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:09.566672 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2d7d7-5829-4dc8-9433-fbf5eed1a67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:09.568509 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2d7d7-5829-4dc8-9433-fbf5eed1a67e None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:09.568789 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2d7d7-5829-4dc8-9433-fbf5eed1a67e None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:09.569058 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2d7d7-5829-4dc8-9433-fbf5eed1a67e None admin] PATH_INFO: `/v3/users/324edde91cc04fb78de41b8afb513e41` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:09.570268 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2d7d7-5829-4dc8-9433-fbf5eed1a67e None admin] RBAC: Authorizing `identity:get_user(user_id=324edde91cc04fb78de41b8afb513e41)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:09.571729 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2d7d7-5829-4dc8-9433-fbf5eed1a67e None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:09.576147 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 164/333] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:56:09 2022] GET /identity/v3/users/324edde91cc04fb78de41b8afb513e41 => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:09.579572 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0ec87-a8f2-4f16-8821-3fdb7702517a None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:09.695018 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0ec87-a8f2-4f16-8821-3fdb7702517a None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:09.730890 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf78ac5-71b0-4381-a7e2-843dc27151bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:09.731551 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf78ac5-71b0-4381-a7e2-843dc27151bd None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:09.731861 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf78ac5-71b0-4381-a7e2-843dc27151bd None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:09.732136 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf78ac5-71b0-4381-a7e2-843dc27151bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:09.732959 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf78ac5-71b0-4381-a7e2-843dc27151bd None admin] RBAC: Adding query filter params (role.id=73b2aee45a2d4be19addaf4a33414295, user.id=324edde91cc04fb78de41b8afb513e41, scope.system=all) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:09.733267 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf78ac5-71b0-4381-a7e2-843dc27151bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:09.734700 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf78ac5-71b0-4381-a7e2-843dc27151bd None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:09.750655 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 170/334] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Mar 10 03:56:09 2022] GET /identity/v3/role_assignments?user.id=324edde91cc04fb78de41b8afb513e41&scope.system=all&role.id=73b2aee45a2d4be19addaf4a33414295 => generated 510 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:11.464189 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a5b03-16a5-4d44-9bd5-ecc5c2236240 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:11.465216 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a5b03-16a5-4d44-9bd5-ecc5c2236240 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:11.465707 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a5b03-16a5-4d44-9bd5-ecc5c2236240 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:11.468296 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 165/335] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:11.476421 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256fad7-c0fc-4194-a093-43ef0b25cc25 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:11.477393 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256fad7-c0fc-4194-a093-43ef0b25cc25 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:11.477889 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256fad7-c0fc-4194-a093-43ef0b25cc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:11.499495 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-5256fad7-c0fc-4194-a093-43ef0b25cc25 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:11.501081 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-5256fad7-c0fc-4194-a093-43ef0b25cc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:11.571797 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 171/336] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 03:56:11.594276 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a5b03-16a5-4d44-9bd5-ecc5c2236240 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:11.696953 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a5b03-16a5-4d44-9bd5-ecc5c2236240 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:11.731299 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5dbe7-a55c-4f87-8b85-e835a60b1abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:11.732477 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5dbe7-a55c-4f87-8b85-e835a60b1abf None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:11.732984 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5dbe7-a55c-4f87-8b85-e835a60b1abf None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:11.733472 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5dbe7-a55c-4f87-8b85-e835a60b1abf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:11.743894 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5dbe7-a55c-4f87-8b85-e835a60b1abf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:11.751428 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-29f5dbe7-a55c-4f87-8b85-e835a60b1abf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 10 03:56:11.757653 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 166/337] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Mar 10 03:56:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:11.759247 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256fad7-c0fc-4194-a093-43ef0b25cc25 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:11.870803 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256fad7-c0fc-4194-a093-43ef0b25cc25 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:11.905161 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff850a-8828-4e7b-9d01-871ad941e6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:11.906201 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff850a-8828-4e7b-9d01-871ad941e6af None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:11.906703 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff850a-8828-4e7b-9d01-871ad941e6af None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:11.907184 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff850a-8828-4e7b-9d01-871ad941e6af None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:11.908164 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff850a-8828-4e7b-9d01-871ad941e6af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:11.908670 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff850a-8828-4e7b-9d01-871ad941e6af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:11.910215 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff850a-8828-4e7b-9d01-871ad941e6af None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:11.923799 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 172/338] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:56:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:11.925563 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5dbe7-a55c-4f87-8b85-e835a60b1abf None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:11.970866 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057612ab-d857-4540-b3f8-263af93549c6 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:11.971579 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057612ab-d857-4540-b3f8-263af93549c6 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:11.972083 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057612ab-d857-4540-b3f8-263af93549c6 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:11.974630 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 173/339] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 03:56:11.979921 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b579f69-c7f7-4f99-ac89-67cdf197dcff None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:11.980483 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b579f69-c7f7-4f99-ac89-67cdf197dcff None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:11.980960 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b579f69-c7f7-4f99-ac89-67cdf197dcff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:12.010077 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-7b579f69-c7f7-4f99-ac89-67cdf197dcff None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:12.012692 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-7b579f69-c7f7-4f99-ac89-67cdf197dcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:12.097013 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5dbe7-a55c-4f87-8b85-e835a60b1abf None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:12.123469 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 174/340] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 03:56:12.159572 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194ab87-f85f-471a-9151-f64dbd2a8c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:12.160268 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194ab87-f85f-471a-9151-f64dbd2a8c52 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:12.160611 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194ab87-f85f-471a-9151-f64dbd2a8c52 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:12.160890 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194ab87-f85f-471a-9151-f64dbd2a8c52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:12.176492 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b579f69-c7f7-4f99-ac89-67cdf197dcff None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:12.289252 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b579f69-c7f7-4f99-ac89-67cdf197dcff None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:12.312925 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194ab87-f85f-471a-9151-f64dbd2a8c52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:12.314672 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194ab87-f85f-471a-9151-f64dbd2a8c52 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:12.328674 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37146c3-dff2-4861-9afd-ad51d9884791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:12.329824 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37146c3-dff2-4861-9afd-ad51d9884791 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:12.330306 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37146c3-dff2-4861-9afd-ad51d9884791 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:12.330774 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37146c3-dff2-4861-9afd-ad51d9884791 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:12.343033 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37146c3-dff2-4861-9afd-ad51d9884791 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:12.351349 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-b37146c3-dff2-4861-9afd-ad51d9884791 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 03:56:12.353515 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 175/341] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:56:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:56:12.363640 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37146c3-dff2-4861-9afd-ad51d9884791 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:12.473570 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37146c3-dff2-4861-9afd-ad51d9884791 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:12.511566 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d3468-de32-4f28-a2cc-15be849d6e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:12.513310 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d3468-de32-4f28-a2cc-15be849d6e84 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:12.513788 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d3468-de32-4f28-a2cc-15be849d6e84 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:12.514257 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d3468-de32-4f28-a2cc-15be849d6e84 None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:12.515391 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d3468-de32-4f28-a2cc-15be849d6e84 None admin] RBAC: Adding query filter params (name=member) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:12.515944 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d3468-de32-4f28-a2cc-15be849d6e84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:12.517609 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d3468-de32-4f28-a2cc-15be849d6e84 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:12.526682 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 167/342] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:56:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:56:12.533147 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 176/343] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Mar 10 03:56:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:56:12.534962 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194ab87-f85f-471a-9151-f64dbd2a8c52 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:12.543173 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d3468-de32-4f28-a2cc-15be849d6e84 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:12.706585 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194ab87-f85f-471a-9151-f64dbd2a8c52 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:12.743267 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc27bc-1ab8-4502-aa2c-606274d5c79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:12.744612 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc27bc-1ab8-4502-aa2c-606274d5c79a None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:12.745098 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc27bc-1ab8-4502-aa2c-606274d5c79a None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:12.745582 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc27bc-1ab8-4502-aa2c-606274d5c79a None admin] PATH_INFO: `/v3/projects/296b04835db8494cbdfa27b87fe62760` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:12.746998 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc27bc-1ab8-4502-aa2c-606274d5c79a None admin] RBAC: Authorizing `identity:get_project(project_id=296b04835db8494cbdfa27b87fe62760)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:12.748693 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc27bc-1ab8-4502-aa2c-606274d5c79a None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:12.750585 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 168/344] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:56:12 2022] GET /identity/v3/projects/296b04835db8494cbdfa27b87fe62760 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:12.751998 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cef06f-9f49-4ce3-a00a-a54b4db93105 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:12.752504 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cef06f-9f49-4ce3-a00a-a54b4db93105 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:12.752994 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cef06f-9f49-4ce3-a00a-a54b4db93105 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:12.757172 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 169/345] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:12.760601 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37d1f1-0c09-45ea-839f-535f689e7e0f None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:12.761114 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37d1f1-0c09-45ea-839f-535f689e7e0f None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:12.761588 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37d1f1-0c09-45ea-839f-535f689e7e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:12.780975 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-1c37d1f1-0c09-45ea-839f-535f689e7e0f None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:12.782476 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-1c37d1f1-0c09-45ea-839f-535f689e7e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:12.802461 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d3468-de32-4f28-a2cc-15be849d6e84 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:12.843301 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f3253-079a-43ae-83ac-81a7de46ca19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:12.844164 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f3253-079a-43ae-83ac-81a7de46ca19 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:12.844451 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f3253-079a-43ae-83ac-81a7de46ca19 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:12.844725 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f3253-079a-43ae-83ac-81a7de46ca19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:12.856743 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 170/346] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 03:56:12.857968 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37d1f1-0c09-45ea-839f-535f689e7e0f None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:12.930353 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f3253-079a-43ae-83ac-81a7de46ca19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:12.932744 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f3253-079a-43ae-83ac-81a7de46ca19 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:12.979405 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37d1f1-0c09-45ea-839f-535f689e7e0f None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:13.032305 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f826f-bcea-4c42-8ead-73978a631532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:13.033531 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f826f-bcea-4c42-8ead-73978a631532 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:13.034119 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f826f-bcea-4c42-8ead-73978a631532 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:13.034407 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f826f-bcea-4c42-8ead-73978a631532 None admin] PATH_INFO: `/v3/groups/63f30dde633b4babae3c8e5a6b5efa4e` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:13.046484 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f826f-bcea-4c42-8ead-73978a631532 None admin] RBAC: Authorizing `identity:get_group(group_id=63f30dde633b4babae3c8e5a6b5efa4e)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:13.048836 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f826f-bcea-4c42-8ead-73978a631532 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:13.050735 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 171/347] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Mar 10 03:56:12 2022] GET /identity/v3/groups/63f30dde633b4babae3c8e5a6b5efa4e => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:13.051934 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f826f-bcea-4c42-8ead-73978a631532 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:13.054988 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 177/348] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:56:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 10 03:56:13.058413 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f3253-079a-43ae-83ac-81a7de46ca19 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:13.177859 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f3253-079a-43ae-83ac-81a7de46ca19 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:13.190385 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f826f-bcea-4c42-8ead-73978a631532 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:13.218974 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca7926-7bfd-4b6f-b286-0a4fd56879ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:13.219895 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca7926-7bfd-4b6f-b286-0a4fd56879ae None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:13.220338 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca7926-7bfd-4b6f-b286-0a4fd56879ae None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:13.220752 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca7926-7bfd-4b6f-b286-0a4fd56879ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:13.221713 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca7926-7bfd-4b6f-b286-0a4fd56879ae None admin] RBAC: Adding query filter params (group.id=63f30dde633b4babae3c8e5a6b5efa4e, role.id=c38b04db9cd34eeaaaa8d2a6425c05ad, scope.project.id=296b04835db8494cbdfa27b87fe62760) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:13.222221 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca7926-7bfd-4b6f-b286-0a4fd56879ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:13.226617 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca7926-7bfd-4b6f-b286-0a4fd56879ae None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:13.234746 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 178/349] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Mar 10 03:56:13 2022] GET /identity/v3/role_assignments?group.id=63f30dde633b4babae3c8e5a6b5efa4e&scope.project.id=296b04835db8494cbdfa27b87fe62760&role.id=c38b04db9cd34eeaaaa8d2a6425c05ad => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:56:13.235821 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca7926-7bfd-4b6f-b286-0a4fd56879ae None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:13.236838 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894ad17-b245-463f-aaf5-6dfd658b3924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:13.237711 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894ad17-b245-463f-aaf5-6dfd658b3924 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:13.238065 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894ad17-b245-463f-aaf5-6dfd658b3924 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:13.238413 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894ad17-b245-463f-aaf5-6dfd658b3924 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:13.258575 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2894ad17-b245-463f-aaf5-6dfd658b3924 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:13.272297 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-2894ad17-b245-463f-aaf5-6dfd658b3924 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 03:56:13.273975 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 172/350] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:56:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:13.279673 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea6cde-f2d1-4960-98e6-d30b5dcdfa65 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:13.280247 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea6cde-f2d1-4960-98e6-d30b5dcdfa65 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:13.280661 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea6cde-f2d1-4960-98e6-d30b5dcdfa65 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:13.282891 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 173/351] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:13.283858 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea6cde-f2d1-4960-98e6-d30b5dcdfa65 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:13.346501 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca7926-7bfd-4b6f-b286-0a4fd56879ae None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:13.383337 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f2e3c-a5e5-460f-b1f0-78bd44a1927a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:13.384678 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f2e3c-a5e5-460f-b1f0-78bd44a1927a None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:13.385211 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f2e3c-a5e5-460f-b1f0-78bd44a1927a None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:13.385708 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f2e3c-a5e5-460f-b1f0-78bd44a1927a None admin] PATH_INFO: `/v3/projects/296b04835db8494cbdfa27b87fe62760` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:13.387383 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f2e3c-a5e5-460f-b1f0-78bd44a1927a None admin] RBAC: Authorizing `identity:get_project(project_id=296b04835db8494cbdfa27b87fe62760)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:13.389312 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f2e3c-a5e5-460f-b1f0-78bd44a1927a None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:13.391358 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 179/352] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:56:13 2022] GET /identity/v3/projects/296b04835db8494cbdfa27b87fe62760 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:13.393880 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0087c-935d-4c32-ad5b-e90f52999dd1 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:13.394402 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0087c-935d-4c32-ad5b-e90f52999dd1 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:13.395429 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0087c-935d-4c32-ad5b-e90f52999dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:13.412978 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea6cde-f2d1-4960-98e6-d30b5dcdfa65 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:13.416642 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-b5b0087c-935d-4c32-ad5b-e90f52999dd1 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:13.418198 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-b5b0087c-935d-4c32-ad5b-e90f52999dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:13.456588 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cddf9-81ee-43e9-94ef-f591bdc90e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:13.457901 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cddf9-81ee-43e9-94ef-f591bdc90e68 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:13.458183 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cddf9-81ee-43e9-94ef-f591bdc90e68 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:13.458456 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cddf9-81ee-43e9-94ef-f591bdc90e68 None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:13.459218 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5cddf9-81ee-43e9-94ef-f591bdc90e68 None admin] RBAC: Adding query filter params (name=member) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:13.459526 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5cddf9-81ee-43e9-94ef-f591bdc90e68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:13.461255 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5cddf9-81ee-43e9-94ef-f591bdc90e68 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:13.474248 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 174/353] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Mar 10 03:56:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:13.475985 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b71f4-0f40-4d02-98b7-323ffbb538d5 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:13.476288 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b71f4-0f40-4d02-98b7-323ffbb538d5 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:13.476987 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b71f4-0f40-4d02-98b7-323ffbb538d5 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:13.479728 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 175/354] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:13.480452 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b71f4-0f40-4d02-98b7-323ffbb538d5 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:13.497706 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 180/355] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:13.498905 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0087c-935d-4c32-ad5b-e90f52999dd1 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:13.599403 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b71f4-0f40-4d02-98b7-323ffbb538d5 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:13.609978 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0087c-935d-4c32-ad5b-e90f52999dd1 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:13.635430 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6e3a8-5e2d-4856-9a94-b120eeb314bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:13.636679 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6e3a8-5e2d-4856-9a94-b120eeb314bb None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:13.637165 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6e3a8-5e2d-4856-9a94-b120eeb314bb None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:13.637662 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6e3a8-5e2d-4856-9a94-b120eeb314bb None admin] PATH_INFO: `/v3/groups/63f30dde633b4babae3c8e5a6b5efa4e` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:13.639058 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6e3a8-5e2d-4856-9a94-b120eeb314bb None admin] RBAC: Authorizing `identity:get_group(group_id=63f30dde633b4babae3c8e5a6b5efa4e)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:13.640742 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6e3a8-5e2d-4856-9a94-b120eeb314bb None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:13.642587 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 176/356] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Mar 10 03:56:13 2022] GET /identity/v3/groups/63f30dde633b4babae3c8e5a6b5efa4e => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:13.645647 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b72c49-0e3b-4155-a879-2812e18435a3 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:13.646171 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b72c49-0e3b-4155-a879-2812e18435a3 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:13.646650 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b72c49-0e3b-4155-a879-2812e18435a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:13.649156 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcacc2-13a6-41e0-8dc7-b734c2532085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:13.649862 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcacc2-13a6-41e0-8dc7-b734c2532085 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:13.650142 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcacc2-13a6-41e0-8dc7-b734c2532085 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:13.650414 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcacc2-13a6-41e0-8dc7-b734c2532085 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:13.665053 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-f7b72c49-0e3b-4155-a879-2812e18435a3 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:13.666576 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-f7b72c49-0e3b-4155-a879-2812e18435a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:13.740270 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 177/357] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:13.741429 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b72c49-0e3b-4155-a879-2812e18435a3 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:13.742941 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bcacc2-13a6-41e0-8dc7-b734c2532085 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:13.744583 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bcacc2-13a6-41e0-8dc7-b734c2532085 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:13.845658 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b72c49-0e3b-4155-a879-2812e18435a3 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:13.853437 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 181/358] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:56:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:56:13.854292 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcacc2-13a6-41e0-8dc7-b734c2532085 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:13.892386 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e776d80-6472-4903-95e3-927d7b528e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:13.893187 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e776d80-6472-4903-95e3-927d7b528e06 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:13.893626 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e776d80-6472-4903-95e3-927d7b528e06 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:13.893919 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e776d80-6472-4903-95e3-927d7b528e06 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:13.910830 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e776d80-6472-4903-95e3-927d7b528e06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:13.918032 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-8e776d80-6472-4903-95e3-927d7b528e06 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 10 03:56:13.919548 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 178/359] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:56:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:13.920361 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e776d80-6472-4903-95e3-927d7b528e06 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:13.978584 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcacc2-13a6-41e0-8dc7-b734c2532085 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:14.021268 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca207d-2022-477f-8ae6-32d02333e9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:14.021920 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca207d-2022-477f-8ae6-32d02333e9cb None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:14.022197 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca207d-2022-477f-8ae6-32d02333e9cb None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:14.023442 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca207d-2022-477f-8ae6-32d02333e9cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:14.023442 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca207d-2022-477f-8ae6-32d02333e9cb None admin] RBAC: Adding query filter params (group.id=63f30dde633b4babae3c8e5a6b5efa4e, role.id=73b2aee45a2d4be19addaf4a33414295, scope.project.id=296b04835db8494cbdfa27b87fe62760) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:14.023617 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca207d-2022-477f-8ae6-32d02333e9cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:14.024992 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca207d-2022-477f-8ae6-32d02333e9cb None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:14.030843 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 182/360] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Mar 10 03:56:13 2022] GET /identity/v3/role_assignments?group.id=63f30dde633b4babae3c8e5a6b5efa4e&scope.project.id=296b04835db8494cbdfa27b87fe62760&role.id=73b2aee45a2d4be19addaf4a33414295 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:14.032626 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c9b7e-bc3f-472f-9037-b79151cea017 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:14.033315 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c9b7e-bc3f-472f-9037-b79151cea017 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:14.034148 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c9b7e-bc3f-472f-9037-b79151cea017 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:14.036800 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 183/361] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:14.036966 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e776d80-6472-4903-95e3-927d7b528e06 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:14.037994 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c9b7e-bc3f-472f-9037-b79151cea017 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:14.085148 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b3c7e-b860-4133-8fa5-df1401e52cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:14.086372 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b3c7e-b860-4133-8fa5-df1401e52cf0 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:14.087013 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b3c7e-b860-4133-8fa5-df1401e52cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:14.087492 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b3c7e-b860-4133-8fa5-df1401e52cf0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:14.102182 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b3c7e-b860-4133-8fa5-df1401e52cf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:14.112862 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-7f5b3c7e-b860-4133-8fa5-df1401e52cf0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 10 03:56:14.115675 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 179/362] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Mar 10 03:56:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:14.117140 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b3c7e-b860-4133-8fa5-df1401e52cf0 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:14.162567 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c9b7e-bc3f-472f-9037-b79151cea017 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:14.206263 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a87842-b279-4302-998a-3caf68135a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:14.208213 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a87842-b279-4302-998a-3caf68135a17 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:14.208650 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a87842-b279-4302-998a-3caf68135a17 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:14.209067 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a87842-b279-4302-998a-3caf68135a17 None admin] PATH_INFO: `/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:14.210767 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a87842-b279-4302-998a-3caf68135a17 None admin] RBAC: Authorizing `identity:get_project(project_id=fdcba3bc2cf94d4683c633c879cc7d25)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:14.212567 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a87842-b279-4302-998a-3caf68135a17 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:14.219891 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 184/363] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:56:14 2022] GET /identity/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:14.222011 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2620c-06d9-4df9-8bd7-9d45b5ec2c00 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:14.222011 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2620c-06d9-4df9-8bd7-9d45b5ec2c00 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:14.222197 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2620c-06d9-4df9-8bd7-9d45b5ec2c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:14.249561 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b3c7e-b860-4133-8fa5-df1401e52cf0 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:14.250213 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-44f2620c-06d9-4df9-8bd7-9d45b5ec2c00 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:14.251805 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-44f2620c-06d9-4df9-8bd7-9d45b5ec2c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:14.292280 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06dc0c9-9928-4caf-92ca-dd1498bbecf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:14.293305 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06dc0c9-9928-4caf-92ca-dd1498bbecf5 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:14.293978 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06dc0c9-9928-4caf-92ca-dd1498bbecf5 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:14.294463 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06dc0c9-9928-4caf-92ca-dd1498bbecf5 None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:14.295398 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06dc0c9-9928-4caf-92ca-dd1498bbecf5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:14.295913 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06dc0c9-9928-4caf-92ca-dd1498bbecf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:14.297470 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06dc0c9-9928-4caf-92ca-dd1498bbecf5 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:14.309211 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 180/364] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Mar 10 03:56:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:14.310417 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06dc0c9-9928-4caf-92ca-dd1498bbecf5 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:14.350213 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 185/365] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:14.351984 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2620c-06d9-4df9-8bd7-9d45b5ec2c00 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:14.425362 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06dc0c9-9928-4caf-92ca-dd1498bbecf5 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:14.462341 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4389bca-a745-4b40-af4d-3e81330e99ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:14.463423 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4389bca-a745-4b40-af4d-3e81330e99ce None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:14.463930 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4389bca-a745-4b40-af4d-3e81330e99ce None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:14.464432 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4389bca-a745-4b40-af4d-3e81330e99ce None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:14.465383 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4389bca-a745-4b40-af4d-3e81330e99ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:14.465877 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4389bca-a745-4b40-af4d-3e81330e99ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:14.467457 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4389bca-a745-4b40-af4d-3e81330e99ce None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:14.470555 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2620c-06d9-4df9-8bd7-9d45b5ec2c00 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:14.479497 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 181/366] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:56:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:14.480560 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4389bca-a745-4b40-af4d-3e81330e99ce None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:14.511168 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e18486-0589-4236-8756-983c2fc45e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:14.512529 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e18486-0589-4236-8756-983c2fc45e4f None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:14.513156 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e18486-0589-4236-8756-983c2fc45e4f None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:14.513541 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e18486-0589-4236-8756-983c2fc45e4f None admin] PATH_INFO: `/v3/groups/63f30dde633b4babae3c8e5a6b5efa4e` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:14.514979 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e18486-0589-4236-8756-983c2fc45e4f None admin] RBAC: Authorizing `identity:get_group(group_id=63f30dde633b4babae3c8e5a6b5efa4e)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:14.517123 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e18486-0589-4236-8756-983c2fc45e4f None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:14.519056 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 186/367] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Mar 10 03:56:14 2022] GET /identity/v3/groups/63f30dde633b4babae3c8e5a6b5efa4e => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:14.521210 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e18486-0589-4236-8756-983c2fc45e4f None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:14.606208 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4389bca-a745-4b40-af4d-3e81330e99ce None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:14.628212 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e18486-0589-4236-8756-983c2fc45e4f None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:14.646156 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac4d8d-b74c-4636-ab76-fcdb5c3eca40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:14.647405 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac4d8d-b74c-4636-ab76-fcdb5c3eca40 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:14.647929 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac4d8d-b74c-4636-ab76-fcdb5c3eca40 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:14.648419 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac4d8d-b74c-4636-ab76-fcdb5c3eca40 None admin] PATH_INFO: `/v3/users/7670b78bd7f54b51af84f4044769a20a` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:14.650055 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac4d8d-b74c-4636-ab76-fcdb5c3eca40 None admin] RBAC: Authorizing `identity:get_user(user_id=7670b78bd7f54b51af84f4044769a20a)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:14.651820 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac4d8d-b74c-4636-ab76-fcdb5c3eca40 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:14.654165 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 182/368] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:56:14 2022] GET /identity/v3/users/7670b78bd7f54b51af84f4044769a20a => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:14.655235 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac4d8d-b74c-4636-ab76-fcdb5c3eca40 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:14.670045 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7e540-268c-446a-9fad-984cbda92a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:14.670848 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7e540-268c-446a-9fad-984cbda92a8b None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:14.671129 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7e540-268c-446a-9fad-984cbda92a8b None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:14.671407 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7e540-268c-446a-9fad-984cbda92a8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:14.685150 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7e540-268c-446a-9fad-984cbda92a8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:14.694912 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-50e7e540-268c-446a-9fad-984cbda92a8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 03:56:14.696801 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 187/369] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:56:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:14.698026 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7e540-268c-446a-9fad-984cbda92a8b None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:14.771503 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac4d8d-b74c-4636-ab76-fcdb5c3eca40 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:14.809478 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a000317-3227-4e33-9068-e55ef7ba7e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:14.810516 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a000317-3227-4e33-9068-e55ef7ba7e99 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:14.811004 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a000317-3227-4e33-9068-e55ef7ba7e99 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:14.811575 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a000317-3227-4e33-9068-e55ef7ba7e99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:14.816420 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7e540-268c-446a-9fad-984cbda92a8b None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:14.854422 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f97218-e49e-4572-8d5d-f320cccaad31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:14.855460 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f97218-e49e-4572-8d5d-f320cccaad31 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:14.855962 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f97218-e49e-4572-8d5d-f320cccaad31 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:14.856481 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f97218-e49e-4572-8d5d-f320cccaad31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:14.857521 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f97218-e49e-4572-8d5d-f320cccaad31 None admin] RBAC: Adding query filter params (group.id=63f30dde633b4babae3c8e5a6b5efa4e, role.id=73b2aee45a2d4be19addaf4a33414295, scope.project.id=fdcba3bc2cf94d4683c633c879cc7d25) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:14.858022 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f97218-e49e-4572-8d5d-f320cccaad31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:14.859648 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f97218-e49e-4572-8d5d-f320cccaad31 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:14.865690 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 188/370] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Mar 10 03:56:14 2022] GET /identity/v3/role_assignments?group.id=63f30dde633b4babae3c8e5a6b5efa4e&scope.project.id=fdcba3bc2cf94d4683c633c879cc7d25&role.id=73b2aee45a2d4be19addaf4a33414295 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:14.866711 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f97218-e49e-4572-8d5d-f320cccaad31 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:14.902527 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a000317-3227-4e33-9068-e55ef7ba7e99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:14.904810 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a000317-3227-4e33-9068-e55ef7ba7e99 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:15.024110 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f97218-e49e-4572-8d5d-f320cccaad31 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:15.042060 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 183/371] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:56:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:56:15.043318 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a000317-3227-4e33-9068-e55ef7ba7e99 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:15.059114 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08ef31-50b7-45a2-95db-d98b4d8449d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:15.059790 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08ef31-50b7-45a2-95db-d98b4d8449d7 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:15.060109 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08ef31-50b7-45a2-95db-d98b4d8449d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:15.060345 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08ef31-50b7-45a2-95db-d98b4d8449d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:15.061171 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08ef31-50b7-45a2-95db-d98b4d8449d7 None admin] RBAC: Adding query filter params (role.id=5daf615f445643608474ea1432d21e42, user.id=7670b78bd7f54b51af84f4044769a20a, scope.system=all) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:15.061481 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08ef31-50b7-45a2-95db-d98b4d8449d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:15.062904 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08ef31-50b7-45a2-95db-d98b4d8449d7 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:15.079054 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 189/372] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Mar 10 03:56:14 2022] GET /identity/v3/role_assignments?user.id=7670b78bd7f54b51af84f4044769a20a&scope.system=all&role.id=5daf615f445643608474ea1432d21e42 => generated 510 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:15.079054 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08ef31-50b7-45a2-95db-d98b4d8449d7 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:15.243349 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a000317-3227-4e33-9068-e55ef7ba7e99 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:15.274205 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08ef31-50b7-45a2-95db-d98b4d8449d7 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:15.279099 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aaaca5-ff83-4b4e-b3b2-5b7cbde8630f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:15.280056 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aaaca5-ff83-4b4e-b3b2-5b7cbde8630f None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:15.280561 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aaaca5-ff83-4b4e-b3b2-5b7cbde8630f None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:15.281034 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aaaca5-ff83-4b4e-b3b2-5b7cbde8630f None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:15.281986 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aaaca5-ff83-4b4e-b3b2-5b7cbde8630f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:15.282486 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aaaca5-ff83-4b4e-b3b2-5b7cbde8630f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:15.284111 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aaaca5-ff83-4b4e-b3b2-5b7cbde8630f None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:15.294238 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 184/373] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:56:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:15.299341 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aaaca5-ff83-4b4e-b3b2-5b7cbde8630f None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:15.311382 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4ad53-bcc3-48eb-a86b-f6998a6c58ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:15.312591 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4ad53-bcc3-48eb-a86b-f6998a6c58ae None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:15.312591 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4ad53-bcc3-48eb-a86b-f6998a6c58ae None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:15.312861 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4ad53-bcc3-48eb-a86b-f6998a6c58ae None admin] PATH_INFO: `/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:15.314099 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4ad53-bcc3-48eb-a86b-f6998a6c58ae None admin] RBAC: Authorizing `identity:get_project(project_id=fdcba3bc2cf94d4683c633c879cc7d25)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:15.315588 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4ad53-bcc3-48eb-a86b-f6998a6c58ae None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:15.317793 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 190/374] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:56:15 2022] GET /identity/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:15.323152 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4ad53-bcc3-48eb-a86b-f6998a6c58ae None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:15.439997 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4ad53-bcc3-48eb-a86b-f6998a6c58ae None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:15.484438 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea08f4-2627-4f02-8c05-af2f712babb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:15.485576 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea08f4-2627-4f02-8c05-af2f712babb6 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:15.486000 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea08f4-2627-4f02-8c05-af2f712babb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:15.486411 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea08f4-2627-4f02-8c05-af2f712babb6 None admin] PATH_INFO: `/v3/groups/63f30dde633b4babae3c8e5a6b5efa4e` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:15.488860 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ea08f4-2627-4f02-8c05-af2f712babb6 None admin] RBAC: Authorizing `identity:get_group(group_id=63f30dde633b4babae3c8e5a6b5efa4e)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:15.490501 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ea08f4-2627-4f02-8c05-af2f712babb6 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:15.496380 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 191/375] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Mar 10 03:56:15 2022] GET /identity/v3/groups/63f30dde633b4babae3c8e5a6b5efa4e => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:56:15.502267 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea08f4-2627-4f02-8c05-af2f712babb6 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:15.503062 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aaaca5-ff83-4b4e-b3b2-5b7cbde8630f None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:15.587348 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66b8e6-42d5-4793-afc4-0d91dd998bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:15.588330 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66b8e6-42d5-4793-afc4-0d91dd998bcd None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:15.588751 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66b8e6-42d5-4793-afc4-0d91dd998bcd None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:15.589202 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66b8e6-42d5-4793-afc4-0d91dd998bcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:15.684520 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea08f4-2627-4f02-8c05-af2f712babb6 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:15.731622 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66b8e6-42d5-4793-afc4-0d91dd998bcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:15.733134 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66b8e6-42d5-4793-afc4-0d91dd998bcd None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:15.743724 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66909302-fed5-40ba-9cab-cb96c6697a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:15.744374 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66909302-fed5-40ba-9cab-cb96c6697a02 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:15.744658 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66909302-fed5-40ba-9cab-cb96c6697a02 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:15.744938 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66909302-fed5-40ba-9cab-cb96c6697a02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:15.745767 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66909302-fed5-40ba-9cab-cb96c6697a02 None admin] RBAC: Adding query filter params (group.id=63f30dde633b4babae3c8e5a6b5efa4e, role.id=c38b04db9cd34eeaaaa8d2a6425c05ad, scope.project.id=fdcba3bc2cf94d4683c633c879cc7d25) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:15.746077 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66909302-fed5-40ba-9cab-cb96c6697a02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:15.747494 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66909302-fed5-40ba-9cab-cb96c6697a02 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:15.765934 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 192/376] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Mar 10 03:56:15 2022] GET /identity/v3/role_assignments?group.id=63f30dde633b4babae3c8e5a6b5efa4e&scope.project.id=fdcba3bc2cf94d4683c633c879cc7d25&role.id=c38b04db9cd34eeaaaa8d2a6425c05ad => generated 260 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:56:15.905946 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 185/377] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:56:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:56:15.911244 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66909302-fed5-40ba-9cab-cb96c6697a02 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:16.028026 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66909302-fed5-40ba-9cab-cb96c6697a02 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:16.065085 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f46f0-e4f5-4f15-bf70-47a97dfd213a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:16.065962 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f46f0-e4f5-4f15-bf70-47a97dfd213a None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:16.066252 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f46f0-e4f5-4f15-bf70-47a97dfd213a None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:16.067077 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f46f0-e4f5-4f15-bf70-47a97dfd213a None admin] PATH_INFO: `/v3/projects/15f699ac2a074d6bb8d9dc62578c5328` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:16.068576 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f46f0-e4f5-4f15-bf70-47a97dfd213a None admin] RBAC: Authorizing `identity:get_project(project_id=15f699ac2a074d6bb8d9dc62578c5328)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:16.070002 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f46f0-e4f5-4f15-bf70-47a97dfd213a None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:16.071697 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 193/378] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:56:15 2022] GET /identity/v3/projects/15f699ac2a074d6bb8d9dc62578c5328 => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:16.079434 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66b8e6-42d5-4793-afc4-0d91dd998bcd None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:16.086065 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd8a0b-ad4f-4f98-8fd1-ed4a7822adc3 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:16.086355 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd8a0b-ad4f-4f98-8fd1-ed4a7822adc3 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:16.086632 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd8a0b-ad4f-4f98-8fd1-ed4a7822adc3 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:16.088701 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 194/379] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:16.093927 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03148d0a-c4bc-47dc-aade-7d3c17e9eb39 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:16.094218 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03148d0a-c4bc-47dc-aade-7d3c17e9eb39 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:16.094499 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03148d0a-c4bc-47dc-aade-7d3c17e9eb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:16.124160 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-03148d0a-c4bc-47dc-aade-7d3c17e9eb39 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:16.125352 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-03148d0a-c4bc-47dc-aade-7d3c17e9eb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:16.252533 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 195/380] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 03:56:16.260950 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66b8e6-42d5-4793-afc4-0d91dd998bcd None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:16.287421 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03148d0a-c4bc-47dc-aade-7d3c17e9eb39 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:16.316421 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591ab14-a0e9-46cc-9202-e6ce2a3dc68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:16.317834 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591ab14-a0e9-46cc-9202-e6ce2a3dc68d None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:16.318375 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591ab14-a0e9-46cc-9202-e6ce2a3dc68d None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:16.318648 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591ab14-a0e9-46cc-9202-e6ce2a3dc68d None admin] PATH_INFO: `/v3/groups/7b930d92089543c29ce86563b776f17d` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:16.331182 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591ab14-a0e9-46cc-9202-e6ce2a3dc68d None admin] RBAC: Authorizing `identity:get_group(group_id=7b930d92089543c29ce86563b776f17d)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:16.332722 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591ab14-a0e9-46cc-9202-e6ce2a3dc68d None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:16.334431 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 186/381] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Mar 10 03:56:16 2022] GET /identity/v3/groups/7b930d92089543c29ce86563b776f17d => generated 229 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:16.341084 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591ab14-a0e9-46cc-9202-e6ce2a3dc68d None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:16.473032 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03148d0a-c4bc-47dc-aade-7d3c17e9eb39 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:16.536573 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591ab14-a0e9-46cc-9202-e6ce2a3dc68d None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:16.545720 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b9514-3e6c-4e8a-bfa4-78d4a269aa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:16.545950 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b9514-3e6c-4e8a-bfa4-78d4a269aa41 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:16.546189 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b9514-3e6c-4e8a-bfa4-78d4a269aa41 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:16.546351 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b9514-3e6c-4e8a-bfa4-78d4a269aa41 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:16.569734 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b9514-3e6c-4e8a-bfa4-78d4a269aa41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:16.577293 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-9d0b9514-3e6c-4e8a-bfa4-78d4a269aa41 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 10 03:56:16.578515 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 196/382] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Mar 10 03:56:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:56:16.581235 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0772a32-847d-4b71-877a-e2ba3632f65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:16.582152 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0772a32-847d-4b71-877a-e2ba3632f65c None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:16.582636 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0772a32-847d-4b71-877a-e2ba3632f65c None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:16.583204 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0772a32-847d-4b71-877a-e2ba3632f65c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:16.584259 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b9514-3e6c-4e8a-bfa4-78d4a269aa41 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:16.584446 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0772a32-847d-4b71-877a-e2ba3632f65c None admin] RBAC: Adding query filter params (group.id=7b930d92089543c29ce86563b776f17d, role.id=a8b2a5887cec4a31b7304792af3dd3f1, scope.project.id=15f699ac2a074d6bb8d9dc62578c5328) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:16.584952 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0772a32-847d-4b71-877a-e2ba3632f65c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:16.586572 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0772a32-847d-4b71-877a-e2ba3632f65c None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:16.595068 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 187/383] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Mar 10 03:56:16 2022] GET /identity/v3/role_assignments?group.id=7b930d92089543c29ce86563b776f17d&scope.project.id=15f699ac2a074d6bb8d9dc62578c5328&role.id=a8b2a5887cec4a31b7304792af3dd3f1 => generated 260 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:16.698994 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b9514-3e6c-4e8a-bfa4-78d4a269aa41 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:16.738189 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcede55-6cf7-482e-bcae-92794d2119b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:16.739494 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcede55-6cf7-482e-bcae-92794d2119b6 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:16.739803 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcede55-6cf7-482e-bcae-92794d2119b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:16.740077 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcede55-6cf7-482e-bcae-92794d2119b6 None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:16.740826 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcede55-6cf7-482e-bcae-92794d2119b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:16.741129 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcede55-6cf7-482e-bcae-92794d2119b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:16.742495 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcede55-6cf7-482e-bcae-92794d2119b6 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:16.751410 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 197/384] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:56:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:16.757412 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0772a32-847d-4b71-877a-e2ba3632f65c None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:16.875800 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0772a32-847d-4b71-877a-e2ba3632f65c None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:16.911414 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48151d6-64e6-40f6-b4f3-15610e98383a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:16.912680 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48151d6-64e6-40f6-b4f3-15610e98383a None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:16.913156 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48151d6-64e6-40f6-b4f3-15610e98383a None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:16.913640 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48151d6-64e6-40f6-b4f3-15610e98383a None admin] PATH_INFO: `/v3/groups/63f30dde633b4babae3c8e5a6b5efa4e` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:16.915014 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48151d6-64e6-40f6-b4f3-15610e98383a None admin] RBAC: Authorizing `identity:get_group(group_id=63f30dde633b4babae3c8e5a6b5efa4e)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:16.916893 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48151d6-64e6-40f6-b4f3-15610e98383a None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:16.919039 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 188/385] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Mar 10 03:56:16 2022] GET /identity/v3/groups/63f30dde633b4babae3c8e5a6b5efa4e => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:16.927711 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcede55-6cf7-482e-bcae-92794d2119b6 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:17.032497 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132d48e-4424-4c1a-b9d2-67049e6ea024 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:17.033150 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132d48e-4424-4c1a-b9d2-67049e6ea024 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:17.033625 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132d48e-4424-4c1a-b9d2-67049e6ea024 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:17.039793 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 189/386] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:17.041956 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e41488-6631-4a14-86bc-3bd817e218d4 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:17.042474 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e41488-6631-4a14-86bc-3bd817e218d4 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:17.042943 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e41488-6631-4a14-86bc-3bd817e218d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:17.071826 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-32e41488-6631-4a14-86bc-3bd817e218d4 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:17.076731 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-32e41488-6631-4a14-86bc-3bd817e218d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:17.101137 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcede55-6cf7-482e-bcae-92794d2119b6 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:17.177505 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cecce-8fa5-434c-8f48-8ee726b38735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:17.178282 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cecce-8fa5-434c-8f48-8ee726b38735 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:17.178608 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cecce-8fa5-434c-8f48-8ee726b38735 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:17.178881 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cecce-8fa5-434c-8f48-8ee726b38735 None admin] PATH_INFO: `/v3/projects/296b04835db8494cbdfa27b87fe62760` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:17.184408 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6cecce-8fa5-434c-8f48-8ee726b38735 None admin] RBAC: Authorizing `identity:get_project(project_id=296b04835db8494cbdfa27b87fe62760)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:17.185857 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6cecce-8fa5-434c-8f48-8ee726b38735 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:17.191705 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 198/388] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:56:16 2022] GET /identity/v3/projects/296b04835db8494cbdfa27b87fe62760 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:56:17.192023 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 190/388] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 03:56:17.193534 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cecce-8fa5-434c-8f48-8ee726b38735 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:17.212044 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e41488-6631-4a14-86bc-3bd817e218d4 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:17.316163 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e41488-6631-4a14-86bc-3bd817e218d4 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:17.317649 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cecce-8fa5-434c-8f48-8ee726b38735 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:17.352627 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d9c3c-a428-425c-9d7b-5bf77c4624e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:17.353764 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d9c3c-a428-425c-9d7b-5bf77c4624e8 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:17.354089 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b74e8-3c98-4281-837d-e44f0a1260ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:17.354480 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d9c3c-a428-425c-9d7b-5bf77c4624e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:17.354960 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d9c3c-a428-425c-9d7b-5bf77c4624e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:17.355072 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b74e8-3c98-4281-837d-e44f0a1260ee None admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:17.355239 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b74e8-3c98-4281-837d-e44f0a1260ee None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:17.355706 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b74e8-3c98-4281-837d-e44f0a1260ee None admin] PATH_INFO: `/v3/projects/296b04835db8494cbdfa27b87fe62760/groups/63f30dde633b4babae3c8e5a6b5efa4e/roles/c38b04db9cd34eeaaaa8d2a6425c05ad` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:17.361517 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b74e8-3c98-4281-837d-e44f0a1260ee None admin] RBAC: Authorizing `identity:create_grant(project_id=296b04835db8494cbdfa27b87fe62760, group_id=63f30dde633b4babae3c8e5a6b5efa4e, role_id=c38b04db9cd34eeaaaa8d2a6425c05ad)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:17.363417 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b74e8-3c98-4281-837d-e44f0a1260ee None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:17.366923 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d9c3c-a428-425c-9d7b-5bf77c4624e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:17.374915 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-1b7d9c3c-a428-425c-9d7b-5bf77c4624e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 03:56:17.379846 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 191/389] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:56:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:17.384306 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d9c3c-a428-425c-9d7b-5bf77c4624e8 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:17.395491 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 199/390] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Mar 10 03:56:17 2022] PUT /identity/v3/projects/296b04835db8494cbdfa27b87fe62760/groups/63f30dde633b4babae3c8e5a6b5efa4e/roles/c38b04db9cd34eeaaaa8d2a6425c05ad => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 03:56:17.493325 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d9c3c-a428-425c-9d7b-5bf77c4624e8 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:17.530455 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee889a-20c2-4f70-990f-b5fc9a46d40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:17.531547 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee889a-20c2-4f70-990f-b5fc9a46d40e None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:17.532097 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee889a-20c2-4f70-990f-b5fc9a46d40e None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:17.532560 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee889a-20c2-4f70-990f-b5fc9a46d40e None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:17.533610 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee889a-20c2-4f70-990f-b5fc9a46d40e None admin] RBAC: Adding query filter params (name=member) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:17.534111 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee889a-20c2-4f70-990f-b5fc9a46d40e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:17.535811 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee889a-20c2-4f70-990f-b5fc9a46d40e None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:17.546358 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 192/391] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Mar 10 03:56:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:17.556808 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b74e8-3c98-4281-837d-e44f0a1260ee None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:17.696082 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b74e8-3c98-4281-837d-e44f0a1260ee None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:17.732571 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585196af-1d72-45ea-b797-6104e09c766c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:17.733427 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585196af-1d72-45ea-b797-6104e09c766c None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:17.733708 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585196af-1d72-45ea-b797-6104e09c766c None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:17.733979 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585196af-1d72-45ea-b797-6104e09c766c None admin] PATH_INFO: `/v3/groups/63f30dde633b4babae3c8e5a6b5efa4e` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:17.736792 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585196af-1d72-45ea-b797-6104e09c766c None admin] RBAC: Authorizing `identity:get_group(group_id=63f30dde633b4babae3c8e5a6b5efa4e)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:17.738837 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585196af-1d72-45ea-b797-6104e09c766c None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:17.740825 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 200/392] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Mar 10 03:56:17 2022] GET /identity/v3/groups/63f30dde633b4babae3c8e5a6b5efa4e => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:17.746244 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee889a-20c2-4f70-990f-b5fc9a46d40e None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:17.860970 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee889a-20c2-4f70-990f-b5fc9a46d40e None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:17.901668 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663552cc-83e5-4f0b-aab7-164ff39b0349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:17.902533 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663552cc-83e5-4f0b-aab7-164ff39b0349 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:17.902812 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663552cc-83e5-4f0b-aab7-164ff39b0349 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:17.903086 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663552cc-83e5-4f0b-aab7-164ff39b0349 None admin] PATH_INFO: `/v3/projects/296b04835db8494cbdfa27b87fe62760` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:17.908437 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663552cc-83e5-4f0b-aab7-164ff39b0349 None admin] RBAC: Authorizing `identity:get_project(project_id=296b04835db8494cbdfa27b87fe62760)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:17.909950 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663552cc-83e5-4f0b-aab7-164ff39b0349 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:17.911994 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 193/393] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:56:17 2022] GET /identity/v3/projects/296b04835db8494cbdfa27b87fe62760 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:17.918855 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585196af-1d72-45ea-b797-6104e09c766c None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:18.038857 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585196af-1d72-45ea-b797-6104e09c766c None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:18.077438 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e2ac3-2cea-4161-8fd2-c96747e69d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:18.078316 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e2ac3-2cea-4161-8fd2-c96747e69d02 None admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:18.078593 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e2ac3-2cea-4161-8fd2-c96747e69d02 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:18.078864 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e2ac3-2cea-4161-8fd2-c96747e69d02 None admin] PATH_INFO: `/v3/projects/296b04835db8494cbdfa27b87fe62760/groups/63f30dde633b4babae3c8e5a6b5efa4e/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:18.080834 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e2ac3-2cea-4161-8fd2-c96747e69d02 None admin] RBAC: Authorizing `identity:create_grant(project_id=296b04835db8494cbdfa27b87fe62760, group_id=63f30dde633b4babae3c8e5a6b5efa4e, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:18.082296 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e2ac3-2cea-4161-8fd2-c96747e69d02 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:18.099774 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 201/394] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Mar 10 03:56:17 2022] PUT /identity/v3/projects/296b04835db8494cbdfa27b87fe62760/groups/63f30dde633b4babae3c8e5a6b5efa4e/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 03:56:18.327388 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f2c89-fb18-4de7-b9cb-74c6ccc696cf None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:18.327782 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f2c89-fb18-4de7-b9cb-74c6ccc696cf None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:18.327957 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f2c89-fb18-4de7-b9cb-74c6ccc696cf None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:18.330070 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 194/395] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:18.335610 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba040db-a759-4342-8959-c3f79331d56e None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:18.335928 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba040db-a759-4342-8959-c3f79331d56e None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:18.336207 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba040db-a759-4342-8959-c3f79331d56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:18.359860 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-1ba040db-a759-4342-8959-c3f79331d56e None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:18.361065 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-1ba040db-a759-4342-8959-c3f79331d56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:18.445718 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 202/396] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:18.468403 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f2c89-fb18-4de7-b9cb-74c6ccc696cf None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:18.580986 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f2c89-fb18-4de7-b9cb-74c6ccc696cf None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:18.620047 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a715b-fecc-40f1-877a-2689c0c7ea6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:18.620898 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a715b-fecc-40f1-877a-2689c0c7ea6f None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:18.621178 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a715b-fecc-40f1-877a-2689c0c7ea6f None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:18.621445 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a715b-fecc-40f1-877a-2689c0c7ea6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:18.638071 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a715b-fecc-40f1-877a-2689c0c7ea6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:18.645659 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-309a715b-fecc-40f1-877a-2689c0c7ea6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 03:56:18.647183 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 195/397] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:56:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:56:18.652679 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba040db-a759-4342-8959-c3f79331d56e None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:18.752521 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba040db-a759-4342-8959-c3f79331d56e None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:18.786707 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06da5d-69c1-412a-aecd-c99b51b5bf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:18.787377 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06da5d-69c1-412a-aecd-c99b51b5bf02 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:18.787657 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06da5d-69c1-412a-aecd-c99b51b5bf02 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:18.787957 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06da5d-69c1-412a-aecd-c99b51b5bf02 None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:18.788707 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06da5d-69c1-412a-aecd-c99b51b5bf02 None admin] RBAC: Adding query filter params (name=member) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:18.789008 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06da5d-69c1-412a-aecd-c99b51b5bf02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:18.790484 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06da5d-69c1-412a-aecd-c99b51b5bf02 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:18.799390 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 203/398] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Mar 10 03:56:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:18.804816 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a715b-fecc-40f1-877a-2689c0c7ea6f None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:18.919548 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a715b-fecc-40f1-877a-2689c0c7ea6f None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:18.963671 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5884a28-c75f-4fad-8f05-ba31a7135fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:18.964559 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5884a28-c75f-4fad-8f05-ba31a7135fdb None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:18.964838 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5884a28-c75f-4fad-8f05-ba31a7135fdb None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:18.965113 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5884a28-c75f-4fad-8f05-ba31a7135fdb None admin] PATH_INFO: `/v3/groups/63f30dde633b4babae3c8e5a6b5efa4e` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:18.966272 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5884a28-c75f-4fad-8f05-ba31a7135fdb None admin] RBAC: Authorizing `identity:get_group(group_id=63f30dde633b4babae3c8e5a6b5efa4e)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:18.967714 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5884a28-c75f-4fad-8f05-ba31a7135fdb None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:18.969308 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 196/399] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Mar 10 03:56:18 2022] GET /identity/v3/groups/63f30dde633b4babae3c8e5a6b5efa4e => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:18.974713 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06da5d-69c1-412a-aecd-c99b51b5bf02 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:19.077107 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06da5d-69c1-412a-aecd-c99b51b5bf02 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:19.111250 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1659d-7114-45df-b0fa-cd49c26472dc None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:19.111549 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1659d-7114-45df-b0fa-cd49c26472dc None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:19.111833 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1659d-7114-45df-b0fa-cd49c26472dc None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:19.114233 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 197/400] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 03:56:19.115287 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c55bc7-7bf1-4ea3-b8c0-f4f414c87ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:19.115813 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c55bc7-7bf1-4ea3-b8c0-f4f414c87ff7 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:19.116099 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c55bc7-7bf1-4ea3-b8c0-f4f414c87ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:19.116371 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c55bc7-7bf1-4ea3-b8c0-f4f414c87ff7 None admin] PATH_INFO: `/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:19.117574 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c55bc7-7bf1-4ea3-b8c0-f4f414c87ff7 None admin] RBAC: Authorizing `identity:get_project(project_id=fdcba3bc2cf94d4683c633c879cc7d25)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:19.121114 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c55bc7-7bf1-4ea3-b8c0-f4f414c87ff7 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:19.121216 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761a726-f58a-4eec-b28d-b0e118768d35 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:19.121216 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761a726-f58a-4eec-b28d-b0e118768d35 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:19.121216 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761a726-f58a-4eec-b28d-b0e118768d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:19.121400 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 204/401] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:56:18 2022] GET /identity/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:19.126387 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c55bc7-7bf1-4ea3-b8c0-f4f414c87ff7 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:19.155595 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-5761a726-f58a-4eec-b28d-b0e118768d35 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:19.156805 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-5761a726-f58a-4eec-b28d-b0e118768d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:19.229602 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c55bc7-7bf1-4ea3-b8c0-f4f414c87ff7 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:19.263676 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcad0d-594b-41db-a75a-a4e1e39d0ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:19.264583 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcad0d-594b-41db-a75a-a4e1e39d0ea5 None admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:19.264863 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcad0d-594b-41db-a75a-a4e1e39d0ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:19.265135 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcad0d-594b-41db-a75a-a4e1e39d0ea5 None admin] PATH_INFO: `/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25/groups/63f30dde633b4babae3c8e5a6b5efa4e/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:19.267537 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcad0d-594b-41db-a75a-a4e1e39d0ea5 None admin] RBAC: Authorizing `identity:create_grant(project_id=fdcba3bc2cf94d4683c633c879cc7d25, group_id=63f30dde633b4babae3c8e5a6b5efa4e, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:19.269000 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcad0d-594b-41db-a75a-a4e1e39d0ea5 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:19.286726 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 205/402] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Mar 10 03:56:19 2022] PUT /identity/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25/groups/63f30dde633b4babae3c8e5a6b5efa4e/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 03:56:19.314606 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 198/403] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:19.354858 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcad0d-594b-41db-a75a-a4e1e39d0ea5 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:19.472117 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcad0d-594b-41db-a75a-a4e1e39d0ea5 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:19.489053 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b63bad-4509-4349-aa8d-83a367ef456f None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:19.489322 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b63bad-4509-4349-aa8d-83a367ef456f None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:19.489531 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b63bad-4509-4349-aa8d-83a367ef456f None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:19.491536 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 199/404] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:19.496987 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da48ccd-ffce-4b46-b43e-f88c1c6a0b3e None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:19.497280 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da48ccd-ffce-4b46-b43e-f88c1c6a0b3e None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:19.497547 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da48ccd-ffce-4b46-b43e-f88c1c6a0b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:19.512168 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5ff51-8893-4066-a779-f73151cea1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:19.513012 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5ff51-8893-4066-a779-f73151cea1e3 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:19.513291 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5ff51-8893-4066-a779-f73151cea1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:19.513562 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5ff51-8893-4066-a779-f73151cea1e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:19.530519 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-3da48ccd-ffce-4b46-b43e-f88c1c6a0b3e None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:19.531751 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-3da48ccd-ffce-4b46-b43e-f88c1c6a0b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:19.539433 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5ff51-8893-4066-a779-f73151cea1e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:19.554012 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-3ff5ff51-8893-4066-a779-f73151cea1e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 10 03:56:19.561794 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 206/405] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Mar 10 03:56:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:19.562867 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5ff51-8893-4066-a779-f73151cea1e3 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:19.640096 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 200/406] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 03:56:19.666057 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da48ccd-ffce-4b46-b43e-f88c1c6a0b3e None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:19.682184 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5ff51-8893-4066-a779-f73151cea1e3 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:19.727950 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965d081-f955-4303-8d22-72beba99264b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:19.728630 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965d081-f955-4303-8d22-72beba99264b None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:19.728915 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965d081-f955-4303-8d22-72beba99264b None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:19.729191 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965d081-f955-4303-8d22-72beba99264b None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:19.731118 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965d081-f955-4303-8d22-72beba99264b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:19.731424 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965d081-f955-4303-8d22-72beba99264b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:19.738242 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965d081-f955-4303-8d22-72beba99264b None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:19.755785 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 207/407] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:56:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:19.761284 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965d081-f955-4303-8d22-72beba99264b None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:19.820419 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da48ccd-ffce-4b46-b43e-f88c1c6a0b3e None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:19.866070 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadcfd7-6401-4e40-8f20-6763a462589d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:19.866888 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadcfd7-6401-4e40-8f20-6763a462589d None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:19.867172 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadcfd7-6401-4e40-8f20-6763a462589d None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:19.867447 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadcfd7-6401-4e40-8f20-6763a462589d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:19.884750 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965d081-f955-4303-8d22-72beba99264b None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:19.889075 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dadcfd7-6401-4e40-8f20-6763a462589d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:19.905271 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-5dadcfd7-6401-4e40-8f20-6763a462589d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 03:56:19.908912 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 201/408] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:56:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:56:19.915094 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadcfd7-6401-4e40-8f20-6763a462589d None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:19.933236 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6b666-7514-4dd0-90dd-50b0485eaaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:19.934098 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6b666-7514-4dd0-90dd-50b0485eaaae None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:19.934380 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6b666-7514-4dd0-90dd-50b0485eaaae None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:19.934656 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6b666-7514-4dd0-90dd-50b0485eaaae None admin] PATH_INFO: `/v3/groups/63f30dde633b4babae3c8e5a6b5efa4e` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:19.937138 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6b666-7514-4dd0-90dd-50b0485eaaae None admin] RBAC: Authorizing `identity:get_group(group_id=63f30dde633b4babae3c8e5a6b5efa4e)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:19.938566 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6b666-7514-4dd0-90dd-50b0485eaaae None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:19.940201 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 208/409] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Mar 10 03:56:19 2022] GET /identity/v3/groups/63f30dde633b4babae3c8e5a6b5efa4e => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:56:19.948600 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6b666-7514-4dd0-90dd-50b0485eaaae None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:20.073347 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadcfd7-6401-4e40-8f20-6763a462589d None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:20.123793 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6b666-7514-4dd0-90dd-50b0485eaaae None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:20.132164 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc6172-7aca-4ec7-954c-3cc002f6ecbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:20.133240 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc6172-7aca-4ec7-954c-3cc002f6ecbd None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:20.133716 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc6172-7aca-4ec7-954c-3cc002f6ecbd None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:20.134199 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc6172-7aca-4ec7-954c-3cc002f6ecbd None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:20.135168 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc6172-7aca-4ec7-954c-3cc002f6ecbd None admin] RBAC: Adding query filter params (name=admin) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:20.135742 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc6172-7aca-4ec7-954c-3cc002f6ecbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:20.137435 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc6172-7aca-4ec7-954c-3cc002f6ecbd None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:20.155563 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 202/410] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:56:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:56:20.162533 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc6172-7aca-4ec7-954c-3cc002f6ecbd None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:20.162908 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7465627-32c0-4056-8b92-4cd670ef18b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:20.163799 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7465627-32c0-4056-8b92-4cd670ef18b8 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:20.164085 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7465627-32c0-4056-8b92-4cd670ef18b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:20.164361 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7465627-32c0-4056-8b92-4cd670ef18b8 None admin] PATH_INFO: `/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:20.165552 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7465627-32c0-4056-8b92-4cd670ef18b8 None admin] RBAC: Authorizing `identity:get_project(project_id=fdcba3bc2cf94d4683c633c879cc7d25)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:20.166994 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7465627-32c0-4056-8b92-4cd670ef18b8 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:20.168842 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 209/411] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:56:19 2022] GET /identity/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:20.174250 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7465627-32c0-4056-8b92-4cd670ef18b8 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:20.290066 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc6172-7aca-4ec7-954c-3cc002f6ecbd None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:20.318608 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7465627-32c0-4056-8b92-4cd670ef18b8 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:20.329062 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5cad1-3116-4aec-a774-399d99ac783a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:20.330226 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5cad1-3116-4aec-a774-399d99ac783a None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:20.330701 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5cad1-3116-4aec-a774-399d99ac783a None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:20.331171 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5cad1-3116-4aec-a774-399d99ac783a None admin] PATH_INFO: `/v3/groups/7b930d92089543c29ce86563b776f17d` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:20.334979 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5cad1-3116-4aec-a774-399d99ac783a None admin] RBAC: Authorizing `identity:get_group(group_id=7b930d92089543c29ce86563b776f17d)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:20.336663 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5cad1-3116-4aec-a774-399d99ac783a None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:20.339616 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 203/412] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Mar 10 03:56:20 2022] GET /identity/v3/groups/7b930d92089543c29ce86563b776f17d => generated 229 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:56:20.348685 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5cad1-3116-4aec-a774-399d99ac783a None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:20.389512 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb5157-d3bc-4c5d-bb0c-b13e2258053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:20.390787 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb5157-d3bc-4c5d-bb0c-b13e2258053c None admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:20.391295 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb5157-d3bc-4c5d-bb0c-b13e2258053c None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:20.391781 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb5157-d3bc-4c5d-bb0c-b13e2258053c None admin] PATH_INFO: `/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25/groups/63f30dde633b4babae3c8e5a6b5efa4e/roles/c38b04db9cd34eeaaaa8d2a6425c05ad` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:20.394196 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb5157-d3bc-4c5d-bb0c-b13e2258053c None admin] RBAC: Authorizing `identity:create_grant(project_id=fdcba3bc2cf94d4683c633c879cc7d25, group_id=63f30dde633b4babae3c8e5a6b5efa4e, role_id=c38b04db9cd34eeaaaa8d2a6425c05ad)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:20.396479 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb5157-d3bc-4c5d-bb0c-b13e2258053c None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:20.422095 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 210/413] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Mar 10 03:56:20 2022] PUT /identity/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25/groups/63f30dde633b4babae3c8e5a6b5efa4e/roles/c38b04db9cd34eeaaaa8d2a6425c05ad => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 03:56:20.477342 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5cad1-3116-4aec-a774-399d99ac783a None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:20.522736 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6c625-6295-4dc7-b5bd-8dd30588e16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:20.523715 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6c625-6295-4dc7-b5bd-8dd30588e16b None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:20.524008 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6c625-6295-4dc7-b5bd-8dd30588e16b None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:20.524332 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6c625-6295-4dc7-b5bd-8dd30588e16b None admin] PATH_INFO: `/v3/projects/15f699ac2a074d6bb8d9dc62578c5328` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:20.525695 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6c625-6295-4dc7-b5bd-8dd30588e16b None admin] RBAC: Authorizing `identity:get_project(project_id=15f699ac2a074d6bb8d9dc62578c5328)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:20.527202 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6c625-6295-4dc7-b5bd-8dd30588e16b None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:20.529372 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 204/414] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:56:20 2022] GET /identity/v3/projects/15f699ac2a074d6bb8d9dc62578c5328 => generated 344 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:20.535754 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb5157-d3bc-4c5d-bb0c-b13e2258053c None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:20.629536 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd90fec-7783-4b90-bc4d-5d9fe22cae79 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:20.629802 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd90fec-7783-4b90-bc4d-5d9fe22cae79 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:20.630008 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd90fec-7783-4b90-bc4d-5d9fe22cae79 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:20.632264 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 205/415] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:20.641090 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abcf1a-6ad7-4e53-b68f-a326ef23d3b5 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:20.641394 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abcf1a-6ad7-4e53-b68f-a326ef23d3b5 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:20.641646 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95abcf1a-6ad7-4e53-b68f-a326ef23d3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:20.666257 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-95abcf1a-6ad7-4e53-b68f-a326ef23d3b5 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:20.667351 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb5157-d3bc-4c5d-bb0c-b13e2258053c None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:20.667459 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-95abcf1a-6ad7-4e53-b68f-a326ef23d3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:20.708529 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b080b9-745f-43c8-8bff-b4b5d95bb572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:20.709432 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b080b9-745f-43c8-8bff-b4b5d95bb572 None admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:20.709714 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b080b9-745f-43c8-8bff-b4b5d95bb572 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:20.709987 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b080b9-745f-43c8-8bff-b4b5d95bb572 None admin] PATH_INFO: `/v3/projects/15f699ac2a074d6bb8d9dc62578c5328/groups/7b930d92089543c29ce86563b776f17d/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:20.713096 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b080b9-745f-43c8-8bff-b4b5d95bb572 None admin] RBAC: Authorizing `identity:create_grant(project_id=15f699ac2a074d6bb8d9dc62578c5328, group_id=7b930d92089543c29ce86563b776f17d, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:20.714611 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b080b9-745f-43c8-8bff-b4b5d95bb572 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:20.732380 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 211/416] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Mar 10 03:56:20 2022] PUT /identity/v3/projects/15f699ac2a074d6bb8d9dc62578c5328/groups/7b930d92089543c29ce86563b776f17d/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 03:56:20.751715 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 206/417] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 03:56:20.794836 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b080b9-745f-43c8-8bff-b4b5d95bb572 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:20.907808 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b080b9-745f-43c8-8bff-b4b5d95bb572 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:20.950059 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5e44a-0bb2-4a69-9e90-35af36523cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:20.950950 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5e44a-0bb2-4a69-9e90-35af36523cea None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:20.951236 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5e44a-0bb2-4a69-9e90-35af36523cea None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:20.951508 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5e44a-0bb2-4a69-9e90-35af36523cea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:20.964160 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a5e44a-0bb2-4a69-9e90-35af36523cea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:20.971648 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-91a5e44a-0bb2-4a69-9e90-35af36523cea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 10 03:56:20.973469 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 212/418] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Mar 10 03:56:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:20.979651 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abcf1a-6ad7-4e53-b68f-a326ef23d3b5 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:21.141819 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95abcf1a-6ad7-4e53-b68f-a326ef23d3b5 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:21.189316 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15205eda-dbcb-4537-8bb5-07aab0eb4972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:21.189910 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15205eda-dbcb-4537-8bb5-07aab0eb4972 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:21.190190 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15205eda-dbcb-4537-8bb5-07aab0eb4972 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:21.190464 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15205eda-dbcb-4537-8bb5-07aab0eb4972 None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:21.191201 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15205eda-dbcb-4537-8bb5-07aab0eb4972 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:21.192035 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15205eda-dbcb-4537-8bb5-07aab0eb4972 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:21.193657 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15205eda-dbcb-4537-8bb5-07aab0eb4972 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:21.207544 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 207/419] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:56:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:21.212842 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5e44a-0bb2-4a69-9e90-35af36523cea None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:21.318410 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5e44a-0bb2-4a69-9e90-35af36523cea None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:21.358232 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00077a24-aaf9-4aaa-b3be-72427d4860f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:21.358889 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00077a24-aaf9-4aaa-b3be-72427d4860f2 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:21.359174 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00077a24-aaf9-4aaa-b3be-72427d4860f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:21.359451 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00077a24-aaf9-4aaa-b3be-72427d4860f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:21.372927 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89f3a3-bd99-4f74-a73a-1ecb77642709 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:21.373218 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89f3a3-bd99-4f74-a73a-1ecb77642709 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:21.373501 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89f3a3-bd99-4f74-a73a-1ecb77642709 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:21.375342 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 208/420] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 03:56:21.383193 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50cce2-e9a0-49f1-9ce4-da74370dd554 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:21.385523 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50cce2-e9a0-49f1-9ce4-da74370dd554 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:21.386002 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50cce2-e9a0-49f1-9ce4-da74370dd554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:21.414696 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-5f50cce2-e9a0-49f1-9ce4-da74370dd554 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:21.417306 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-5f50cce2-e9a0-49f1-9ce4-da74370dd554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:21.465746 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00077a24-aaf9-4aaa-b3be-72427d4860f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:21.467628 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00077a24-aaf9-4aaa-b3be-72427d4860f2 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:21.559503 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 209/421] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 03:56:21.603464 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 213/422] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:56:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:56:21.608605 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50cce2-e9a0-49f1-9ce4-da74370dd554 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:21.641952 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00077a24-aaf9-4aaa-b3be-72427d4860f2 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:21.771482 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50cce2-e9a0-49f1-9ce4-da74370dd554 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:21.807223 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00077a24-aaf9-4aaa-b3be-72427d4860f2 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:21.832881 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21fd37-3166-4b8e-8e99-0a1bc61cb4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:21.833752 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21fd37-3166-4b8e-8e99-0a1bc61cb4d1 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:21.834037 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21fd37-3166-4b8e-8e99-0a1bc61cb4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:21.834318 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21fd37-3166-4b8e-8e99-0a1bc61cb4d1 None admin] PATH_INFO: `/v3/projects/296b04835db8494cbdfa27b87fe62760` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:21.838153 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21fd37-3166-4b8e-8e99-0a1bc61cb4d1 None admin] RBAC: Authorizing `identity:get_project(project_id=296b04835db8494cbdfa27b87fe62760)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:21.839608 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21fd37-3166-4b8e-8e99-0a1bc61cb4d1 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:21.841367 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 210/423] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:56:21 2022] GET /identity/v3/projects/296b04835db8494cbdfa27b87fe62760 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:21.848590 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21fd37-3166-4b8e-8e99-0a1bc61cb4d1 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:21.883242 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851faaf0-d979-43f5-8038-bf2da5c9c425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:21.884087 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851faaf0-d979-43f5-8038-bf2da5c9c425 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:21.884374 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851faaf0-d979-43f5-8038-bf2da5c9c425 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:21.884651 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851faaf0-d979-43f5-8038-bf2da5c9c425 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:21.916677 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851faaf0-d979-43f5-8038-bf2da5c9c425 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:21.931953 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-851faaf0-d979-43f5-8038-bf2da5c9c425 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 03:56:21.933527 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 214/424] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:56:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:56:21.939077 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851faaf0-d979-43f5-8038-bf2da5c9c425 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:21.961919 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21fd37-3166-4b8e-8e99-0a1bc61cb4d1 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:22.010450 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4d5bc-37d8-45a4-a936-bb37a07cfddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:22.011376 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4d5bc-37d8-45a4-a936-bb37a07cfddb None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:22.011659 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4d5bc-37d8-45a4-a936-bb37a07cfddb None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:22.011965 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4d5bc-37d8-45a4-a936-bb37a07cfddb None admin] PATH_INFO: `/v3/groups/63f30dde633b4babae3c8e5a6b5efa4e` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:22.013322 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4d5bc-37d8-45a4-a936-bb37a07cfddb None admin] RBAC: Authorizing `identity:get_group(group_id=63f30dde633b4babae3c8e5a6b5efa4e)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:22.014767 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4d5bc-37d8-45a4-a936-bb37a07cfddb None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:22.020994 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 211/425] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Mar 10 03:56:21 2022] GET /identity/v3/groups/63f30dde633b4babae3c8e5a6b5efa4e => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:22.022763 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4d5bc-37d8-45a4-a936-bb37a07cfddb None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:22.115304 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851faaf0-d979-43f5-8038-bf2da5c9c425 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:22.155184 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4d5bc-37d8-45a4-a936-bb37a07cfddb None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:22.194209 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e26e8-ab9d-4e6c-86d2-4ea00ebc4566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:22.194872 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e26e8-ab9d-4e6c-86d2-4ea00ebc4566 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:22.195152 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e26e8-ab9d-4e6c-86d2-4ea00ebc4566 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:22.195425 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e26e8-ab9d-4e6c-86d2-4ea00ebc4566 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:22.196278 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e26e8-ab9d-4e6c-86d2-4ea00ebc4566 None admin] RBAC: Adding query filter params (group.id=63f30dde633b4babae3c8e5a6b5efa4e, role.id=c38b04db9cd34eeaaaa8d2a6425c05ad, scope.project.id=296b04835db8494cbdfa27b87fe62760) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:22.196587 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e26e8-ab9d-4e6c-86d2-4ea00ebc4566 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:22.198228 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e26e8-ab9d-4e6c-86d2-4ea00ebc4566 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:22.202027 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d61be8-f4f1-4443-ae23-8f1e1ad40ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:22.202700 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d61be8-f4f1-4443-ae23-8f1e1ad40ea6 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:22.202980 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d61be8-f4f1-4443-ae23-8f1e1ad40ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:22.203264 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d61be8-f4f1-4443-ae23-8f1e1ad40ea6 None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:22.204030 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d61be8-f4f1-4443-ae23-8f1e1ad40ea6 None admin] RBAC: Adding query filter params (name=member) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:22.204343 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d61be8-f4f1-4443-ae23-8f1e1ad40ea6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:22.205699 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d61be8-f4f1-4443-ae23-8f1e1ad40ea6 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:22.213109 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 212/426] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Mar 10 03:56:22 2022] GET /identity/v3/role_assignments?group.id=63f30dde633b4babae3c8e5a6b5efa4e&scope.project.id=296b04835db8494cbdfa27b87fe62760&role.id=c38b04db9cd34eeaaaa8d2a6425c05ad => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:22.219894 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 215/427] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Mar 10 03:56:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:56:22.225673 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e26e8-ab9d-4e6c-86d2-4ea00ebc4566 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:22.330647 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248e4f5-de23-467a-8da6-9d9ca2f717a2 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:22.330968 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248e4f5-de23-467a-8da6-9d9ca2f717a2 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:22.331205 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248e4f5-de23-467a-8da6-9d9ca2f717a2 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:22.333820 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 216/428] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:22.338796 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e26e8-ab9d-4e6c-86d2-4ea00ebc4566 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:22.345228 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d7f50-bfa9-4ea6-818e-2b8b305a0f62 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:22.345513 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d7f50-bfa9-4ea6-818e-2b8b305a0f62 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:22.345775 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d7f50-bfa9-4ea6-818e-2b8b305a0f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:22.380231 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-b08d7f50-bfa9-4ea6-818e-2b8b305a0f62 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:22.381442 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-b08d7f50-bfa9-4ea6-818e-2b8b305a0f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:22.385748 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed5f3d-6aeb-4fd4-b6dd-8e7879d5df7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:22.386419 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed5f3d-6aeb-4fd4-b6dd-8e7879d5df7e None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:22.386700 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed5f3d-6aeb-4fd4-b6dd-8e7879d5df7e None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:22.386977 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed5f3d-6aeb-4fd4-b6dd-8e7879d5df7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:22.474839 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed5f3d-6aeb-4fd4-b6dd-8e7879d5df7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:22.476388 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed5f3d-6aeb-4fd4-b6dd-8e7879d5df7e None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:22.476738 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 217/429] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:22.500488 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d7f50-bfa9-4ea6-818e-2b8b305a0f62 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:22.576630 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 213/430] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:56:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:56:22.583765 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed5f3d-6aeb-4fd4-b6dd-8e7879d5df7e None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:22.605460 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d7f50-bfa9-4ea6-818e-2b8b305a0f62 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:22.651929 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e1575-a9eb-4427-865d-5e83dae30a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:22.653179 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e1575-a9eb-4427-865d-5e83dae30a9e None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:22.653462 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e1575-a9eb-4427-865d-5e83dae30a9e None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:22.653989 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e1575-a9eb-4427-865d-5e83dae30a9e None admin] PATH_INFO: `/v3/roles/member` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:22.666371 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e1575-a9eb-4427-865d-5e83dae30a9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:22.675561 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-716e1575-a9eb-4427-865d-5e83dae30a9e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 10 03:56:22.677092 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 218/431] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:56:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:56:22.682894 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e1575-a9eb-4427-865d-5e83dae30a9e None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:22.698325 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed5f3d-6aeb-4fd4-b6dd-8e7879d5df7e None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:22.742003 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58015f82-b778-4c35-9c27-51c1f3fd042a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:22.743670 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58015f82-b778-4c35-9c27-51c1f3fd042a None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:22.744135 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58015f82-b778-4c35-9c27-51c1f3fd042a None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:22.744718 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58015f82-b778-4c35-9c27-51c1f3fd042a None admin] PATH_INFO: `/v3/projects/296b04835db8494cbdfa27b87fe62760` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:22.746671 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58015f82-b778-4c35-9c27-51c1f3fd042a None admin] RBAC: Authorizing `identity:get_project(project_id=296b04835db8494cbdfa27b87fe62760)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:22.748297 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58015f82-b778-4c35-9c27-51c1f3fd042a None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:22.750815 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 214/432] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:56:22 2022] GET /identity/v3/projects/296b04835db8494cbdfa27b87fe62760 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:22.756786 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58015f82-b778-4c35-9c27-51c1f3fd042a None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:22.787482 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e1575-a9eb-4427-865d-5e83dae30a9e None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:22.823225 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba76a5-83ac-4739-90da-0f5538739b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:22.825140 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba76a5-83ac-4739-90da-0f5538739b02 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:22.825895 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba76a5-83ac-4739-90da-0f5538739b02 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:22.826376 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba76a5-83ac-4739-90da-0f5538739b02 None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:22.827324 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba76a5-83ac-4739-90da-0f5538739b02 None admin] RBAC: Adding query filter params (name=member) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:22.827864 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba76a5-83ac-4739-90da-0f5538739b02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:22.830045 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba76a5-83ac-4739-90da-0f5538739b02 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:22.841894 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 219/433] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Mar 10 03:56:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:22.848151 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba76a5-83ac-4739-90da-0f5538739b02 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:22.870626 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58015f82-b778-4c35-9c27-51c1f3fd042a None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:22.910018 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a517bd-1452-4eac-814e-8214539b8596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:22.911995 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a517bd-1452-4eac-814e-8214539b8596 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:22.912788 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a517bd-1452-4eac-814e-8214539b8596 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:22.913285 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a517bd-1452-4eac-814e-8214539b8596 None admin] PATH_INFO: `/v3/groups/63f30dde633b4babae3c8e5a6b5efa4e` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:22.915378 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a517bd-1452-4eac-814e-8214539b8596 None admin] RBAC: Authorizing `identity:get_group(group_id=63f30dde633b4babae3c8e5a6b5efa4e)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:22.917242 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a517bd-1452-4eac-814e-8214539b8596 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:22.920451 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 215/434] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Mar 10 03:56:22 2022] GET /identity/v3/groups/63f30dde633b4babae3c8e5a6b5efa4e => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:56:22.926585 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a517bd-1452-4eac-814e-8214539b8596 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:22.977382 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba76a5-83ac-4739-90da-0f5538739b02 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:23.012744 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf6ce2-fbce-4d55-b77e-1e060efe8a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:23.013749 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf6ce2-fbce-4d55-b77e-1e060efe8a3f None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:23.014242 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf6ce2-fbce-4d55-b77e-1e060efe8a3f None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:23.014725 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf6ce2-fbce-4d55-b77e-1e060efe8a3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:23.027699 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a517bd-1452-4eac-814e-8214539b8596 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:23.061641 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b240ba-4192-414e-b081-a35a8744aac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:23.062301 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b240ba-4192-414e-b081-a35a8744aac2 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:23.062584 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b240ba-4192-414e-b081-a35a8744aac2 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:23.062860 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b240ba-4192-414e-b081-a35a8744aac2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:23.063708 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b240ba-4192-414e-b081-a35a8744aac2 None admin] RBAC: Adding query filter params (group.id=63f30dde633b4babae3c8e5a6b5efa4e, role.id=73b2aee45a2d4be19addaf4a33414295, scope.project.id=296b04835db8494cbdfa27b87fe62760) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:23.064019 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b240ba-4192-414e-b081-a35a8744aac2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:23.065452 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b240ba-4192-414e-b081-a35a8744aac2 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:23.080000 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 216/435] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Mar 10 03:56:22 2022] GET /identity/v3/role_assignments?group.id=63f30dde633b4babae3c8e5a6b5efa4e&scope.project.id=296b04835db8494cbdfa27b87fe62760&role.id=73b2aee45a2d4be19addaf4a33414295 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:23.094194 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf6ce2-fbce-4d55-b77e-1e060efe8a3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:23.095756 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf6ce2-fbce-4d55-b77e-1e060efe8a3f None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:23.200051 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 220/436] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:56:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 10 03:56:23.205552 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b240ba-4192-414e-b081-a35a8744aac2 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:23.220125 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fe3f0-9f51-4372-8557-0de00387e333 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:23.220454 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fe3f0-9f51-4372-8557-0de00387e333 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:23.220681 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fe3f0-9f51-4372-8557-0de00387e333 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:23.222900 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 221/437] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:23.229225 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e2750-04e3-4e84-8b6c-7fb78ff9c91f None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:23.229504 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e2750-04e3-4e84-8b6c-7fb78ff9c91f None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:23.229777 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e2750-04e3-4e84-8b6c-7fb78ff9c91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:23.249944 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-a17e2750-04e3-4e84-8b6c-7fb78ff9c91f None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:23.251710 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-a17e2750-04e3-4e84-8b6c-7fb78ff9c91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:23.314107 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b240ba-4192-414e-b081-a35a8744aac2 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:23.328864 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 222/438] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:23.330320 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67d542-55ed-48d2-8df0-7c5096bf4309 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:23.330608 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67d542-55ed-48d2-8df0-7c5096bf4309 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:23.330882 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67d542-55ed-48d2-8df0-7c5096bf4309 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:23.332623 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 223/439] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:23.337932 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dee4fb-011c-4087-8e79-27db359ffadf None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:23.338221 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dee4fb-011c-4087-8e79-27db359ffadf None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:23.338495 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dee4fb-011c-4087-8e79-27db359ffadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:23.353764 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280238b7-e93a-47fb-8042-8eab745da870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:23.354550 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280238b7-e93a-47fb-8042-8eab745da870 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:23.354828 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280238b7-e93a-47fb-8042-8eab745da870 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:23.355101 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280238b7-e93a-47fb-8042-8eab745da870 None admin] PATH_INFO: `/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:23.355984 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-a2dee4fb-011c-4087-8e79-27db359ffadf None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:23.356796 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280238b7-e93a-47fb-8042-8eab745da870 None admin] RBAC: Authorizing `identity:get_project(project_id=fdcba3bc2cf94d4683c633c879cc7d25)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:23.357745 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280238b7-e93a-47fb-8042-8eab745da870 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:23.358090 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-a2dee4fb-011c-4087-8e79-27db359ffadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:23.359557 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 217/440] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:56:23 2022] GET /identity/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:23.360212 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280238b7-e93a-47fb-8042-8eab745da870 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:23.433178 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 224/441] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 03:56:23.434097 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dee4fb-011c-4087-8e79-27db359ffadf None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:23.472220 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280238b7-e93a-47fb-8042-8eab745da870 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:23.511085 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992f988-9ee6-43ec-9bec-d962170da3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:23.511955 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992f988-9ee6-43ec-9bec-d962170da3a6 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:23.512243 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992f988-9ee6-43ec-9bec-d962170da3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:23.512525 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992f988-9ee6-43ec-9bec-d962170da3a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:23.524344 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992f988-9ee6-43ec-9bec-d962170da3a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:23.531707 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-d992f988-9ee6-43ec-9bec-d962170da3a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 10 03:56:23.533976 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 218/442] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Mar 10 03:56:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:23.534834 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992f988-9ee6-43ec-9bec-d962170da3a6 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:23.543336 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dee4fb-011c-4087-8e79-27db359ffadf None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:23.580112 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002111a5-4675-4403-a3a4-6f76b217be0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:23.580971 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002111a5-4675-4403-a3a4-6f76b217be0a None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:23.581250 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002111a5-4675-4403-a3a4-6f76b217be0a None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:23.581524 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002111a5-4675-4403-a3a4-6f76b217be0a None admin] PATH_INFO: `/v3/groups/63f30dde633b4babae3c8e5a6b5efa4e` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:23.582720 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002111a5-4675-4403-a3a4-6f76b217be0a None admin] RBAC: Authorizing `identity:get_group(group_id=63f30dde633b4babae3c8e5a6b5efa4e)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:23.584764 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002111a5-4675-4403-a3a4-6f76b217be0a None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:23.585958 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 225/443] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Mar 10 03:56:23 2022] GET /identity/v3/groups/63f30dde633b4babae3c8e5a6b5efa4e => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:23.586551 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002111a5-4675-4403-a3a4-6f76b217be0a None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:23.643226 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992f988-9ee6-43ec-9bec-d962170da3a6 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:23.681043 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9326a0-be6e-47f8-a21f-478a695f7f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:23.681839 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9326a0-be6e-47f8-a21f-478a695f7f8b None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:23.682123 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9326a0-be6e-47f8-a21f-478a695f7f8b None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:23.682402 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9326a0-be6e-47f8-a21f-478a695f7f8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:23.692185 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9326a0-be6e-47f8-a21f-478a695f7f8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:23.694422 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002111a5-4675-4403-a3a4-6f76b217be0a None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:23.699381 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-ce9326a0-be6e-47f8-a21f-478a695f7f8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 03:56:23.700572 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 219/444] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:56:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:23.701336 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9326a0-be6e-47f8-a21f-478a695f7f8b None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:23.727116 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91013ceb-4ae4-42ba-ad2f-81c529e28b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:23.727793 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91013ceb-4ae4-42ba-ad2f-81c529e28b8b None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:23.728072 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91013ceb-4ae4-42ba-ad2f-81c529e28b8b None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:23.728345 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91013ceb-4ae4-42ba-ad2f-81c529e28b8b None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:23.729080 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91013ceb-4ae4-42ba-ad2f-81c529e28b8b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:23.729382 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91013ceb-4ae4-42ba-ad2f-81c529e28b8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:23.730715 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91013ceb-4ae4-42ba-ad2f-81c529e28b8b None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:23.738080 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 226/445] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:56:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:23.738849 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91013ceb-4ae4-42ba-ad2f-81c529e28b8b None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:23.798054 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9326a0-be6e-47f8-a21f-478a695f7f8b None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:23.828772 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36fabc1-b442-4489-8a2f-89eb0bbc860e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:23.828930 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91013ceb-4ae4-42ba-ad2f-81c529e28b8b None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:23.829414 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fabc1-b442-4489-8a2f-89eb0bbc860e None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:23.829696 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fabc1-b442-4489-8a2f-89eb0bbc860e None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:23.829972 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36fabc1-b442-4489-8a2f-89eb0bbc860e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:23.830791 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36fabc1-b442-4489-8a2f-89eb0bbc860e None admin] RBAC: Adding query filter params (group.id=63f30dde633b4babae3c8e5a6b5efa4e, role.id=73b2aee45a2d4be19addaf4a33414295, scope.project.id=fdcba3bc2cf94d4683c633c879cc7d25) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:23.831099 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36fabc1-b442-4489-8a2f-89eb0bbc860e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:23.833063 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36fabc1-b442-4489-8a2f-89eb0bbc860e None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:23.838596 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 220/446] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Mar 10 03:56:23 2022] GET /identity/v3/role_assignments?group.id=63f30dde633b4babae3c8e5a6b5efa4e&scope.project.id=fdcba3bc2cf94d4683c633c879cc7d25&role.id=73b2aee45a2d4be19addaf4a33414295 => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:23.839355 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36fabc1-b442-4489-8a2f-89eb0bbc860e None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:23.864916 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226827a-a550-4131-8ffb-9895f69aa351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:23.865605 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226827a-a550-4131-8ffb-9895f69aa351 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:23.865940 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226827a-a550-4131-8ffb-9895f69aa351 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:23.866216 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226827a-a550-4131-8ffb-9895f69aa351 None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:23.866986 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226827a-a550-4131-8ffb-9895f69aa351 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:23.867342 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226827a-a550-4131-8ffb-9895f69aa351 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:23.868987 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226827a-a550-4131-8ffb-9895f69aa351 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:23.882890 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 227/447] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:56:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:23.884092 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226827a-a550-4131-8ffb-9895f69aa351 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:23.943843 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36fabc1-b442-4489-8a2f-89eb0bbc860e None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:23.978782 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e25a36-3809-4e20-bee3-358a3b440042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:23.979448 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e25a36-3809-4e20-bee3-358a3b440042 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:23.979787 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e25a36-3809-4e20-bee3-358a3b440042 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:23.980073 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e25a36-3809-4e20-bee3-358a3b440042 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:23.994091 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226827a-a550-4131-8ffb-9895f69aa351 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:24.030610 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee8da2-ef21-48b6-9698-996b7e976477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:24.031404 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee8da2-ef21-48b6-9698-996b7e976477 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:24.031513 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee8da2-ef21-48b6-9698-996b7e976477 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:24.031836 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee8da2-ef21-48b6-9698-996b7e976477 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:24.052358 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e25a36-3809-4e20-bee3-358a3b440042 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:24.053823 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e25a36-3809-4e20-bee3-358a3b440042 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:24.105030 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee8da2-ef21-48b6-9698-996b7e976477 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:24.106489 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee8da2-ef21-48b6-9698-996b7e976477 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:24.163777 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 221/448] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:56:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:56:24.169331 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e25a36-3809-4e20-bee3-358a3b440042 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:24.212751 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 228/449] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:56:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:56:24.218525 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee8da2-ef21-48b6-9698-996b7e976477 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:24.271443 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e25a36-3809-4e20-bee3-358a3b440042 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:24.304237 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca56238-7181-48fd-9a12-a22400d9b77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:24.305095 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca56238-7181-48fd-9a12-a22400d9b77c None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:24.305379 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca56238-7181-48fd-9a12-a22400d9b77c None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:24.305650 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca56238-7181-48fd-9a12-a22400d9b77c None admin] PATH_INFO: `/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:24.306819 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca56238-7181-48fd-9a12-a22400d9b77c None admin] RBAC: Authorizing `identity:get_project(project_id=fdcba3bc2cf94d4683c633c879cc7d25)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:24.308294 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca56238-7181-48fd-9a12-a22400d9b77c None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:24.309956 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 222/450] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:56:24 2022] GET /identity/v3/projects/fdcba3bc2cf94d4683c633c879cc7d25 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:56:24.310579 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee8da2-ef21-48b6-9698-996b7e976477 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:24.315235 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca56238-7181-48fd-9a12-a22400d9b77c None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:24.342870 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa873f-38eb-4d97-af5b-47ec7ddbe3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:24.343738 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa873f-38eb-4d97-af5b-47ec7ddbe3db None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:24.344019 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa873f-38eb-4d97-af5b-47ec7ddbe3db None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:24.344298 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa873f-38eb-4d97-af5b-47ec7ddbe3db None admin] PATH_INFO: `/v3/projects/15f699ac2a074d6bb8d9dc62578c5328` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:24.345450 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa873f-38eb-4d97-af5b-47ec7ddbe3db None admin] RBAC: Authorizing `identity:get_project(project_id=15f699ac2a074d6bb8d9dc62578c5328)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:24.346860 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa873f-38eb-4d97-af5b-47ec7ddbe3db None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:24.348574 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 229/451] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:56:24 2022] GET /identity/v3/projects/15f699ac2a074d6bb8d9dc62578c5328 => generated 344 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:24.353926 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa873f-38eb-4d97-af5b-47ec7ddbe3db None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:24.407738 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca56238-7181-48fd-9a12-a22400d9b77c None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:24.438814 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544efd3-64ce-4f28-bf94-f8543ae28272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:24.439648 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544efd3-64ce-4f28-bf94-f8543ae28272 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:24.439953 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544efd3-64ce-4f28-bf94-f8543ae28272 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:24.440220 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544efd3-64ce-4f28-bf94-f8543ae28272 None admin] PATH_INFO: `/v3/groups/63f30dde633b4babae3c8e5a6b5efa4e` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:24.441996 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544efd3-64ce-4f28-bf94-f8543ae28272 None admin] RBAC: Authorizing `identity:get_group(group_id=63f30dde633b4babae3c8e5a6b5efa4e)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:24.443676 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544efd3-64ce-4f28-bf94-f8543ae28272 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:24.444674 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa873f-38eb-4d97-af5b-47ec7ddbe3db None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:24.445280 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 223/452] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Mar 10 03:56:24 2022] GET /identity/v3/groups/63f30dde633b4babae3c8e5a6b5efa4e => generated 226 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:56:24.450918 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544efd3-64ce-4f28-bf94-f8543ae28272 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:24.475623 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2008e-c382-4361-a657-0c2eab836a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:24.476499 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2008e-c382-4361-a657-0c2eab836a56 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:24.476779 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2008e-c382-4361-a657-0c2eab836a56 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:24.477055 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2008e-c382-4361-a657-0c2eab836a56 None admin] PATH_INFO: `/v3/groups/7b930d92089543c29ce86563b776f17d` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:24.478216 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f2008e-c382-4361-a657-0c2eab836a56 None admin] RBAC: Authorizing `identity:get_group(group_id=7b930d92089543c29ce86563b776f17d)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:24.479619 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f2008e-c382-4361-a657-0c2eab836a56 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:24.481232 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 230/453] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Mar 10 03:56:24 2022] GET /identity/v3/groups/7b930d92089543c29ce86563b776f17d => generated 229 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:56:24.486847 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2008e-c382-4361-a657-0c2eab836a56 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:24.542281 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544efd3-64ce-4f28-bf94-f8543ae28272 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:24.575739 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfb8f4-4a21-4fb6-930c-9d988c3e0555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:24.576392 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfb8f4-4a21-4fb6-930c-9d988c3e0555 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:24.576677 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfb8f4-4a21-4fb6-930c-9d988c3e0555 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:24.576953 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfb8f4-4a21-4fb6-930c-9d988c3e0555 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:24.577776 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfb8f4-4a21-4fb6-930c-9d988c3e0555 None admin] RBAC: Adding query filter params (group.id=63f30dde633b4babae3c8e5a6b5efa4e, role.id=c38b04db9cd34eeaaaa8d2a6425c05ad, scope.project.id=fdcba3bc2cf94d4683c633c879cc7d25) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:24.578084 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfb8f4-4a21-4fb6-930c-9d988c3e0555 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:24.578743 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2008e-c382-4361-a657-0c2eab836a56 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:24.579514 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfb8f4-4a21-4fb6-930c-9d988c3e0555 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:24.597431 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 224/454] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Mar 10 03:56:24 2022] GET /identity/v3/role_assignments?group.id=63f30dde633b4babae3c8e5a6b5efa4e&scope.project.id=fdcba3bc2cf94d4683c633c879cc7d25&role.id=c38b04db9cd34eeaaaa8d2a6425c05ad => generated 611 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:56:24.623598 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbf3a2-e8b8-4433-b5fd-2cd9400ccd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:24.624620 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbf3a2-e8b8-4433-b5fd-2cd9400ccd3e None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:24.625032 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbf3a2-e8b8-4433-b5fd-2cd9400ccd3e None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:24.625438 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbf3a2-e8b8-4433-b5fd-2cd9400ccd3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:24.626756 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fbf3a2-e8b8-4433-b5fd-2cd9400ccd3e None admin] RBAC: Adding query filter params (group.id=7b930d92089543c29ce86563b776f17d, role.id=a8b2a5887cec4a31b7304792af3dd3f1, scope.project.id=15f699ac2a074d6bb8d9dc62578c5328) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:24.627226 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fbf3a2-e8b8-4433-b5fd-2cd9400ccd3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:24.630265 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fbf3a2-e8b8-4433-b5fd-2cd9400ccd3e None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:24.639843 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 231/455] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Mar 10 03:56:24 2022] GET /identity/v3/role_assignments?group.id=7b930d92089543c29ce86563b776f17d&scope.project.id=15f699ac2a074d6bb8d9dc62578c5328&role.id=a8b2a5887cec4a31b7304792af3dd3f1 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:56:27.753040 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205d570-6d2a-4627-b3ce-4a31fd3bdfa2 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:27.753622 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75994495-7dbd-4a33-82da-58eeeaead158 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:27.753622 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75994495-7dbd-4a33-82da-58eeeaead158 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:27.754025 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75994495-7dbd-4a33-82da-58eeeaead158 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:27.754643 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205d570-6d2a-4627-b3ce-4a31fd3bdfa2 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:27.755154 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205d570-6d2a-4627-b3ce-4a31fd3bdfa2 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:27.755906 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 232/456] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:27.757635 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 225/457] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:27.760464 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3ab9d-5881-4c03-949a-70ea73c429b8 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:27.760961 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3ab9d-5881-4c03-949a-70ea73c429b8 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:27.761407 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3ab9d-5881-4c03-949a-70ea73c429b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:27.763284 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec9c92-d3c7-4384-b648-f50d755c047c None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:27.763851 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec9c92-d3c7-4384-b648-f50d755c047c None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:27.764347 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec9c92-d3c7-4384-b648-f50d755c047c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:27.788943 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-d9d3ab9d-5881-4c03-949a-70ea73c429b8 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:27.790850 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-d9d3ab9d-5881-4c03-949a-70ea73c429b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:27.797608 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-77ec9c92-d3c7-4384-b648-f50d755c047c None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:27.799186 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-77ec9c92-d3c7-4384-b648-f50d755c047c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:27.911868 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 233/458] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:27.920391 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 226/459] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 03:56:27.936693 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a25f0f-ba1b-4e30-b5f4-279ed479c306 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:27.937239 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a25f0f-ba1b-4e30-b5f4-279ed479c306 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:27.937715 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a25f0f-ba1b-4e30-b5f4-279ed479c306 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:27.939700 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 234/460] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:27.945661 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59357606-0fe5-4f26-af9e-154f2bb8d01d None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:27.946236 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59357606-0fe5-4f26-af9e-154f2bb8d01d None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:27.946799 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59357606-0fe5-4f26-af9e-154f2bb8d01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:27.947892 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a25f0f-ba1b-4e30-b5f4-279ed479c306 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:27.967820 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-59357606-0fe5-4f26-af9e-154f2bb8d01d None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:27.969204 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-59357606-0fe5-4f26-af9e-154f2bb8d01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:28.055290 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a25f0f-ba1b-4e30-b5f4-279ed479c306 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:28.055739 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 227/461] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:28.056660 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59357606-0fe5-4f26-af9e-154f2bb8d01d None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:28.104449 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1a763-2be3-446a-b305-5501ca59066e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:28.105272 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1a763-2be3-446a-b305-5501ca59066e None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:28.105547 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1a763-2be3-446a-b305-5501ca59066e None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:28.105993 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1a763-2be3-446a-b305-5501ca59066e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:28.120789 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1a763-2be3-446a-b305-5501ca59066e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:28.122428 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1a763-2be3-446a-b305-5501ca59066e None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:28.140283 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-a1f1a763-2be3-446a-b305-5501ca59066e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:28.142072 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 235/462] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:28.143155 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1a763-2be3-446a-b305-5501ca59066e None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:28.171071 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59357606-0fe5-4f26-af9e-154f2bb8d01d None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:28.206874 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8e35d-afb6-41df-a3eb-25eb56676afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:28.208037 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8e35d-afb6-41df-a3eb-25eb56676afe None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:28.208479 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8e35d-afb6-41df-a3eb-25eb56676afe None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:28.209205 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8e35d-afb6-41df-a3eb-25eb56676afe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:28.219328 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8e35d-afb6-41df-a3eb-25eb56676afe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:28.220826 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8e35d-afb6-41df-a3eb-25eb56676afe None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:28.238896 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-f4f8e35d-afb6-41df-a3eb-25eb56676afe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:28.240133 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 228/463] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:28.241053 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8e35d-afb6-41df-a3eb-25eb56676afe None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:28.251725 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1a763-2be3-446a-b305-5501ca59066e None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:28.284434 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49fe803-4c90-46c3-9d1e-b11e7c59ecca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:28.285512 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fe803-4c90-46c3-9d1e-b11e7c59ecca None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:28.285949 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fe803-4c90-46c3-9d1e-b11e7c59ecca None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:28.286368 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fe803-4c90-46c3-9d1e-b11e7c59ecca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:28.297011 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49fe803-4c90-46c3-9d1e-b11e7c59ecca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:28.298631 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49fe803-4c90-46c3-9d1e-b11e7c59ecca None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:28.315785 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-b49fe803-4c90-46c3-9d1e-b11e7c59ecca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:28.317780 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 236/464] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:28.319364 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f30e0-5504-4b0b-b329-5dea18cfae83 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:28.319653 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f30e0-5504-4b0b-b329-5dea18cfae83 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:28.319963 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f30e0-5504-4b0b-b329-5dea18cfae83 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:28.321625 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 237/465] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:28.322445 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f30e0-5504-4b0b-b329-5dea18cfae83 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:28.343579 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8e35d-afb6-41df-a3eb-25eb56676afe None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:28.376572 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c0bca-ec77-4ac3-a98a-3f5d21e3541d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:28.377233 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c0bca-ec77-4ac3-a98a-3f5d21e3541d None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:28.377527 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c0bca-ec77-4ac3-a98a-3f5d21e3541d None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:28.377801 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c0bca-ec77-4ac3-a98a-3f5d21e3541d None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:28.379167 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c0bca-ec77-4ac3-a98a-3f5d21e3541d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:28.379476 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c0bca-ec77-4ac3-a98a-3f5d21e3541d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:28.380975 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c0bca-ec77-4ac3-a98a-3f5d21e3541d None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:28.396991 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 229/466] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:28.396991 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c0bca-ec77-4ac3-a98a-3f5d21e3541d None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:28.430045 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f30e0-5504-4b0b-b329-5dea18cfae83 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:28.464306 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810da565-bbd8-4a91-ac2e-7cf6fb80c324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:28.464986 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810da565-bbd8-4a91-ac2e-7cf6fb80c324 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:28.465269 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810da565-bbd8-4a91-ac2e-7cf6fb80c324 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:28.465549 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810da565-bbd8-4a91-ac2e-7cf6fb80c324 None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:28.466282 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810da565-bbd8-4a91-ac2e-7cf6fb80c324 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:28.466588 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810da565-bbd8-4a91-ac2e-7cf6fb80c324 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:28.468017 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810da565-bbd8-4a91-ac2e-7cf6fb80c324 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:28.486112 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 238/467] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:28.486112 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1a65d-b0b6-4be7-aea7-a19dd4d09f4a None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:28.486112 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1a65d-b0b6-4be7-aea7-a19dd4d09f4a None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:28.486112 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1a65d-b0b6-4be7-aea7-a19dd4d09f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:28.498080 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c0bca-ec77-4ac3-a98a-3f5d21e3541d None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:28.501310 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-6ac1a65d-b0b6-4be7-aea7-a19dd4d09f4a None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:28.502482 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-6ac1a65d-b0b6-4be7-aea7-a19dd4d09f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:28.533010 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91732d-9da8-4ae2-8d35-723e65242609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:28.533703 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91732d-9da8-4ae2-8d35-723e65242609 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:28.533985 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91732d-9da8-4ae2-8d35-723e65242609 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:28.534264 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91732d-9da8-4ae2-8d35-723e65242609 None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:28.535012 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91732d-9da8-4ae2-8d35-723e65242609 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:28.535317 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91732d-9da8-4ae2-8d35-723e65242609 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:28.537633 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91732d-9da8-4ae2-8d35-723e65242609 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:28.549485 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 230/468] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:28.550785 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91732d-9da8-4ae2-8d35-723e65242609 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:28.572134 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 239/469] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:28.572981 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1a65d-b0b6-4be7-aea7-a19dd4d09f4a None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:28.661807 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91732d-9da8-4ae2-8d35-723e65242609 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:28.682085 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1a65d-b0b6-4be7-aea7-a19dd4d09f4a None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:28.694757 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85683df6-820e-446e-8a14-5998d6254de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:28.695522 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85683df6-820e-446e-8a14-5998d6254de2 None admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:28.695867 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85683df6-820e-446e-8a14-5998d6254de2 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:28.696152 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85683df6-820e-446e-8a14-5998d6254de2 None admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:28.696857 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85683df6-820e-446e-8a14-5998d6254de2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:28.698293 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85683df6-820e-446e-8a14-5998d6254de2 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:28.716547 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f116dc-cc26-4c52-8ffd-bc3331d0bbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:28.717220 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f116dc-cc26-4c52-8ffd-bc3331d0bbf4 None admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:28.717506 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f116dc-cc26-4c52-8ffd-bc3331d0bbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:28.717784 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f116dc-cc26-4c52-8ffd-bc3331d0bbf4 None admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:28.718487 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f116dc-cc26-4c52-8ffd-bc3331d0bbf4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:28.719943 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f116dc-cc26-4c52-8ffd-bc3331d0bbf4 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:28.728073 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 231/470] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Mar 10 03:56:28 2022] POST /identity/v3/users => generated 246 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 03:56:28.728073 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85683df6-820e-446e-8a14-5998d6254de2 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:28.752701 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 240/471] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Mar 10 03:56:28 2022] POST /identity/v3/users => generated 248 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 03:56:28.753628 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f116dc-cc26-4c52-8ffd-bc3331d0bbf4 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:28.883543 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f116dc-cc26-4c52-8ffd-bc3331d0bbf4 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:28.893764 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85683df6-820e-446e-8a14-5998d6254de2 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:28.926482 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12496d6-4cff-4722-92d4-603e21c6ae12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:28.926482 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12496d6-4cff-4722-92d4-603e21c6ae12 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:28.926482 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12496d6-4cff-4722-92d4-603e21c6ae12 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:28.926841 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12496d6-4cff-4722-92d4-603e21c6ae12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:28.940101 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12496d6-4cff-4722-92d4-603e21c6ae12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:28.941879 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12496d6-4cff-4722-92d4-603e21c6ae12 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:28.946530 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f707e-1c8b-424c-b1b3-287ec1377379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:28.947226 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f707e-1c8b-424c-b1b3-287ec1377379 None admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:28.947507 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f707e-1c8b-424c-b1b3-287ec1377379 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:28.948263 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f707e-1c8b-424c-b1b3-287ec1377379 None admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:28.948569 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f707e-1c8b-424c-b1b3-287ec1377379 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:28.950062 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f707e-1c8b-424c-b1b3-287ec1377379 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:28.961224 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-d12496d6-4cff-4722-92d4-603e21c6ae12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:28.962646 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 241/472] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:28.964024 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faee2c1-6c95-4974-b5f1-11bd43f8b36b None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:28.965407 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faee2c1-6c95-4974-b5f1-11bd43f8b36b None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:28.965407 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faee2c1-6c95-4974-b5f1-11bd43f8b36b None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:28.968032 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 242/473] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:28.971427 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faee2c1-6c95-4974-b5f1-11bd43f8b36b None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:28.977357 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 232/474] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Mar 10 03:56:28 2022] POST /identity/v3/users => generated 248 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 03:56:28.978633 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e1654-627e-48a8-8714-41353704a936 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:28.978924 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e1654-627e-48a8-8714-41353704a936 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:28.979202 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e1654-627e-48a8-8714-41353704a936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:28.997717 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-9c5e1654-627e-48a8-8714-41353704a936 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:28.998961 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-9c5e1654-627e-48a8-8714-41353704a936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:29.074362 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 233/475] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:29.098635 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e1654-627e-48a8-8714-41353704a936 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:29.104694 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faee2c1-6c95-4974-b5f1-11bd43f8b36b None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:29.154105 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129cb7e-a069-4296-8f8c-88a830522273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:29.154699 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129cb7e-a069-4296-8f8c-88a830522273 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:29.154977 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129cb7e-a069-4296-8f8c-88a830522273 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:29.155249 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129cb7e-a069-4296-8f8c-88a830522273 None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:29.156011 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129cb7e-a069-4296-8f8c-88a830522273 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:29.156315 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129cb7e-a069-4296-8f8c-88a830522273 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:29.157718 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129cb7e-a069-4296-8f8c-88a830522273 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:29.177131 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 243/476] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:29.178505 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129cb7e-a069-4296-8f8c-88a830522273 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:29.205563 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e1654-627e-48a8-8714-41353704a936 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:29.241974 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbc1c2-fde8-4273-b9fc-beeb226fb458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:29.242647 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbc1c2-fde8-4273-b9fc-beeb226fb458 None admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:29.242930 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbc1c2-fde8-4273-b9fc-beeb226fb458 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:29.243205 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbc1c2-fde8-4273-b9fc-beeb226fb458 None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:29.243993 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbc1c2-fde8-4273-b9fc-beeb226fb458 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:29.245384 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbc1c2-fde8-4273-b9fc-beeb226fb458 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:29.257113 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.sql.core [None req-86dbc1c2-fde8-4273-b9fc-beeb226fb458 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Mar 10 03:56:29.257113 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Mar 10 03:56:29.257113 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [parameters: {'id': 'a5a418247b2b44839ee25e5ff6afb21a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Mar 10 03:56:29.257113 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79560) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 10 03:56:29.272079 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-86dbc1c2-fde8-4273-b9fc-beeb226fb458 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Mar 10 03:56:29.273761 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 234/477] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Mar 10 03:56:29 2022] POST /identity/v3/roles => generated 144 bytes in 176 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:56:29.279344 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbc1c2-fde8-4273-b9fc-beeb226fb458 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:29.297773 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129cb7e-a069-4296-8f8c-88a830522273 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:29.335102 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7746aa3-ddc0-4ce1-ae6e-a9aa787b1ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:29.336206 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7746aa3-ddc0-4ce1-ae6e-a9aa787b1ba9 None admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:29.336682 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7746aa3-ddc0-4ce1-ae6e-a9aa787b1ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:29.337176 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7746aa3-ddc0-4ce1-ae6e-a9aa787b1ba9 None admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:29.338117 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7746aa3-ddc0-4ce1-ae6e-a9aa787b1ba9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:29.339800 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7746aa3-ddc0-4ce1-ae6e-a9aa787b1ba9 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:29.364561 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 244/478] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Mar 10 03:56:29 2022] POST /identity/v3/users => generated 249 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 03:56:29.388571 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbc1c2-fde8-4273-b9fc-beeb226fb458 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:29.427736 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c649407-d3c2-4e55-9ed8-6f291943bc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:29.428499 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c649407-d3c2-4e55-9ed8-6f291943bc3e None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:29.428831 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c649407-d3c2-4e55-9ed8-6f291943bc3e None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:29.429109 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c649407-d3c2-4e55-9ed8-6f291943bc3e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:29.441770 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c649407-d3c2-4e55-9ed8-6f291943bc3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:29.449676 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-1c649407-d3c2-4e55-9ed8-6f291943bc3e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 10 03:56:29.450959 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 235/479] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Mar 10 03:56:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:56:29.457620 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7746aa3-ddc0-4ce1-ae6e-a9aa787b1ba9 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:29.584198 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7746aa3-ddc0-4ce1-ae6e-a9aa787b1ba9 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:29.616631 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642edd2-489e-415c-9c4f-15130126e08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:29.617358 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642edd2-489e-415c-9c4f-15130126e08e None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:29.617670 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642edd2-489e-415c-9c4f-15130126e08e None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:29.617961 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642edd2-489e-415c-9c4f-15130126e08e None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:29.618715 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642edd2-489e-415c-9c4f-15130126e08e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:29.619019 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642edd2-489e-415c-9c4f-15130126e08e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:29.620413 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642edd2-489e-415c-9c4f-15130126e08e None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:29.629610 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 245/480] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:56:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:56:31.548327 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1952a-9d68-4bf6-83d1-92f1ea7f8f36 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:31.548874 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1952a-9d68-4bf6-83d1-92f1ea7f8f36 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:31.548874 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1952a-9d68-4bf6-83d1-92f1ea7f8f36 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:31.551558 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 236/481] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:31.558462 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70e2d0-5cfc-4d75-8b7f-6a7fc8cd2274 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:31.558941 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70e2d0-5cfc-4d75-8b7f-6a7fc8cd2274 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:31.559011 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70e2d0-5cfc-4d75-8b7f-6a7fc8cd2274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:31.580526 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-eb70e2d0-5cfc-4d75-8b7f-6a7fc8cd2274 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:31.581738 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-eb70e2d0-5cfc-4d75-8b7f-6a7fc8cd2274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:31.668365 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 246/482] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:31.709207 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1952a-9d68-4bf6-83d1-92f1ea7f8f36 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:31.828601 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc1952a-9d68-4bf6-83d1-92f1ea7f8f36 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:31.870638 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65031f56-be95-412c-82f6-d67bd2d85ce0 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:31.870847 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa851571-2a68-4916-b5e5-b0a40fc5288a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:31.870943 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65031f56-be95-412c-82f6-d67bd2d85ce0 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:31.871212 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65031f56-be95-412c-82f6-d67bd2d85ce0 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:31.871642 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa851571-2a68-4916-b5e5-b0a40fc5288a None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:31.871951 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa851571-2a68-4916-b5e5-b0a40fc5288a None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:31.872230 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa851571-2a68-4916-b5e5-b0a40fc5288a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:31.873186 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 247/483] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:31.881185 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66699d04-2100-4f4b-9bc1-1f7b26857619 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:31.881744 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66699d04-2100-4f4b-9bc1-1f7b26857619 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:31.882236 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66699d04-2100-4f4b-9bc1-1f7b26857619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:31.884510 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa851571-2a68-4916-b5e5-b0a40fc5288a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:31.891482 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-fa851571-2a68-4916-b5e5-b0a40fc5288a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 03:56:31.893027 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 237/484] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Mar 10 03:56:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:31.898678 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa851571-2a68-4916-b5e5-b0a40fc5288a None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:31.900449 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-66699d04-2100-4f4b-9bc1-1f7b26857619 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:31.901840 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-66699d04-2100-4f4b-9bc1-1f7b26857619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:31.977539 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 248/485] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:31.978979 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f5d38-6760-477e-8d7f-a7c92ee685f6 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:31.979261 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f5d38-6760-477e-8d7f-a7c92ee685f6 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:31.979530 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f5d38-6760-477e-8d7f-a7c92ee685f6 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:31.981548 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 249/486] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:31.986912 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c946a8b-4c19-4cdc-bdf8-49923117b3ac None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:31.987198 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c946a8b-4c19-4cdc-bdf8-49923117b3ac None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:31.987473 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c946a8b-4c19-4cdc-bdf8-49923117b3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:32.004304 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-0c946a8b-4c19-4cdc-bdf8-49923117b3ac None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:32.005469 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-0c946a8b-4c19-4cdc-bdf8-49923117b3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:32.019470 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa851571-2a68-4916-b5e5-b0a40fc5288a None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:32.062574 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019901cd-5d7d-46b1-8e41-c06f19da567f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:32.063731 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019901cd-5d7d-46b1-8e41-c06f19da567f None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:32.064035 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019901cd-5d7d-46b1-8e41-c06f19da567f None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:32.064595 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019901cd-5d7d-46b1-8e41-c06f19da567f None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:32.065365 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019901cd-5d7d-46b1-8e41-c06f19da567f None admin] RBAC: Adding query filter params (name=service) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:32.065874 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019901cd-5d7d-46b1-8e41-c06f19da567f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:32.068168 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019901cd-5d7d-46b1-8e41-c06f19da567f None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:32.071255 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 250/487] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:32.080705 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c946a8b-4c19-4cdc-bdf8-49923117b3ac None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:32.081237 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 238/488] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Mar 10 03:56:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:56:32.085664 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019901cd-5d7d-46b1-8e41-c06f19da567f None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:32.193100 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019901cd-5d7d-46b1-8e41-c06f19da567f None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:32.196534 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c946a8b-4c19-4cdc-bdf8-49923117b3ac None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:32.230633 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535007d-2acc-4a3d-bc2c-a3d9f7fddb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:32.231421 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535007d-2acc-4a3d-bc2c-a3d9f7fddb07 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:32.231729 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535007d-2acc-4a3d-bc2c-a3d9f7fddb07 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:32.232011 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535007d-2acc-4a3d-bc2c-a3d9f7fddb07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:32.233380 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8b152-0139-47ad-9d04-62048671921e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:32.234177 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8b152-0139-47ad-9d04-62048671921e None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:32.234455 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8b152-0139-47ad-9d04-62048671921e None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:32.234721 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8b152-0139-47ad-9d04-62048671921e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:32.242930 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535007d-2acc-4a3d-bc2c-a3d9f7fddb07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:32.245113 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535007d-2acc-4a3d-bc2c-a3d9f7fddb07 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:32.245453 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8b152-0139-47ad-9d04-62048671921e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:32.252814 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-e3c8b152-0139-47ad-9d04-62048671921e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 03:56:32.254058 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 251/489] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Mar 10 03:56:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:32.254822 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8b152-0139-47ad-9d04-62048671921e None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:32.264887 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-e535007d-2acc-4a3d-bc2c-a3d9f7fddb07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:32.271069 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 239/490] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:56:32.271936 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535007d-2acc-4a3d-bc2c-a3d9f7fddb07 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:32.353798 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8b152-0139-47ad-9d04-62048671921e None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:32.372865 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535007d-2acc-4a3d-bc2c-a3d9f7fddb07 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:32.386363 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388781ee-bd3c-4b8e-8210-a7f638aec79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:32.387158 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388781ee-bd3c-4b8e-8210-a7f638aec79a None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:32.387439 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388781ee-bd3c-4b8e-8210-a7f638aec79a None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:32.387739 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388781ee-bd3c-4b8e-8210-a7f638aec79a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:32.398992 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388781ee-bd3c-4b8e-8210-a7f638aec79a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:32.406123 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-388781ee-bd3c-4b8e-8210-a7f638aec79a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 03:56:32.407226 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a3086-21b9-4d6b-b261-bf0724e2b40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:32.407616 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 252/491] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Mar 10 03:56:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:32.408005 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a3086-21b9-4d6b-b261-bf0724e2b40b None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:32.408297 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a3086-21b9-4d6b-b261-bf0724e2b40b None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:32.408573 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a3086-21b9-4d6b-b261-bf0724e2b40b None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:32.409389 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a3086-21b9-4d6b-b261-bf0724e2b40b None admin] RBAC: Adding query filter params (name=service) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:32.409739 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a3086-21b9-4d6b-b261-bf0724e2b40b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:32.411123 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a3086-21b9-4d6b-b261-bf0724e2b40b None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:32.412544 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388781ee-bd3c-4b8e-8210-a7f638aec79a None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:32.420119 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 240/492] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Mar 10 03:56:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:32.421005 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a3086-21b9-4d6b-b261-bf0724e2b40b None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:32.512594 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388781ee-bd3c-4b8e-8210-a7f638aec79a None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:32.520766 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a3086-21b9-4d6b-b261-bf0724e2b40b None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:32.546254 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469de3f4-d2d7-4750-ba35-31845cdf010c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:32.546984 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469de3f4-d2d7-4750-ba35-31845cdf010c None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:32.547269 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469de3f4-d2d7-4750-ba35-31845cdf010c None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:32.547543 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469de3f4-d2d7-4750-ba35-31845cdf010c None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:32.548305 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469de3f4-d2d7-4750-ba35-31845cdf010c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:32.548607 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469de3f4-d2d7-4750-ba35-31845cdf010c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:32.550021 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469de3f4-d2d7-4750-ba35-31845cdf010c None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:32.556824 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e84783-964f-4e42-a834-b597cb722fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:32.557468 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e84783-964f-4e42-a834-b597cb722fd1 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:32.557749 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e84783-964f-4e42-a834-b597cb722fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:32.558559 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e84783-964f-4e42-a834-b597cb722fd1 None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:32.559359 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e84783-964f-4e42-a834-b597cb722fd1 None admin] RBAC: Adding query filter params (name=service) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:32.559677 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e84783-964f-4e42-a834-b597cb722fd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:32.561083 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e84783-964f-4e42-a834-b597cb722fd1 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:32.563422 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 253/493] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:32.564792 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469de3f4-d2d7-4750-ba35-31845cdf010c None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:32.571670 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 241/494] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Mar 10 03:56:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:32.573186 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ebbb5-71c5-4a80-bd25-dba977a22ee6 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:32.573553 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ebbb5-71c5-4a80-bd25-dba977a22ee6 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:32.573909 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ebbb5-71c5-4a80-bd25-dba977a22ee6 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:32.576428 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 242/495] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:32.577716 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ebbb5-71c5-4a80-bd25-dba977a22ee6 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:32.657991 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469de3f4-d2d7-4750-ba35-31845cdf010c None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:32.673454 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ebbb5-71c5-4a80-bd25-dba977a22ee6 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:32.688813 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc55c59-4cdc-47cc-a3be-4f42876d5c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:32.689590 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc55c59-4cdc-47cc-a3be-4f42876d5c68 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:32.689864 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc55c59-4cdc-47cc-a3be-4f42876d5c68 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:32.690136 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc55c59-4cdc-47cc-a3be-4f42876d5c68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:32.700385 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc55c59-4cdc-47cc-a3be-4f42876d5c68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:32.701800 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc55c59-4cdc-47cc-a3be-4f42876d5c68 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:32.705908 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504b09b-1b17-4026-835f-eb60d41493fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:32.706702 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504b09b-1b17-4026-835f-eb60d41493fd None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:32.706988 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504b09b-1b17-4026-835f-eb60d41493fd None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:32.707266 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504b09b-1b17-4026-835f-eb60d41493fd None admin] PATH_INFO: `/v3/users/nova` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:32.714469 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504b09b-1b17-4026-835f-eb60d41493fd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:32.715934 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504b09b-1b17-4026-835f-eb60d41493fd None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:32.717853 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-5bc55c59-4cdc-47cc-a3be-4f42876d5c68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:32.719002 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 254/496] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:32.720559 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc55c59-4cdc-47cc-a3be-4f42876d5c68 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:32.729185 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-c504b09b-1b17-4026-835f-eb60d41493fd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 10 03:56:32.730355 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 243/497] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Mar 10 03:56:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:32.731520 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973252af-b7a8-495b-82cd-71ab3b9a8718 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:32.731832 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973252af-b7a8-495b-82cd-71ab3b9a8718 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:32.732116 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973252af-b7a8-495b-82cd-71ab3b9a8718 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:32.733758 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 244/498] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:32.734780 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebeb82-57c8-48d8-b7b8-da93f76d43a8 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:32.735065 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebeb82-57c8-48d8-b7b8-da93f76d43a8 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:32.735338 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebeb82-57c8-48d8-b7b8-da93f76d43a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:32.751797 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-a1ebeb82-57c8-48d8-b7b8-da93f76d43a8 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:32.752982 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-a1ebeb82-57c8-48d8-b7b8-da93f76d43a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:32.814274 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc55c59-4cdc-47cc-a3be-4f42876d5c68 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:32.814458 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 245/499] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:32.815073 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebeb82-57c8-48d8-b7b8-da93f76d43a8 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:32.847242 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301516e1-63fd-4555-86ed-a050695f9341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:32.848052 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301516e1-63fd-4555-86ed-a050695f9341 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:32.848330 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301516e1-63fd-4555-86ed-a050695f9341 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:32.848598 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301516e1-63fd-4555-86ed-a050695f9341 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:32.858163 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301516e1-63fd-4555-86ed-a050695f9341 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:32.859611 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301516e1-63fd-4555-86ed-a050695f9341 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:32.876172 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-301516e1-63fd-4555-86ed-a050695f9341 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:32.877337 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 255/500] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:32.878091 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301516e1-63fd-4555-86ed-a050695f9341 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:32.916612 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebeb82-57c8-48d8-b7b8-da93f76d43a8 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:32.949125 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47c48b-c305-43ca-89c0-5c337371052a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:32.949774 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47c48b-c305-43ca-89c0-5c337371052a None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:32.950062 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47c48b-c305-43ca-89c0-5c337371052a None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:32.950341 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47c48b-c305-43ca-89c0-5c337371052a None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:32.951058 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47c48b-c305-43ca-89c0-5c337371052a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:32.951360 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47c48b-c305-43ca-89c0-5c337371052a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:32.952780 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47c48b-c305-43ca-89c0-5c337371052a None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:32.963562 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 246/501] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:32.964768 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7594edb-5d0a-4ac7-93f7-79365bf6f0d0 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:32.965055 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7594edb-5d0a-4ac7-93f7-79365bf6f0d0 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:32.965331 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7594edb-5d0a-4ac7-93f7-79365bf6f0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:32.973835 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301516e1-63fd-4555-86ed-a050695f9341 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:32.980519 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-e7594edb-5d0a-4ac7-93f7-79365bf6f0d0 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:32.981690 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-e7594edb-5d0a-4ac7-93f7-79365bf6f0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:33.006171 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb76cd4-39c2-4037-9e74-c0bc616854e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:33.006832 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb76cd4-39c2-4037-9e74-c0bc616854e3 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:33.007119 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb76cd4-39c2-4037-9e74-c0bc616854e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:33.007400 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb76cd4-39c2-4037-9e74-c0bc616854e3 None admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:33.008257 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb76cd4-39c2-4037-9e74-c0bc616854e3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:33.008567 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb76cd4-39c2-4037-9e74-c0bc616854e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:33.009978 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb76cd4-39c2-4037-9e74-c0bc616854e3 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:33.043147 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 247/502] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:33.043828 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7594edb-5d0a-4ac7-93f7-79365bf6f0d0 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:33.050667 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 256/503] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Mar 10 03:56:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:33.050667 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb76cd4-39c2-4037-9e74-c0bc616854e3 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:33.139930 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb76cd4-39c2-4037-9e74-c0bc616854e3 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:33.149871 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7594edb-5d0a-4ac7-93f7-79365bf6f0d0 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:33.174036 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2c129-50f9-44e8-bc83-14b8626edc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:33.174622 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2c129-50f9-44e8-bc83-14b8626edc99 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:33.174902 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2c129-50f9-44e8-bc83-14b8626edc99 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:33.175836 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2c129-50f9-44e8-bc83-14b8626edc99 None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:33.176550 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2c129-50f9-44e8-bc83-14b8626edc99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:33.176855 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2c129-50f9-44e8-bc83-14b8626edc99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:33.178221 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2c129-50f9-44e8-bc83-14b8626edc99 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:33.181967 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae56577-17b3-4be4-bf36-4ab2a8be1a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:33.182756 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae56577-17b3-4be4-bf36-4ab2a8be1a80 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:33.183036 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae56577-17b3-4be4-bf36-4ab2a8be1a80 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:33.183308 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae56577-17b3-4be4-bf36-4ab2a8be1a80 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:33.191951 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 257/504] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:33.193534 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2c129-50f9-44e8-bc83-14b8626edc99 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:33.197625 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae56577-17b3-4be4-bf36-4ab2a8be1a80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:33.205134 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-aae56577-17b3-4be4-bf36-4ab2a8be1a80 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 03:56:33.206489 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 248/505] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Mar 10 03:56:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:33.207138 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae56577-17b3-4be4-bf36-4ab2a8be1a80 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:33.291288 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2c129-50f9-44e8-bc83-14b8626edc99 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:33.300956 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae56577-17b3-4be4-bf36-4ab2a8be1a80 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:33.322113 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d09953-d3d0-4ae8-973c-623f04689c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:33.322894 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d09953-d3d0-4ae8-973c-623f04689c3f None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:33.323172 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d09953-d3d0-4ae8-973c-623f04689c3f None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:33.323439 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d09953-d3d0-4ae8-973c-623f04689c3f None admin] PATH_INFO: `/v3/users/glance` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:33.330419 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d09953-d3d0-4ae8-973c-623f04689c3f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:33.331885 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d09953-d3d0-4ae8-973c-623f04689c3f None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:33.332647 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cf739-9053-4e92-9aa7-47698bfcddc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:33.333284 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cf739-9053-4e92-9aa7-47698bfcddc6 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:33.333571 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cf739-9053-4e92-9aa7-47698bfcddc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:33.333847 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cf739-9053-4e92-9aa7-47698bfcddc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:33.344939 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-f3d09953-d3d0-4ae8-973c-623f04689c3f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 10 03:56:33.346181 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 258/506] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:56:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:33.347414 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d09953-d3d0-4ae8-973c-623f04689c3f None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:33.397026 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385cf739-9053-4e92-9aa7-47698bfcddc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:33.398469 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385cf739-9053-4e92-9aa7-47698bfcddc6 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:33.437711 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d09953-d3d0-4ae8-973c-623f04689c3f None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:33.468709 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e99657-e9f6-49d2-8fe6-03421da9d6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:33.469472 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e99657-e9f6-49d2-8fe6-03421da9d6c0 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:33.469747 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e99657-e9f6-49d2-8fe6-03421da9d6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:33.470017 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e99657-e9f6-49d2-8fe6-03421da9d6c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:33.480439 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e99657-e9f6-49d2-8fe6-03421da9d6c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:33.481859 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e99657-e9f6-49d2-8fe6-03421da9d6c0 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:33.490370 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 249/507] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:56:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:56:33.491392 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cf739-9053-4e92-9aa7-47698bfcddc6 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:33.497496 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-42e99657-e9f6-49d2-8fe6-03421da9d6c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:33.498666 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 259/508] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:33.499424 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e99657-e9f6-49d2-8fe6-03421da9d6c0 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:33.582548 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cf739-9053-4e92-9aa7-47698bfcddc6 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:33.590623 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e99657-e9f6-49d2-8fe6-03421da9d6c0 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:33.614739 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db845f-7920-4d86-b006-0231842c935a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:33.615513 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db845f-7920-4d86-b006-0231842c935a None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:33.615830 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db845f-7920-4d86-b006-0231842c935a None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:33.616103 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db845f-7920-4d86-b006-0231842c935a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:33.621441 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23c498-454a-48af-8fd5-0ebb6325bd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:33.622081 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23c498-454a-48af-8fd5-0ebb6325bd8d None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:33.622364 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23c498-454a-48af-8fd5-0ebb6325bd8d None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:33.622642 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23c498-454a-48af-8fd5-0ebb6325bd8d None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:33.622734 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db845f-7920-4d86-b006-0231842c935a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:33.623375 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23c498-454a-48af-8fd5-0ebb6325bd8d None admin] RBAC: Adding query filter params (name=service) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:33.623697 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23c498-454a-48af-8fd5-0ebb6325bd8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:33.624112 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db845f-7920-4d86-b006-0231842c935a None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:33.625058 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23c498-454a-48af-8fd5-0ebb6325bd8d None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:33.632479 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 260/509] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Mar 10 03:56:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:33.633242 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23c498-454a-48af-8fd5-0ebb6325bd8d None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:33.637243 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-76db845f-7920-4d86-b006-0231842c935a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 10 03:56:33.638401 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 250/510] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:56:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:33.639141 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db845f-7920-4d86-b006-0231842c935a None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:33.725679 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23c498-454a-48af-8fd5-0ebb6325bd8d None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:33.731248 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db845f-7920-4d86-b006-0231842c935a None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:33.755689 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcae214-9a2d-4496-b2d5-82bdbf004bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:33.756359 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcae214-9a2d-4496-b2d5-82bdbf004bdd None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:33.756637 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcae214-9a2d-4496-b2d5-82bdbf004bdd None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:33.756910 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcae214-9a2d-4496-b2d5-82bdbf004bdd None admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:33.757721 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcae214-9a2d-4496-b2d5-82bdbf004bdd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:33.758024 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcae214-9a2d-4496-b2d5-82bdbf004bdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:33.759429 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcae214-9a2d-4496-b2d5-82bdbf004bdd None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:33.762324 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba66ee-74e2-48e9-b149-24ce6e308360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:33.763124 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba66ee-74e2-48e9-b149-24ce6e308360 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:33.763406 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba66ee-74e2-48e9-b149-24ce6e308360 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:33.763695 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba66ee-74e2-48e9-b149-24ce6e308360 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:33.773807 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba66ee-74e2-48e9-b149-24ce6e308360 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:33.775235 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba66ee-74e2-48e9-b149-24ce6e308360 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:33.775947 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 261/511] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Mar 10 03:56:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:33.776725 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcae214-9a2d-4496-b2d5-82bdbf004bdd None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:33.796194 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-c6ba66ee-74e2-48e9-b149-24ce6e308360 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:33.797362 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 251/512] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:33.798127 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba66ee-74e2-48e9-b149-24ce6e308360 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:33.873706 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcae214-9a2d-4496-b2d5-82bdbf004bdd None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:33.895243 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba66ee-74e2-48e9-b149-24ce6e308360 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:33.906182 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543e57c-68ce-4a5b-9cf8-d93e2c6dd932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:33.906831 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543e57c-68ce-4a5b-9cf8-d93e2c6dd932 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:33.907115 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543e57c-68ce-4a5b-9cf8-d93e2c6dd932 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:33.907392 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543e57c-68ce-4a5b-9cf8-d93e2c6dd932 None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:33.908131 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543e57c-68ce-4a5b-9cf8-d93e2c6dd932 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:33.908435 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543e57c-68ce-4a5b-9cf8-d93e2c6dd932 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:33.909837 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543e57c-68ce-4a5b-9cf8-d93e2c6dd932 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:33.924998 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 262/513] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:33.924998 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543e57c-68ce-4a5b-9cf8-d93e2c6dd932 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:33.927657 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24298b-5767-4f0f-96c9-26e0422ee8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:33.928474 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24298b-5767-4f0f-96c9-26e0422ee8a0 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:33.928758 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24298b-5767-4f0f-96c9-26e0422ee8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:33.929036 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24298b-5767-4f0f-96c9-26e0422ee8a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:33.938965 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24298b-5767-4f0f-96c9-26e0422ee8a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:33.940435 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24298b-5767-4f0f-96c9-26e0422ee8a0 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:33.958081 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-9f24298b-5767-4f0f-96c9-26e0422ee8a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:33.959247 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 252/514] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:33.960041 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24298b-5767-4f0f-96c9-26e0422ee8a0 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:34.017740 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543e57c-68ce-4a5b-9cf8-d93e2c6dd932 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:34.048419 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac87cdc-cb5f-4408-a12c-eefac2c89686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:34.049076 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac87cdc-cb5f-4408-a12c-eefac2c89686 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:34.049355 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac87cdc-cb5f-4408-a12c-eefac2c89686 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:34.049626 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac87cdc-cb5f-4408-a12c-eefac2c89686 None admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:34.050474 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac87cdc-cb5f-4408-a12c-eefac2c89686 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:34.050781 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac87cdc-cb5f-4408-a12c-eefac2c89686 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:34.051665 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24298b-5767-4f0f-96c9-26e0422ee8a0 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:34.052224 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac87cdc-cb5f-4408-a12c-eefac2c89686 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:34.069055 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 263/515] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Mar 10 03:56:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:34.069905 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac87cdc-cb5f-4408-a12c-eefac2c89686 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:34.085564 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d1b62-9d28-4ed8-8707-f2abc1faae2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:34.086212 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d1b62-9d28-4ed8-8707-f2abc1faae2a None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:34.086500 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d1b62-9d28-4ed8-8707-f2abc1faae2a None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:34.086780 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d1b62-9d28-4ed8-8707-f2abc1faae2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:34.150518 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d1b62-9d28-4ed8-8707-f2abc1faae2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:34.152010 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d1b62-9d28-4ed8-8707-f2abc1faae2a None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:34.161558 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac87cdc-cb5f-4408-a12c-eefac2c89686 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:34.193474 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a7afb-47a7-43b3-8a0b-141fc622a7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:34.194118 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a7afb-47a7-43b3-8a0b-141fc622a7b3 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:34.194403 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a7afb-47a7-43b3-8a0b-141fc622a7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:34.194676 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a7afb-47a7-43b3-8a0b-141fc622a7b3 None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:34.195384 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a7afb-47a7-43b3-8a0b-141fc622a7b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:34.195707 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a7afb-47a7-43b3-8a0b-141fc622a7b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:34.197055 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a7afb-47a7-43b3-8a0b-141fc622a7b3 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:34.207618 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 264/516] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:34.208397 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a7afb-47a7-43b3-8a0b-141fc622a7b3 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:34.248977 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 253/517] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:56:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:56:34.249788 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d1b62-9d28-4ed8-8707-f2abc1faae2a None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:34.299642 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a7afb-47a7-43b3-8a0b-141fc622a7b3 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:34.331270 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8233f-1d37-4c03-a4a4-92bcba771e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:34.331946 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8233f-1d37-4c03-a4a4-92bcba771e9e None admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:34.332225 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8233f-1d37-4c03-a4a4-92bcba771e9e None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:34.332504 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8233f-1d37-4c03-a4a4-92bcba771e9e None admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:34.333192 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8233f-1d37-4c03-a4a4-92bcba771e9e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:34.334607 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8233f-1d37-4c03-a4a4-92bcba771e9e None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:34.343370 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d1b62-9d28-4ed8-8707-f2abc1faae2a None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:34.352846 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 265/518] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Mar 10 03:56:34 2022] POST /identity/v3/users => generated 247 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 03:56:34.353850 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8233f-1d37-4c03-a4a4-92bcba771e9e None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:34.378941 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a075c-5dc5-4d8f-95af-b9645e6a4185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:34.379632 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a075c-5dc5-4d8f-95af-b9645e6a4185 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:34.379949 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a075c-5dc5-4d8f-95af-b9645e6a4185 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:34.380231 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a075c-5dc5-4d8f-95af-b9645e6a4185 None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:34.380976 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a075c-5dc5-4d8f-95af-b9645e6a4185 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:34.381284 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a075c-5dc5-4d8f-95af-b9645e6a4185 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:34.382739 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a075c-5dc5-4d8f-95af-b9645e6a4185 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:34.395068 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 254/519] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:34.395920 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a075c-5dc5-4d8f-95af-b9645e6a4185 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:34.466878 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8233f-1d37-4c03-a4a4-92bcba771e9e None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:34.500390 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83fc66-ddaf-4417-a821-5319d502c62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:34.500604 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a075c-5dc5-4d8f-95af-b9645e6a4185 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:34.501071 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83fc66-ddaf-4417-a821-5319d502c62c None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:34.501328 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83fc66-ddaf-4417-a821-5319d502c62c None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:34.501604 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83fc66-ddaf-4417-a821-5319d502c62c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:34.534471 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12c972-1e3c-4201-9f27-3d08835557b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:34.535275 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12c972-1e3c-4201-9f27-3d08835557b4 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:34.535564 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12c972-1e3c-4201-9f27-3d08835557b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:34.535876 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12c972-1e3c-4201-9f27-3d08835557b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:34.544108 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12c972-1e3c-4201-9f27-3d08835557b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:34.545561 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12c972-1e3c-4201-9f27-3d08835557b4 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:34.559918 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-5a12c972-1e3c-4201-9f27-3d08835557b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:56:34.561319 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 255/520] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:56:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:34.562259 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12c972-1e3c-4201-9f27-3d08835557b4 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:34.572646 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83fc66-ddaf-4417-a821-5319d502c62c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:34.574361 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83fc66-ddaf-4417-a821-5319d502c62c None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:34.658117 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12c972-1e3c-4201-9f27-3d08835557b4 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:34.671802 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 266/521] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:56:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:56:34.673197 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83fc66-ddaf-4417-a821-5319d502c62c None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:34.692414 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b1a4d-9575-45e2-ab9d-2e9c10655a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:34.693470 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b1a4d-9575-45e2-ab9d-2e9c10655a16 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:34.693790 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b1a4d-9575-45e2-ab9d-2e9c10655a16 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:34.694031 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b1a4d-9575-45e2-ab9d-2e9c10655a16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:34.703878 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b1a4d-9575-45e2-ab9d-2e9c10655a16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:34.705516 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b1a4d-9575-45e2-ab9d-2e9c10655a16 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:34.722837 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-832b1a4d-9575-45e2-ab9d-2e9c10655a16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:34.728603 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 256/522] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:34.728603 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b1a4d-9575-45e2-ab9d-2e9c10655a16 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:34.771225 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83fc66-ddaf-4417-a821-5319d502c62c None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:34.807456 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05b830-9374-43ff-997f-d8507bceaa81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:34.808274 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05b830-9374-43ff-997f-d8507bceaa81 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:34.808557 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05b830-9374-43ff-997f-d8507bceaa81 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:34.808833 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05b830-9374-43ff-997f-d8507bceaa81 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:34.815915 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a05b830-9374-43ff-997f-d8507bceaa81 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:34.817342 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a05b830-9374-43ff-997f-d8507bceaa81 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:34.826238 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b1a4d-9575-45e2-ab9d-2e9c10655a16 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:34.831274 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-1a05b830-9374-43ff-997f-d8507bceaa81 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 10 03:56:34.837044 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 267/523] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Mar 10 03:56:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:34.837044 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05b830-9374-43ff-997f-d8507bceaa81 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:34.864182 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca0103-674e-4445-9f7e-592cf758a0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:34.864843 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca0103-674e-4445-9f7e-592cf758a0d2 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:34.865125 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca0103-674e-4445-9f7e-592cf758a0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:34.865403 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca0103-674e-4445-9f7e-592cf758a0d2 None admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:34.866183 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca0103-674e-4445-9f7e-592cf758a0d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:34.866492 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca0103-674e-4445-9f7e-592cf758a0d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:34.867935 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca0103-674e-4445-9f7e-592cf758a0d2 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:34.890532 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 257/524] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:56:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:34.890532 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca0103-674e-4445-9f7e-592cf758a0d2 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:34.929703 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05b830-9374-43ff-997f-d8507bceaa81 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:34.962393 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9c807-7c38-4584-a71f-a505ad1fcec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:34.963264 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9c807-7c38-4584-a71f-a505ad1fcec1 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:34.963619 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9c807-7c38-4584-a71f-a505ad1fcec1 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:34.963994 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9c807-7c38-4584-a71f-a505ad1fcec1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:34.974224 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9c807-7c38-4584-a71f-a505ad1fcec1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:34.975658 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9c807-7c38-4584-a71f-a505ad1fcec1 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:34.991274 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca0103-674e-4445-9f7e-592cf758a0d2 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:34.991867 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-b1e9c807-7c38-4584-a71f-a505ad1fcec1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:34.997737 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 268/525] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:34.997737 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9c807-7c38-4584-a71f-a505ad1fcec1 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:35.033894 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c14d00-4932-4077-a184-5f29be299373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:35.035307 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c14d00-4932-4077-a184-5f29be299373 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:35.035634 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c14d00-4932-4077-a184-5f29be299373 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:35.036032 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c14d00-4932-4077-a184-5f29be299373 None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:35.036854 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c14d00-4932-4077-a184-5f29be299373 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:35.037210 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c14d00-4932-4077-a184-5f29be299373 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:35.038691 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c14d00-4932-4077-a184-5f29be299373 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:35.051252 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 258/526] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:35.052247 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c14d00-4932-4077-a184-5f29be299373 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:35.098322 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9c807-7c38-4584-a71f-a505ad1fcec1 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:35.133916 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0818b2-c5dd-4c95-b53f-e210765c02c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:35.134841 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0818b2-c5dd-4c95-b53f-e210765c02c5 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:35.135276 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0818b2-c5dd-4c95-b53f-e210765c02c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:35.135556 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0818b2-c5dd-4c95-b53f-e210765c02c5 None admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:35.136414 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0818b2-c5dd-4c95-b53f-e210765c02c5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:35.136723 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0818b2-c5dd-4c95-b53f-e210765c02c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:35.138136 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0818b2-c5dd-4c95-b53f-e210765c02c5 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:35.152898 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c14d00-4932-4077-a184-5f29be299373 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:35.155584 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 269/527] 10.222.0.15 () {56 vars in 1139 bytes} [Thu Mar 10 03:56:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:35.156088 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0818b2-c5dd-4c95-b53f-e210765c02c5 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:35.189572 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3fd186-8351-4e6e-955e-ed949c7b8b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:35.190483 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fd186-8351-4e6e-955e-ed949c7b8b5b None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:35.190483 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fd186-8351-4e6e-955e-ed949c7b8b5b None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:35.190839 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fd186-8351-4e6e-955e-ed949c7b8b5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:35.191665 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3fd186-8351-4e6e-955e-ed949c7b8b5b None admin] RBAC: Adding query filter params (role.id=3fb134668432434eb45c3bb21cb5882e, scope.project.id=0846fccaeb674395a87e45290eda74b7, user.id=fbd92bd14ed04621af06d68161798fe3) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:35.192012 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3fd186-8351-4e6e-955e-ed949c7b8b5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:35.193700 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3fd186-8351-4e6e-955e-ed949c7b8b5b None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:35.207985 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 259/528] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:56:35 2022] GET /identity/v3/role_assignments?user.id=fbd92bd14ed04621af06d68161798fe3&scope.project.id=0846fccaeb674395a87e45290eda74b7&role.id=3fb134668432434eb45c3bb21cb5882e => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:35.207985 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3fd186-8351-4e6e-955e-ed949c7b8b5b None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:35.280229 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0818b2-c5dd-4c95-b53f-e210765c02c5 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:35.308103 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3fd186-8351-4e6e-955e-ed949c7b8b5b None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:35.324982 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17648c0-45cc-4cfb-86f2-e758ffe3e983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:35.326018 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17648c0-45cc-4cfb-86f2-e758ffe3e983 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:35.326529 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17648c0-45cc-4cfb-86f2-e758ffe3e983 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:35.327045 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17648c0-45cc-4cfb-86f2-e758ffe3e983 None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:35.328018 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17648c0-45cc-4cfb-86f2-e758ffe3e983 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:35.328529 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17648c0-45cc-4cfb-86f2-e758ffe3e983 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:35.330160 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17648c0-45cc-4cfb-86f2-e758ffe3e983 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:35.343233 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 270/529] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:35.344548 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17648c0-45cc-4cfb-86f2-e758ffe3e983 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:35.350105 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e264bb-a892-400a-8a54-6da50195c97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:35.350857 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e264bb-a892-400a-8a54-6da50195c97d None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:35.351135 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e264bb-a892-400a-8a54-6da50195c97d None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:35.351408 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e264bb-a892-400a-8a54-6da50195c97d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:35.359421 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e264bb-a892-400a-8a54-6da50195c97d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:35.360801 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e264bb-a892-400a-8a54-6da50195c97d None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:35.374597 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-f5e264bb-a892-400a-8a54-6da50195c97d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:56:35.381108 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 260/530] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:56:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:35.381108 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e264bb-a892-400a-8a54-6da50195c97d None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:35.469782 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17648c0-45cc-4cfb-86f2-e758ffe3e983 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:35.490513 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e264bb-a892-400a-8a54-6da50195c97d None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:35.508834 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128fe6d-e77c-4902-b709-76160d27b1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:35.509484 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128fe6d-e77c-4902-b709-76160d27b1db None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:35.509764 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128fe6d-e77c-4902-b709-76160d27b1db None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:35.510037 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128fe6d-e77c-4902-b709-76160d27b1db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:35.526905 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac93dc-236d-4b26-9391-82900182acfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:35.527766 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac93dc-236d-4b26-9391-82900182acfe None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:35.528050 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac93dc-236d-4b26-9391-82900182acfe None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:35.528324 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac93dc-236d-4b26-9391-82900182acfe None admin] PATH_INFO: `/v3/projects/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:35.536170 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac93dc-236d-4b26-9391-82900182acfe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:35.537650 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac93dc-236d-4b26-9391-82900182acfe None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:35.552439 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-c6ac93dc-236d-4b26-9391-82900182acfe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:56:35.553709 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 261/531] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:56:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:35.554482 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac93dc-236d-4b26-9391-82900182acfe None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:35.589282 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128fe6d-e77c-4902-b709-76160d27b1db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:35.590737 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128fe6d-e77c-4902-b709-76160d27b1db None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:35.661111 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac93dc-236d-4b26-9391-82900182acfe None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:35.692078 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 271/532] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:56:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:56:35.693339 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128fe6d-e77c-4902-b709-76160d27b1db None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:35.696751 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032ca0f-8818-4c15-ac06-4a0aeb53f2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:35.697497 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032ca0f-8818-4c15-ac06-4a0aeb53f2db None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:35.697784 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032ca0f-8818-4c15-ac06-4a0aeb53f2db None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:35.698065 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032ca0f-8818-4c15-ac06-4a0aeb53f2db None admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:35.698898 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1032ca0f-8818-4c15-ac06-4a0aeb53f2db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:35.699214 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1032ca0f-8818-4c15-ac06-4a0aeb53f2db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:35.700691 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1032ca0f-8818-4c15-ac06-4a0aeb53f2db None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:35.713374 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 262/533] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:56:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:35.714157 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032ca0f-8818-4c15-ac06-4a0aeb53f2db None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:35.787342 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128fe6d-e77c-4902-b709-76160d27b1db None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:35.812566 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032ca0f-8818-4c15-ac06-4a0aeb53f2db None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:35.820819 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f2704-45e6-4c84-b3ec-fd5f531f1e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:35.821475 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f2704-45e6-4c84-b3ec-fd5f531f1e6e None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:35.821756 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f2704-45e6-4c84-b3ec-fd5f531f1e6e None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:35.822035 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f2704-45e6-4c84-b3ec-fd5f531f1e6e None admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:35.822808 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f2704-45e6-4c84-b3ec-fd5f531f1e6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:35.823116 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f2704-45e6-4c84-b3ec-fd5f531f1e6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:35.824566 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f2704-45e6-4c84-b3ec-fd5f531f1e6e None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:35.846846 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 272/534] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:56:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:35.847215 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0898bf-d988-4f37-a261-a3d2312a6047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:35.847749 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f2704-45e6-4c84-b3ec-fd5f531f1e6e None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:35.848045 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0898bf-d988-4f37-a261-a3d2312a6047 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:35.848327 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0898bf-d988-4f37-a261-a3d2312a6047 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:35.848606 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0898bf-d988-4f37-a261-a3d2312a6047 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:35.859550 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0898bf-d988-4f37-a261-a3d2312a6047 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:35.861101 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0898bf-d988-4f37-a261-a3d2312a6047 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:35.878095 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-8a0898bf-d988-4f37-a261-a3d2312a6047 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:35.880091 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 263/535] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:35.880870 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0898bf-d988-4f37-a261-a3d2312a6047 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:35.948960 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f2704-45e6-4c84-b3ec-fd5f531f1e6e None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:35.981123 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec8aa5-e138-4b8a-aee7-8fcbd0c6ccb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:35.981602 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0898bf-d988-4f37-a261-a3d2312a6047 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:35.981782 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec8aa5-e138-4b8a-aee7-8fcbd0c6ccb4 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:35.982038 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec8aa5-e138-4b8a-aee7-8fcbd0c6ccb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:35.982309 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec8aa5-e138-4b8a-aee7-8fcbd0c6ccb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:35.983134 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec8aa5-e138-4b8a-aee7-8fcbd0c6ccb4 None admin] RBAC: Adding query filter params (role.id=3fb134668432434eb45c3bb21cb5882e, scope.project.id=0846fccaeb674395a87e45290eda74b7, user.id=6e7c195f91114855acc58163631544d7) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:35.983447 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec8aa5-e138-4b8a-aee7-8fcbd0c6ccb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:35.984899 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec8aa5-e138-4b8a-aee7-8fcbd0c6ccb4 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:35.991089 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 273/536] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:56:35 2022] GET /identity/v3/role_assignments?user.id=6e7c195f91114855acc58163631544d7&scope.project.id=0846fccaeb674395a87e45290eda74b7&role.id=3fb134668432434eb45c3bb21cb5882e => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:35.991912 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec8aa5-e138-4b8a-aee7-8fcbd0c6ccb4 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:36.020887 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b506e-4f9e-4640-8f4c-7f6e679d3af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:36.021596 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b506e-4f9e-4640-8f4c-7f6e679d3af8 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:36.021878 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b506e-4f9e-4640-8f4c-7f6e679d3af8 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:36.022213 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b506e-4f9e-4640-8f4c-7f6e679d3af8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:36.023080 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b506e-4f9e-4640-8f4c-7f6e679d3af8 None admin] RBAC: Adding query filter params (role.id=3fb134668432434eb45c3bb21cb5882e, scope.project.id=0846fccaeb674395a87e45290eda74b7, user.id=b6baa51b91a74ebbab55d644894acd81) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:36.023394 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b506e-4f9e-4640-8f4c-7f6e679d3af8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:36.024919 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b506e-4f9e-4640-8f4c-7f6e679d3af8 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:36.031145 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 264/537] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:56:35 2022] GET /identity/v3/role_assignments?user.id=b6baa51b91a74ebbab55d644894acd81&scope.project.id=0846fccaeb674395a87e45290eda74b7&role.id=3fb134668432434eb45c3bb21cb5882e => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:36.158165 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec8aa5-e138-4b8a-aee7-8fcbd0c6ccb4 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:36.211312 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540deaca-6e26-4241-9f4c-e58b295ceb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:36.211958 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540deaca-6e26-4241-9f4c-e58b295ceb0a None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:36.212243 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540deaca-6e26-4241-9f4c-e58b295ceb0a None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:36.212516 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540deaca-6e26-4241-9f4c-e58b295ceb0a None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:36.213252 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540deaca-6e26-4241-9f4c-e58b295ceb0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:36.213557 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540deaca-6e26-4241-9f4c-e58b295ceb0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:36.214950 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540deaca-6e26-4241-9f4c-e58b295ceb0a None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:36.228911 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 274/538] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:36.234402 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b506e-4f9e-4640-8f4c-7f6e679d3af8 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:36.359603 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b506e-4f9e-4640-8f4c-7f6e679d3af8 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:36.405461 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b85903-e28e-4fa2-9d1f-a9e415c07cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:36.406256 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b85903-e28e-4fa2-9d1f-a9e415c07cd3 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:36.406532 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b85903-e28e-4fa2-9d1f-a9e415c07cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:36.406804 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b85903-e28e-4fa2-9d1f-a9e415c07cd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:36.418506 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b85903-e28e-4fa2-9d1f-a9e415c07cd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:36.419989 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b85903-e28e-4fa2-9d1f-a9e415c07cd3 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:36.437655 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-07b85903-e28e-4fa2-9d1f-a9e415c07cd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:56:36.439143 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 265/539] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:56:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:36.444737 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540deaca-6e26-4241-9f4c-e58b295ceb0a None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:36.595633 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540deaca-6e26-4241-9f4c-e58b295ceb0a None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:36.637243 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048e055-7cd3-4fe8-97e0-18800652fe98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:36.637909 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048e055-7cd3-4fe8-97e0-18800652fe98 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:36.638191 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048e055-7cd3-4fe8-97e0-18800652fe98 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:36.638463 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048e055-7cd3-4fe8-97e0-18800652fe98 None admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:36.639246 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048e055-7cd3-4fe8-97e0-18800652fe98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:36.639550 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048e055-7cd3-4fe8-97e0-18800652fe98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:36.641012 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048e055-7cd3-4fe8-97e0-18800652fe98 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:36.657303 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 275/540] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:56:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:36.663841 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b85903-e28e-4fa2-9d1f-a9e415c07cd3 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:36.774379 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b85903-e28e-4fa2-9d1f-a9e415c07cd3 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:36.807854 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00ecc4-feb8-4224-8b89-968fba8909db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:36.808509 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00ecc4-feb8-4224-8b89-968fba8909db None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:36.808786 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00ecc4-feb8-4224-8b89-968fba8909db None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:36.809059 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00ecc4-feb8-4224-8b89-968fba8909db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:36.809880 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00ecc4-feb8-4224-8b89-968fba8909db None admin] RBAC: Adding query filter params (role.id=3fb134668432434eb45c3bb21cb5882e, scope.project.id=0846fccaeb674395a87e45290eda74b7, user.id=2faf262ae9d643c0b8708dcfecd75b3f) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:36.810186 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00ecc4-feb8-4224-8b89-968fba8909db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:36.811619 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00ecc4-feb8-4224-8b89-968fba8909db None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:36.818104 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 266/541] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:56:36 2022] GET /identity/v3/role_assignments?user.id=2faf262ae9d643c0b8708dcfecd75b3f&scope.project.id=0846fccaeb674395a87e45290eda74b7&role.id=3fb134668432434eb45c3bb21cb5882e => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:36.851795 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3fa1f-3799-47e2-82db-9e3e6d02f30e None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:36.851795 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3fa1f-3799-47e2-82db-9e3e6d02f30e None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:36.851795 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3fa1f-3799-47e2-82db-9e3e6d02f30e None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:36.854793 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 276/542] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:36.859373 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ea869-6ff1-47ef-b65a-fcf02acb7241 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:36.859658 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ea869-6ff1-47ef-b65a-fcf02acb7241 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:36.860085 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ea869-6ff1-47ef-b65a-fcf02acb7241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:36.877178 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-b91ea869-6ff1-47ef-b65a-fcf02acb7241 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:36.878906 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-b91ea869-6ff1-47ef-b65a-fcf02acb7241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:36.949302 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 267/543] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:36.985649 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3fa1f-3799-47e2-82db-9e3e6d02f30e None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:37.120551 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3fa1f-3799-47e2-82db-9e3e6d02f30e None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:37.153761 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad1325-45ba-4a50-b8a2-858b3298c254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:37.154552 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad1325-45ba-4a50-b8a2-858b3298c254 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:37.154886 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad1325-45ba-4a50-b8a2-858b3298c254 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:37.155163 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad1325-45ba-4a50-b8a2-858b3298c254 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:37.165228 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad1325-45ba-4a50-b8a2-858b3298c254 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:37.172291 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-f1ad1325-45ba-4a50-b8a2-858b3298c254 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 03:56:37.173828 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 277/544] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Mar 10 03:56:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:37.180042 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ea869-6ff1-47ef-b65a-fcf02acb7241 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:37.288473 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ea869-6ff1-47ef-b65a-fcf02acb7241 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:37.323510 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b9190-8757-4dcc-96ef-13ccc4c00fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:37.324205 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b9190-8757-4dcc-96ef-13ccc4c00fab None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:37.324482 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b9190-8757-4dcc-96ef-13ccc4c00fab None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:37.324754 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b9190-8757-4dcc-96ef-13ccc4c00fab None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:37.325494 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b9190-8757-4dcc-96ef-13ccc4c00fab None admin] RBAC: Adding query filter params (name=service) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:37.325798 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b9190-8757-4dcc-96ef-13ccc4c00fab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:37.327173 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b9190-8757-4dcc-96ef-13ccc4c00fab None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:37.335778 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 268/545] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Mar 10 03:56:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:37.345003 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad1325-45ba-4a50-b8a2-858b3298c254 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:37.464731 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad1325-45ba-4a50-b8a2-858b3298c254 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:37.504269 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c24ba-285c-4bf4-b623-4f1de5eb4e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:37.505100 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c24ba-285c-4bf4-b623-4f1de5eb4e49 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:37.505382 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c24ba-285c-4bf4-b623-4f1de5eb4e49 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:37.505652 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c24ba-285c-4bf4-b623-4f1de5eb4e49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:37.521546 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c24ba-285c-4bf4-b623-4f1de5eb4e49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:37.523031 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c24ba-285c-4bf4-b623-4f1de5eb4e49 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:37.543792 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-291c24ba-285c-4bf4-b623-4f1de5eb4e49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:37.545193 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 278/546] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:56:37.552205 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b9190-8757-4dcc-96ef-13ccc4c00fab None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:37.659938 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b9190-8757-4dcc-96ef-13ccc4c00fab None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:37.695509 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f6ae0-7604-473e-ba3d-889c42ce5a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:37.696276 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f6ae0-7604-473e-ba3d-889c42ce5a51 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:37.696476 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f6ae0-7604-473e-ba3d-889c42ce5a51 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:37.696753 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f6ae0-7604-473e-ba3d-889c42ce5a51 None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:37.697536 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f6ae0-7604-473e-ba3d-889c42ce5a51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:37.697834 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f6ae0-7604-473e-ba3d-889c42ce5a51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:37.699256 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f6ae0-7604-473e-ba3d-889c42ce5a51 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:37.711500 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 269/547] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:37.716901 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c24ba-285c-4bf4-b623-4f1de5eb4e49 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:37.841999 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c24ba-285c-4bf4-b623-4f1de5eb4e49 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:37.877634 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289dfa47-1c1a-489d-ab40-41fe64b9d83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:37.878461 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289dfa47-1c1a-489d-ab40-41fe64b9d83b None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:37.878793 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289dfa47-1c1a-489d-ab40-41fe64b9d83b None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:37.879070 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289dfa47-1c1a-489d-ab40-41fe64b9d83b None admin] PATH_INFO: `/v3/users/swift` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:37.886823 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289dfa47-1c1a-489d-ab40-41fe64b9d83b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:37.888382 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289dfa47-1c1a-489d-ab40-41fe64b9d83b None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:37.902028 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-289dfa47-1c1a-489d-ab40-41fe64b9d83b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 10 03:56:37.903525 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 279/548] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:56:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:37.909064 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f6ae0-7604-473e-ba3d-889c42ce5a51 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:38.010586 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f6ae0-7604-473e-ba3d-889c42ce5a51 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:38.045070 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12e112-59d8-43d4-b634-6d4deaacb287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:38.045735 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12e112-59d8-43d4-b634-6d4deaacb287 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:38.046013 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12e112-59d8-43d4-b634-6d4deaacb287 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:38.046285 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12e112-59d8-43d4-b634-6d4deaacb287 None admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:38.047107 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12e112-59d8-43d4-b634-6d4deaacb287 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:38.047410 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12e112-59d8-43d4-b634-6d4deaacb287 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:38.048973 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12e112-59d8-43d4-b634-6d4deaacb287 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:38.086259 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 270/549] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Mar 10 03:56:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:38.094716 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289dfa47-1c1a-489d-ab40-41fe64b9d83b None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:38.214699 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ba45d-81b4-4dc9-a8df-2bbe0fe1e1f2 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:38.215018 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ba45d-81b4-4dc9-a8df-2bbe0fe1e1f2 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:38.215250 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ba45d-81b4-4dc9-a8df-2bbe0fe1e1f2 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:38.217206 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 271/550] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 03:56:38.221212 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289dfa47-1c1a-489d-ab40-41fe64b9d83b None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:38.223443 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3af87-8e41-49f2-9d92-fefc95e88445 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:38.223750 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3af87-8e41-49f2-9d92-fefc95e88445 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:38.224030 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3af87-8e41-49f2-9d92-fefc95e88445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:38.248663 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-18e3af87-8e41-49f2-9d92-fefc95e88445 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:38.249851 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-18e3af87-8e41-49f2-9d92-fefc95e88445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:38.298452 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179c950-9266-48a0-8c0c-8136b3f2da36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:38.299102 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179c950-9266-48a0-8c0c-8136b3f2da36 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:38.299380 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179c950-9266-48a0-8c0c-8136b3f2da36 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:38.299650 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179c950-9266-48a0-8c0c-8136b3f2da36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:38.379213 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 272/551] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:38.405123 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179c950-9266-48a0-8c0c-8136b3f2da36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:38.406663 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179c950-9266-48a0-8c0c-8136b3f2da36 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:38.424517 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3af87-8e41-49f2-9d92-fefc95e88445 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:38.600300 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 280/552] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:56:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:56:38.602929 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179c950-9266-48a0-8c0c-8136b3f2da36 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:38.615327 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3af87-8e41-49f2-9d92-fefc95e88445 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:38.690507 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972ff24-7a11-40db-8826-c28d17ea4a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:38.691849 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972ff24-7a11-40db-8826-c28d17ea4a95 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:38.692131 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972ff24-7a11-40db-8826-c28d17ea4a95 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:38.692405 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972ff24-7a11-40db-8826-c28d17ea4a95 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:38.704483 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972ff24-7a11-40db-8826-c28d17ea4a95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:38.712518 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-f972ff24-7a11-40db-8826-c28d17ea4a95 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 03:56:38.714205 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 273/553] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Mar 10 03:56:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:56:38.715603 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e0049-17b0-4401-b1c1-45d3df72ef9d None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:38.716237 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e0049-17b0-4401-b1c1-45d3df72ef9d None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:38.716708 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e0049-17b0-4401-b1c1-45d3df72ef9d None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:38.722696 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 274/554] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:38.723709 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e0049-17b0-4401-b1c1-45d3df72ef9d None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:38.756497 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179c950-9266-48a0-8c0c-8136b3f2da36 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:38.791178 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ebd13-5662-45c7-bff5-5b388e1de4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:38.792339 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ebd13-5662-45c7-bff5-5b388e1de4d8 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:38.792827 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ebd13-5662-45c7-bff5-5b388e1de4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:38.793300 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ebd13-5662-45c7-bff5-5b388e1de4d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:38.804372 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ebd13-5662-45c7-bff5-5b388e1de4d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:38.806070 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ebd13-5662-45c7-bff5-5b388e1de4d8 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:38.824581 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-af9ebd13-5662-45c7-bff5-5b388e1de4d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:38.830577 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 281/555] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:38.832623 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a4663-f10b-4733-979a-51285af9aaba None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:38.833157 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a4663-f10b-4733-979a-51285af9aaba None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:38.833524 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e0049-17b0-4401-b1c1-45d3df72ef9d None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:38.833839 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a4663-f10b-4733-979a-51285af9aaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:38.850886 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-6f1a4663-f10b-4733-979a-51285af9aaba None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:38.852498 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-6f1a4663-f10b-4733-979a-51285af9aaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:38.872469 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d8b02-1911-4937-8866-d289ef9e89ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:38.873249 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d8b02-1911-4937-8866-d289ef9e89ef None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:38.873609 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d8b02-1911-4937-8866-d289ef9e89ef None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:38.873955 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d8b02-1911-4937-8866-d289ef9e89ef None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:38.875195 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d8b02-1911-4937-8866-d289ef9e89ef None admin] RBAC: Adding query filter params (name=service) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:38.875575 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d8b02-1911-4937-8866-d289ef9e89ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:38.877512 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d8b02-1911-4937-8866-d289ef9e89ef None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:38.890639 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 275/556] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Mar 10 03:56:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:38.891442 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d8b02-1911-4937-8866-d289ef9e89ef None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:38.923537 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 282/557] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:38.926060 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade640d-185a-4555-a717-3727461ae4c4 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:38.926559 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade640d-185a-4555-a717-3727461ae4c4 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:38.927011 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade640d-185a-4555-a717-3727461ae4c4 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:38.929159 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 283/558] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:38.930157 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade640d-185a-4555-a717-3727461ae4c4 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:38.999464 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d8b02-1911-4937-8866-d289ef9e89ef None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:39.032577 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc05bd3-0589-4e29-be68-bf8981d98047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:39.033232 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc05bd3-0589-4e29-be68-bf8981d98047 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:39.033534 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc05bd3-0589-4e29-be68-bf8981d98047 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:39.033814 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc05bd3-0589-4e29-be68-bf8981d98047 None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:39.034558 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc05bd3-0589-4e29-be68-bf8981d98047 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:39.034868 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc05bd3-0589-4e29-be68-bf8981d98047 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:39.036287 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc05bd3-0589-4e29-be68-bf8981d98047 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:39.041925 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade640d-185a-4555-a717-3727461ae4c4 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:39.047753 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 276/559] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:39.049067 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd40d3-36a4-4144-bc5f-be904ee25370 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:39.049409 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd40d3-36a4-4144-bc5f-be904ee25370 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:39.049692 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd40d3-36a4-4144-bc5f-be904ee25370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:39.068634 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-23fd40d3-36a4-4144-bc5f-be904ee25370 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:39.069852 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-23fd40d3-36a4-4144-bc5f-be904ee25370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:39.084780 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39867a73-9eb8-4661-b961-70099317d270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:39.085575 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39867a73-9eb8-4661-b961-70099317d270 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:39.085861 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39867a73-9eb8-4661-b961-70099317d270 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:39.086135 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39867a73-9eb8-4661-b961-70099317d270 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:39.095825 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39867a73-9eb8-4661-b961-70099317d270 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:39.097801 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39867a73-9eb8-4661-b961-70099317d270 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:39.115797 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-39867a73-9eb8-4661-b961-70099317d270 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:39.117004 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 284/560] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:39.122060 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39867a73-9eb8-4661-b961-70099317d270 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:39.151704 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 277/561] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:39.151704 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd40d3-36a4-4144-bc5f-be904ee25370 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:39.231472 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39867a73-9eb8-4661-b961-70099317d270 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:39.239521 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd40d3-36a4-4144-bc5f-be904ee25370 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:39.266349 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55da63-7de3-465c-9ebe-0c029e7d6dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:39.267378 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55da63-7de3-465c-9ebe-0c029e7d6dab None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:39.267663 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55da63-7de3-465c-9ebe-0c029e7d6dab None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:39.267975 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55da63-7de3-465c-9ebe-0c029e7d6dab None admin] PATH_INFO: `/v3/roles/service` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:39.273257 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b0041-d9ed-41b6-b41c-a4699bbba423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:39.274159 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b0041-d9ed-41b6-b41c-a4699bbba423 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:39.274448 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b0041-d9ed-41b6-b41c-a4699bbba423 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:39.274728 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b0041-d9ed-41b6-b41c-a4699bbba423 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:39.278608 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55da63-7de3-465c-9ebe-0c029e7d6dab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:39.281475 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b0041-d9ed-41b6-b41c-a4699bbba423 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:39.282934 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b0041-d9ed-41b6-b41c-a4699bbba423 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:39.285780 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-db55da63-7de3-465c-9ebe-0c029e7d6dab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 03:56:39.287169 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 285/562] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Mar 10 03:56:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:39.288991 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55da63-7de3-465c-9ebe-0c029e7d6dab None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:39.295629 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-3d3b0041-d9ed-41b6-b41c-a4699bbba423 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:56:39.301538 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 278/563] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:56:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:39.301538 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b0041-d9ed-41b6-b41c-a4699bbba423 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:39.401647 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55da63-7de3-465c-9ebe-0c029e7d6dab None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:39.402509 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b0041-d9ed-41b6-b41c-a4699bbba423 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:39.433884 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec6f70-8ca6-4531-91f7-db2d3a4c3982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:39.434543 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec6f70-8ca6-4531-91f7-db2d3a4c3982 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:39.434826 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec6f70-8ca6-4531-91f7-db2d3a4c3982 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:39.434945 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244201ab-330d-4fc9-b46d-ccd6cf446806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:39.435115 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec6f70-8ca6-4531-91f7-db2d3a4c3982 None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:39.435665 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244201ab-330d-4fc9-b46d-ccd6cf446806 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:39.435843 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec6f70-8ca6-4531-91f7-db2d3a4c3982 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:39.436006 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244201ab-330d-4fc9-b46d-ccd6cf446806 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:39.436156 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec6f70-8ca6-4531-91f7-db2d3a4c3982 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:39.436307 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244201ab-330d-4fc9-b46d-ccd6cf446806 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:39.437491 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec6f70-8ca6-4531-91f7-db2d3a4c3982 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:39.446918 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244201ab-330d-4fc9-b46d-ccd6cf446806 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:39.453854 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 286/564] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:39.453854 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec6f70-8ca6-4531-91f7-db2d3a4c3982 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:39.454663 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-244201ab-330d-4fc9-b46d-ccd6cf446806 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 03:56:39.460475 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 279/565] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Mar 10 03:56:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:39.460475 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244201ab-330d-4fc9-b46d-ccd6cf446806 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:39.553841 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244201ab-330d-4fc9-b46d-ccd6cf446806 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:39.559975 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec6f70-8ca6-4531-91f7-db2d3a4c3982 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:39.588109 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd5be4-b43f-4852-9f60-831c904e5645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:39.588764 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd5be4-b43f-4852-9f60-831c904e5645 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:39.589046 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd5be4-b43f-4852-9f60-831c904e5645 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:39.589341 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd5be4-b43f-4852-9f60-831c904e5645 None admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:39.590110 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd5be4-b43f-4852-9f60-831c904e5645 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:39.590410 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd5be4-b43f-4852-9f60-831c904e5645 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:39.591890 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd5be4-b43f-4852-9f60-831c904e5645 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:39.595247 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfad83e-3e54-42e6-b0b6-35a3d7027d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:39.596166 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfad83e-3e54-42e6-b0b6-35a3d7027d3d None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:39.596662 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfad83e-3e54-42e6-b0b6-35a3d7027d3d None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:39.597122 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfad83e-3e54-42e6-b0b6-35a3d7027d3d None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:39.598185 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfad83e-3e54-42e6-b0b6-35a3d7027d3d None admin] RBAC: Adding query filter params (name=service) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:39.598684 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfad83e-3e54-42e6-b0b6-35a3d7027d3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:39.600093 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfad83e-3e54-42e6-b0b6-35a3d7027d3d None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:39.608352 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 280/566] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:56:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:39.608352 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd5be4-b43f-4852-9f60-831c904e5645 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:39.617045 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 287/567] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Mar 10 03:56:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:39.617045 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfad83e-3e54-42e6-b0b6-35a3d7027d3d None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:39.713798 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd5be4-b43f-4852-9f60-831c904e5645 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:39.715644 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfad83e-3e54-42e6-b0b6-35a3d7027d3d None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:39.745824 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115136e-4cd4-4a6f-99f4-3a4b423c017f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:39.746606 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115136e-4cd4-4a6f-99f4-3a4b423c017f None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:39.746885 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115136e-4cd4-4a6f-99f4-3a4b423c017f None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:39.747014 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c388ee-fa65-48d2-81ce-1ce2c002b35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:39.747156 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115136e-4cd4-4a6f-99f4-3a4b423c017f None admin] PATH_INFO: `/v3/users/nova` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:39.747669 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c388ee-fa65-48d2-81ce-1ce2c002b35c None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:39.747983 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c388ee-fa65-48d2-81ce-1ce2c002b35c None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:39.748261 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c388ee-fa65-48d2-81ce-1ce2c002b35c None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:39.749000 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c388ee-fa65-48d2-81ce-1ce2c002b35c None admin] RBAC: Adding query filter params (name=service) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:39.749304 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c388ee-fa65-48d2-81ce-1ce2c002b35c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:39.750669 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c388ee-fa65-48d2-81ce-1ce2c002b35c None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:39.754592 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115136e-4cd4-4a6f-99f4-3a4b423c017f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:39.756072 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115136e-4cd4-4a6f-99f4-3a4b423c017f None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:39.758715 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 288/568] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Mar 10 03:56:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:39.759489 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c388ee-fa65-48d2-81ce-1ce2c002b35c None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:39.769533 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-0115136e-4cd4-4a6f-99f4-3a4b423c017f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 10 03:56:39.770695 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 281/569] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Mar 10 03:56:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:39.771449 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115136e-4cd4-4a6f-99f4-3a4b423c017f None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:39.851779 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c388ee-fa65-48d2-81ce-1ce2c002b35c None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:39.863116 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115136e-4cd4-4a6f-99f4-3a4b423c017f None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:39.883080 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d6906-099b-451e-8c35-747076f78f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:39.883750 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d6906-099b-451e-8c35-747076f78f57 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:39.884031 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d6906-099b-451e-8c35-747076f78f57 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:39.884301 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d6906-099b-451e-8c35-747076f78f57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:39.885112 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d6906-099b-451e-8c35-747076f78f57 None admin] RBAC: Adding query filter params (role.id=3fb134668432434eb45c3bb21cb5882e, scope.project.id=0846fccaeb674395a87e45290eda74b7, user.id=260f561c676b4d049553eac4626b5502) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:39.885418 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d6906-099b-451e-8c35-747076f78f57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:39.886840 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d6906-099b-451e-8c35-747076f78f57 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:39.891951 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 289/570] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:56:39 2022] GET /identity/v3/role_assignments?user.id=260f561c676b4d049553eac4626b5502&scope.project.id=0846fccaeb674395a87e45290eda74b7&role.id=3fb134668432434eb45c3bb21cb5882e => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:39.893109 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9d8b7-4f37-4371-8b89-4b9fae516987 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:39.893391 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9d8b7-4f37-4371-8b89-4b9fae516987 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:39.893772 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9d8b7-4f37-4371-8b89-4b9fae516987 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:39.895396 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 290/571] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:39.896140 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9d8b7-4f37-4371-8b89-4b9fae516987 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:39.905805 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68047d05-02df-48ed-b19c-1bfbc9ad086c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:39.906643 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68047d05-02df-48ed-b19c-1bfbc9ad086c None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:39.906930 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68047d05-02df-48ed-b19c-1bfbc9ad086c None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:39.907209 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68047d05-02df-48ed-b19c-1bfbc9ad086c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:39.918964 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68047d05-02df-48ed-b19c-1bfbc9ad086c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:39.920975 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68047d05-02df-48ed-b19c-1bfbc9ad086c None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:39.939228 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-68047d05-02df-48ed-b19c-1bfbc9ad086c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:39.940554 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 282/572] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:39.941346 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68047d05-02df-48ed-b19c-1bfbc9ad086c None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:40.010445 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9d8b7-4f37-4371-8b89-4b9fae516987 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:40.044775 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68047d05-02df-48ed-b19c-1bfbc9ad086c None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:40.045158 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92516b1-634d-4a10-b3d7-9512b65fdb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:40.045961 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92516b1-634d-4a10-b3d7-9512b65fdb5f None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:40.046245 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92516b1-634d-4a10-b3d7-9512b65fdb5f None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:40.046518 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92516b1-634d-4a10-b3d7-9512b65fdb5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:40.058489 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92516b1-634d-4a10-b3d7-9512b65fdb5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:40.060003 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92516b1-634d-4a10-b3d7-9512b65fdb5f None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:40.080408 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-e92516b1-634d-4a10-b3d7-9512b65fdb5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:40.081748 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 291/573] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:40.082913 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46bc8f-781b-4f2b-a68f-9dd1c8f31b77 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:40.083192 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46bc8f-781b-4f2b-a68f-9dd1c8f31b77 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:40.083468 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46bc8f-781b-4f2b-a68f-9dd1c8f31b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:40.084483 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389edd8-8e32-4d6f-b0b3-35dd137bc574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:40.085153 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389edd8-8e32-4d6f-b0b3-35dd137bc574 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:40.085437 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389edd8-8e32-4d6f-b0b3-35dd137bc574 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:40.085717 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389edd8-8e32-4d6f-b0b3-35dd137bc574 None admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:40.086554 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e389edd8-8e32-4d6f-b0b3-35dd137bc574 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:40.087579 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e389edd8-8e32-4d6f-b0b3-35dd137bc574 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:40.088783 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e389edd8-8e32-4d6f-b0b3-35dd137bc574 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:40.100427 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-6f46bc8f-781b-4f2b-a68f-9dd1c8f31b77 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:40.101600 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-6f46bc8f-781b-4f2b-a68f-9dd1c8f31b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:40.111288 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 283/574] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Mar 10 03:56:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:40.111288 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389edd8-8e32-4d6f-b0b3-35dd137bc574 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:40.167203 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 292/575] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:40.168620 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46bc8f-781b-4f2b-a68f-9dd1c8f31b77 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:40.226476 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389edd8-8e32-4d6f-b0b3-35dd137bc574 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:40.258757 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d19540-0574-4777-9633-592fa1c7ce21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:40.259417 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d19540-0574-4777-9633-592fa1c7ce21 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:40.259718 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d19540-0574-4777-9633-592fa1c7ce21 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:40.259997 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d19540-0574-4777-9633-592fa1c7ce21 None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:40.260766 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d19540-0574-4777-9633-592fa1c7ce21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:40.261014 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d19540-0574-4777-9633-592fa1c7ce21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:40.262379 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d19540-0574-4777-9633-592fa1c7ce21 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:40.271057 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46bc8f-781b-4f2b-a68f-9dd1c8f31b77 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:40.273776 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 284/576] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:40.274464 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d19540-0574-4777-9633-592fa1c7ce21 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:40.308716 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33821646-ff6b-4d0b-ab39-60dfa6841b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:40.309373 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33821646-ff6b-4d0b-ab39-60dfa6841b54 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:40.309654 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33821646-ff6b-4d0b-ab39-60dfa6841b54 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:40.309927 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33821646-ff6b-4d0b-ab39-60dfa6841b54 None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:40.310635 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33821646-ff6b-4d0b-ab39-60dfa6841b54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:40.310937 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33821646-ff6b-4d0b-ab39-60dfa6841b54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:40.312317 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33821646-ff6b-4d0b-ab39-60dfa6841b54 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:40.323663 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 293/577] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:40.324531 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33821646-ff6b-4d0b-ab39-60dfa6841b54 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:40.378618 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d19540-0574-4777-9633-592fa1c7ce21 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:40.413746 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbddd64b-7656-4ca6-9963-5f1eac14825d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:40.414675 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddd64b-7656-4ca6-9963-5f1eac14825d None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:40.415022 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddd64b-7656-4ca6-9963-5f1eac14825d None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:40.415382 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddd64b-7656-4ca6-9963-5f1eac14825d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:40.423527 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33821646-ff6b-4d0b-ab39-60dfa6841b54 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:40.427369 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbddd64b-7656-4ca6-9963-5f1eac14825d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:40.428841 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbddd64b-7656-4ca6-9963-5f1eac14825d None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:40.444986 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-fbddd64b-7656-4ca6-9963-5f1eac14825d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:40.450724 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 285/578] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:40.450724 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbddd64b-7656-4ca6-9963-5f1eac14825d None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:40.461631 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab763a-0573-4149-9a15-23f3d2bd41da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:40.462492 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab763a-0573-4149-9a15-23f3d2bd41da None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:40.462777 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab763a-0573-4149-9a15-23f3d2bd41da None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:40.463050 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab763a-0573-4149-9a15-23f3d2bd41da None admin] PATH_INFO: `/v3/roles/service` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:40.473209 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab763a-0573-4149-9a15-23f3d2bd41da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:40.480114 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-deab763a-0573-4149-9a15-23f3d2bd41da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 03:56:40.485880 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 294/579] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Mar 10 03:56:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:40.485880 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab763a-0573-4149-9a15-23f3d2bd41da None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:40.552854 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbddd64b-7656-4ca6-9963-5f1eac14825d None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:40.587577 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02747ea6-d9c1-4e39-997e-da6c5badc807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:40.588636 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02747ea6-d9c1-4e39-997e-da6c5badc807 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:40.588914 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02747ea6-d9c1-4e39-997e-da6c5badc807 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:40.589188 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02747ea6-d9c1-4e39-997e-da6c5badc807 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:40.589403 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab763a-0573-4149-9a15-23f3d2bd41da None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:40.596549 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02747ea6-d9c1-4e39-997e-da6c5badc807 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:40.598211 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02747ea6-d9c1-4e39-997e-da6c5badc807 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:40.611117 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-02747ea6-d9c1-4e39-997e-da6c5badc807 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 10 03:56:40.612491 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 286/580] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:56:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:40.613162 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02747ea6-d9c1-4e39-997e-da6c5badc807 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:40.626838 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f8a9d-0f93-43db-8be1-57d41d4f0a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:40.628425 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f8a9d-0f93-43db-8be1-57d41d4f0a18 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:40.628710 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f8a9d-0f93-43db-8be1-57d41d4f0a18 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:40.628989 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f8a9d-0f93-43db-8be1-57d41d4f0a18 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:40.637662 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f8a9d-0f93-43db-8be1-57d41d4f0a18 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:40.639143 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f8a9d-0f93-43db-8be1-57d41d4f0a18 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:40.653331 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-ce4f8a9d-0f93-43db-8be1-57d41d4f0a18 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 10 03:56:40.659309 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 295/581] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:56:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:40.659309 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f8a9d-0f93-43db-8be1-57d41d4f0a18 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:40.715765 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02747ea6-d9c1-4e39-997e-da6c5badc807 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:40.748132 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb47aa2-c1a3-4ccf-8d6d-600617fd049f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:40.748793 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb47aa2-c1a3-4ccf-8d6d-600617fd049f None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:40.749076 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb47aa2-c1a3-4ccf-8d6d-600617fd049f None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:40.749355 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb47aa2-c1a3-4ccf-8d6d-600617fd049f None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:40.750066 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb47aa2-c1a3-4ccf-8d6d-600617fd049f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:40.750367 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb47aa2-c1a3-4ccf-8d6d-600617fd049f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:40.751775 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb47aa2-c1a3-4ccf-8d6d-600617fd049f None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:40.757245 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f8a9d-0f93-43db-8be1-57d41d4f0a18 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:40.770140 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 287/582] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:40.771411 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb47aa2-c1a3-4ccf-8d6d-600617fd049f None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:40.790910 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd6a10-9c67-43bb-833d-fd1cfa7c7484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:40.791575 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd6a10-9c67-43bb-833d-fd1cfa7c7484 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:40.791877 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd6a10-9c67-43bb-833d-fd1cfa7c7484 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:40.792147 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd6a10-9c67-43bb-833d-fd1cfa7c7484 None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:40.792881 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd6a10-9c67-43bb-833d-fd1cfa7c7484 None admin] RBAC: Adding query filter params (name=service) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:40.793187 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd6a10-9c67-43bb-833d-fd1cfa7c7484 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:40.794540 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd6a10-9c67-43bb-833d-fd1cfa7c7484 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:40.807260 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 296/583] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Mar 10 03:56:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:40.807260 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd6a10-9c67-43bb-833d-fd1cfa7c7484 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:40.868173 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb47aa2-c1a3-4ccf-8d6d-600617fd049f None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:40.898329 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd6a10-9c67-43bb-833d-fd1cfa7c7484 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:40.902420 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31987531-ab75-4c89-819c-45bcbc35ee03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:40.903197 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31987531-ab75-4c89-819c-45bcbc35ee03 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:40.903542 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31987531-ab75-4c89-819c-45bcbc35ee03 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:40.903858 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31987531-ab75-4c89-819c-45bcbc35ee03 None admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:40.904691 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31987531-ab75-4c89-819c-45bcbc35ee03 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:40.905006 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31987531-ab75-4c89-819c-45bcbc35ee03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:40.906433 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31987531-ab75-4c89-819c-45bcbc35ee03 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:40.928896 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 288/584] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Mar 10 03:56:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:40.928896 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31987531-ab75-4c89-819c-45bcbc35ee03 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:40.932286 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacd205-d155-44cc-a565-a4b07c585d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:40.932960 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacd205-d155-44cc-a565-a4b07c585d1b None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:40.933242 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacd205-d155-44cc-a565-a4b07c585d1b None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:40.933516 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacd205-d155-44cc-a565-a4b07c585d1b None admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:40.934351 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfacd205-d155-44cc-a565-a4b07c585d1b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:40.934659 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfacd205-d155-44cc-a565-a4b07c585d1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:40.936218 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfacd205-d155-44cc-a565-a4b07c585d1b None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:40.953616 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 297/585] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Mar 10 03:56:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:40.954759 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacd205-d155-44cc-a565-a4b07c585d1b None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:41.033151 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31987531-ab75-4c89-819c-45bcbc35ee03 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:41.054268 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacd205-d155-44cc-a565-a4b07c585d1b None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:41.067295 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58d6e7-1648-4d22-9d03-2976b3954c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:41.068312 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58d6e7-1648-4d22-9d03-2976b3954c73 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:41.068596 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58d6e7-1648-4d22-9d03-2976b3954c73 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:41.068870 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58d6e7-1648-4d22-9d03-2976b3954c73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:41.075701 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58d6e7-1648-4d22-9d03-2976b3954c73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:41.077150 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58d6e7-1648-4d22-9d03-2976b3954c73 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:41.088752 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897fcaa4-1128-4454-945f-b03b97481f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:41.089543 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897fcaa4-1128-4454-945f-b03b97481f60 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:41.089823 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897fcaa4-1128-4454-945f-b03b97481f60 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:41.090092 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897fcaa4-1128-4454-945f-b03b97481f60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:41.090334 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-1c58d6e7-1648-4d22-9d03-2976b3954c73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:56:41.096250 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 289/586] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:56:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:41.096250 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58d6e7-1648-4d22-9d03-2976b3954c73 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:41.100799 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897fcaa4-1128-4454-945f-b03b97481f60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:41.102245 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897fcaa4-1128-4454-945f-b03b97481f60 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:41.119112 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-897fcaa4-1128-4454-945f-b03b97481f60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:41.125103 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 298/587] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:41.125937 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897fcaa4-1128-4454-945f-b03b97481f60 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:41.191076 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58d6e7-1648-4d22-9d03-2976b3954c73 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:41.218869 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897fcaa4-1128-4454-945f-b03b97481f60 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:41.223565 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa9002-52d8-4af6-9b97-2495226b21dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:41.224382 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa9002-52d8-4af6-9b97-2495226b21dc None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:41.224666 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa9002-52d8-4af6-9b97-2495226b21dc None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:41.224941 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa9002-52d8-4af6-9b97-2495226b21dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:41.234954 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa9002-52d8-4af6-9b97-2495226b21dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:41.236417 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa9002-52d8-4af6-9b97-2495226b21dc None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:41.252184 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-f0fa9002-52d8-4af6-9b97-2495226b21dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:41.253271 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4fe93-6575-4702-87db-e3cdc6b03a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:41.257949 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 290/588] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:41.258073 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4fe93-6575-4702-87db-e3cdc6b03a8c None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:41.258073 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4fe93-6575-4702-87db-e3cdc6b03a8c None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:41.258242 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa9002-52d8-4af6-9b97-2495226b21dc None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:41.258336 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4fe93-6575-4702-87db-e3cdc6b03a8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:41.270813 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4fe93-6575-4702-87db-e3cdc6b03a8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:41.270813 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4fe93-6575-4702-87db-e3cdc6b03a8c None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:41.288618 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-6da4fe93-6575-4702-87db-e3cdc6b03a8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:41.290003 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 299/589] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:41.291048 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4fe93-6575-4702-87db-e3cdc6b03a8c None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:41.360858 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa9002-52d8-4af6-9b97-2495226b21dc None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:41.388639 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4fe93-6575-4702-87db-e3cdc6b03a8c None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:41.392358 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457779ed-e73e-467c-b3ca-5883fff22e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:41.393091 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457779ed-e73e-467c-b3ca-5883fff22e96 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:41.393378 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457779ed-e73e-467c-b3ca-5883fff22e96 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:41.394199 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457779ed-e73e-467c-b3ca-5883fff22e96 None admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:41.394977 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457779ed-e73e-467c-b3ca-5883fff22e96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:41.395285 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457779ed-e73e-467c-b3ca-5883fff22e96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:41.396750 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457779ed-e73e-467c-b3ca-5883fff22e96 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:41.408169 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 291/590] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:56:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:41.408955 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457779ed-e73e-467c-b3ca-5883fff22e96 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:41.429025 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be8710-9518-4d3e-8412-662bfe7096e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:41.430015 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be8710-9518-4d3e-8412-662bfe7096e1 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:41.430433 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be8710-9518-4d3e-8412-662bfe7096e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:41.430867 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be8710-9518-4d3e-8412-662bfe7096e1 None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:41.431743 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be8710-9518-4d3e-8412-662bfe7096e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:41.432182 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be8710-9518-4d3e-8412-662bfe7096e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:41.433733 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be8710-9518-4d3e-8412-662bfe7096e1 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:41.445847 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 300/591] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:41.450281 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be8710-9518-4d3e-8412-662bfe7096e1 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:41.508284 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457779ed-e73e-467c-b3ca-5883fff22e96 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:41.538650 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be8710-9518-4d3e-8412-662bfe7096e1 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:41.540928 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f171637-c210-49a4-840a-3b09d98e385a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:41.541660 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f171637-c210-49a4-840a-3b09d98e385a None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:41.542025 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f171637-c210-49a4-840a-3b09d98e385a None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:41.542289 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f171637-c210-49a4-840a-3b09d98e385a None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:41.543007 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f171637-c210-49a4-840a-3b09d98e385a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:41.543310 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f171637-c210-49a4-840a-3b09d98e385a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:41.544732 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f171637-c210-49a4-840a-3b09d98e385a None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:41.560934 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 292/592] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:41.560934 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f171637-c210-49a4-840a-3b09d98e385a None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:41.571766 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdced2b-46f3-4b65-ab95-170c71b7e6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:41.572428 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdced2b-46f3-4b65-ab95-170c71b7e6fa None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:41.572714 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdced2b-46f3-4b65-ab95-170c71b7e6fa None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:41.572995 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdced2b-46f3-4b65-ab95-170c71b7e6fa None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:41.573713 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdced2b-46f3-4b65-ab95-170c71b7e6fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:41.574016 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdced2b-46f3-4b65-ab95-170c71b7e6fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:41.575393 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdced2b-46f3-4b65-ab95-170c71b7e6fa None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:41.586835 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 301/593] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:41.587629 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdced2b-46f3-4b65-ab95-170c71b7e6fa None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:41.662960 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f171637-c210-49a4-840a-3b09d98e385a None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:41.679435 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdced2b-46f3-4b65-ab95-170c71b7e6fa None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:41.696540 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275fa42-ce7f-4cfb-95b1-a98aa2a57442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:41.697716 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275fa42-ce7f-4cfb-95b1-a98aa2a57442 None admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:41.698178 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275fa42-ce7f-4cfb-95b1-a98aa2a57442 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:41.698642 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275fa42-ce7f-4cfb-95b1-a98aa2a57442 None admin] PATH_INFO: `/v3/projects/0846fccaeb674395a87e45290eda74b7/users/fbd92bd14ed04621af06d68161798fe3/roles/3fb134668432434eb45c3bb21cb5882e` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:41.711555 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e223cf-1b37-4b84-9d60-2506d5198cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:41.712376 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e223cf-1b37-4b84-9d60-2506d5198cc9 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:41.712657 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e223cf-1b37-4b84-9d60-2506d5198cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:41.713000 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e223cf-1b37-4b84-9d60-2506d5198cc9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:41.714307 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275fa42-ce7f-4cfb-95b1-a98aa2a57442 None admin] RBAC: Authorizing `identity:create_grant(project_id=0846fccaeb674395a87e45290eda74b7, user_id=fbd92bd14ed04621af06d68161798fe3, role_id=3fb134668432434eb45c3bb21cb5882e)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:41.715987 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275fa42-ce7f-4cfb-95b1-a98aa2a57442 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:41.719809 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e223cf-1b37-4b84-9d60-2506d5198cc9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:41.721301 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e223cf-1b37-4b84-9d60-2506d5198cc9 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:41.729681 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 293/594] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Mar 10 03:56:41 2022] PUT /identity/v3/projects/0846fccaeb674395a87e45290eda74b7/users/fbd92bd14ed04621af06d68161798fe3/roles/3fb134668432434eb45c3bb21cb5882e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 03:56:41.730705 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275fa42-ce7f-4cfb-95b1-a98aa2a57442 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:41.748496 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-b5e223cf-1b37-4b84-9d60-2506d5198cc9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 10 03:56:41.754282 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 302/595] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Mar 10 03:56:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:41.754282 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e223cf-1b37-4b84-9d60-2506d5198cc9 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:41.853608 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275fa42-ce7f-4cfb-95b1-a98aa2a57442 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:41.863836 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e223cf-1b37-4b84-9d60-2506d5198cc9 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:41.891315 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e94df-b1f6-44ec-8ada-6c82cf8e3826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:41.892582 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e94df-b1f6-44ec-8ada-6c82cf8e3826 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:41.893092 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e94df-b1f6-44ec-8ada-6c82cf8e3826 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:41.894134 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e94df-b1f6-44ec-8ada-6c82cf8e3826 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:41.901088 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b294fe-8cb6-47c6-b16f-39c8a0408da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:41.901894 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b294fe-8cb6-47c6-b16f-39c8a0408da9 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:41.902175 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b294fe-8cb6-47c6-b16f-39c8a0408da9 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:41.902460 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b294fe-8cb6-47c6-b16f-39c8a0408da9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:41.902918 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e94df-b1f6-44ec-8ada-6c82cf8e3826 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:41.904689 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e94df-b1f6-44ec-8ada-6c82cf8e3826 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:41.910637 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b294fe-8cb6-47c6-b16f-39c8a0408da9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:41.912145 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b294fe-8cb6-47c6-b16f-39c8a0408da9 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:41.920022 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-a04e94df-b1f6-44ec-8ada-6c82cf8e3826 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:56:41.922427 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 294/596] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:56:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:41.923397 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e94df-b1f6-44ec-8ada-6c82cf8e3826 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:41.926406 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-07b294fe-8cb6-47c6-b16f-39c8a0408da9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:56:41.928930 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 303/597] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:56:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:41.930205 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b294fe-8cb6-47c6-b16f-39c8a0408da9 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:42.027971 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e94df-b1f6-44ec-8ada-6c82cf8e3826 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:42.031264 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b294fe-8cb6-47c6-b16f-39c8a0408da9 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:42.062401 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbf964-dd65-48b5-b6ab-d88d4a2bdeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:42.063435 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbf964-dd65-48b5-b6ab-d88d4a2bdeb2 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:42.063965 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbf964-dd65-48b5-b6ab-d88d4a2bdeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:42.064432 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbf964-dd65-48b5-b6ab-d88d4a2bdeb2 None admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:42.064980 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf30f0-cd8e-40a4-a2ad-c000ad8d0900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:42.066289 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf30f0-cd8e-40a4-a2ad-c000ad8d0900 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:42.066570 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf30f0-cd8e-40a4-a2ad-c000ad8d0900 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:42.066844 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf30f0-cd8e-40a4-a2ad-c000ad8d0900 None admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:42.067274 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbf964-dd65-48b5-b6ab-d88d4a2bdeb2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:42.067882 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf30f0-cd8e-40a4-a2ad-c000ad8d0900 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:42.068211 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf30f0-cd8e-40a4-a2ad-c000ad8d0900 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:42.068433 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbf964-dd65-48b5-b6ab-d88d4a2bdeb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:42.070089 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbf964-dd65-48b5-b6ab-d88d4a2bdeb2 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:42.072458 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf30f0-cd8e-40a4-a2ad-c000ad8d0900 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:42.089085 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 295/599] 10.222.0.15 () {56 vars in 1139 bytes} [Thu Mar 10 03:56:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:42.089276 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 304/599] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:56:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:42.093506 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf30f0-cd8e-40a4-a2ad-c000ad8d0900 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:42.094575 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbf964-dd65-48b5-b6ab-d88d4a2bdeb2 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:42.193095 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbf964-dd65-48b5-b6ab-d88d4a2bdeb2 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:42.196174 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf30f0-cd8e-40a4-a2ad-c000ad8d0900 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:42.226819 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcece5a-ddb0-40a9-a35f-c1af9e22a502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:42.227739 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcece5a-ddb0-40a9-a35f-c1af9e22a502 None admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:42.228003 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcece5a-ddb0-40a9-a35f-c1af9e22a502 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:42.228276 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcece5a-ddb0-40a9-a35f-c1af9e22a502 None admin] PATH_INFO: `/v3/projects/0846fccaeb674395a87e45290eda74b7/users/6e7c195f91114855acc58163631544d7/roles/3fb134668432434eb45c3bb21cb5882e` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:42.229053 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a779f3-a26e-4f74-bf91-8114a30fe9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:42.229702 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a779f3-a26e-4f74-bf91-8114a30fe9aa None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:42.229982 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a779f3-a26e-4f74-bf91-8114a30fe9aa None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:42.230253 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a779f3-a26e-4f74-bf91-8114a30fe9aa None admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:42.231016 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a779f3-a26e-4f74-bf91-8114a30fe9aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:42.231316 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a779f3-a26e-4f74-bf91-8114a30fe9aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:42.232781 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a779f3-a26e-4f74-bf91-8114a30fe9aa None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:42.242077 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcece5a-ddb0-40a9-a35f-c1af9e22a502 None admin] RBAC: Authorizing `identity:create_grant(project_id=0846fccaeb674395a87e45290eda74b7, user_id=6e7c195f91114855acc58163631544d7, role_id=3fb134668432434eb45c3bb21cb5882e)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:42.247762 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcece5a-ddb0-40a9-a35f-c1af9e22a502 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:42.248491 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 305/600] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:56:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:42.248491 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a779f3-a26e-4f74-bf91-8114a30fe9aa None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:42.262661 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 296/601] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Mar 10 03:56:42 2022] PUT /identity/v3/projects/0846fccaeb674395a87e45290eda74b7/users/6e7c195f91114855acc58163631544d7/roles/3fb134668432434eb45c3bb21cb5882e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 03:56:42.262661 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec31d5-59f9-4ae8-a32a-70cdd13aa263 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:42.262661 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec31d5-59f9-4ae8-a32a-70cdd13aa263 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:42.262661 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec31d5-59f9-4ae8-a32a-70cdd13aa263 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:42.266307 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 297/602] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:42.266596 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec31d5-59f9-4ae8-a32a-70cdd13aa263 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:42.371067 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a779f3-a26e-4f74-bf91-8114a30fe9aa None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:42.395363 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec31d5-59f9-4ae8-a32a-70cdd13aa263 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:42.415833 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad442d-776b-41a1-8336-cc239feaf213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:42.416703 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad442d-776b-41a1-8336-cc239feaf213 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:42.416986 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad442d-776b-41a1-8336-cc239feaf213 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:42.417263 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad442d-776b-41a1-8336-cc239feaf213 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:42.432363 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264df531-94bb-420e-b0a1-d9158ab7ffcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:42.432943 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad442d-776b-41a1-8336-cc239feaf213 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:42.433434 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264df531-94bb-420e-b0a1-d9158ab7ffcc None admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:42.433779 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264df531-94bb-420e-b0a1-d9158ab7ffcc None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:42.434129 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264df531-94bb-420e-b0a1-d9158ab7ffcc None admin] PATH_INFO: `/v3/projects/0846fccaeb674395a87e45290eda74b7/users/b6baa51b91a74ebbab55d644894acd81/roles/3fb134668432434eb45c3bb21cb5882e` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:42.434402 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad442d-776b-41a1-8336-cc239feaf213 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:42.451061 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264df531-94bb-420e-b0a1-d9158ab7ffcc None admin] RBAC: Authorizing `identity:create_grant(project_id=0846fccaeb674395a87e45290eda74b7, user_id=b6baa51b91a74ebbab55d644894acd81, role_id=3fb134668432434eb45c3bb21cb5882e)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:42.453403 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264df531-94bb-420e-b0a1-d9158ab7ffcc None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:42.454310 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-99ad442d-776b-41a1-8336-cc239feaf213 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:42.456403 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 306/603] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:42.457697 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cef6aa-44b5-4396-90e4-920e5321a4f4 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:42.457984 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cef6aa-44b5-4396-90e4-920e5321a4f4 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:42.458261 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cef6aa-44b5-4396-90e4-920e5321a4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:42.474502 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 298/604] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Mar 10 03:56:42 2022] PUT /identity/v3/projects/0846fccaeb674395a87e45290eda74b7/users/b6baa51b91a74ebbab55d644894acd81/roles/3fb134668432434eb45c3bb21cb5882e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 03:56:42.475953 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264df531-94bb-420e-b0a1-d9158ab7ffcc None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:42.485012 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-27cef6aa-44b5-4396-90e4-920e5321a4f4 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:42.486262 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-27cef6aa-44b5-4396-90e4-920e5321a4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:42.584817 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 307/605] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:42.613201 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cef6aa-44b5-4396-90e4-920e5321a4f4 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:42.616318 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264df531-94bb-420e-b0a1-d9158ab7ffcc None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:42.665495 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0765d4-a757-4675-967d-e702b65a0a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:42.666556 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0765d4-a757-4675-967d-e702b65a0a07 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:42.667044 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0765d4-a757-4675-967d-e702b65a0a07 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:42.667553 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0765d4-a757-4675-967d-e702b65a0a07 None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:42.668504 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0765d4-a757-4675-967d-e702b65a0a07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:42.669018 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0765d4-a757-4675-967d-e702b65a0a07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:42.670589 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0765d4-a757-4675-967d-e702b65a0a07 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:42.683897 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 299/606] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:42.689963 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0765d4-a757-4675-967d-e702b65a0a07 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:42.751093 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cef6aa-44b5-4396-90e4-920e5321a4f4 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:42.790216 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3463f1e2-669c-403a-b7b0-f46731c07071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:42.791247 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463f1e2-669c-403a-b7b0-f46731c07071 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:42.791668 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463f1e2-669c-403a-b7b0-f46731c07071 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:42.792140 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463f1e2-669c-403a-b7b0-f46731c07071 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:42.803977 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3463f1e2-669c-403a-b7b0-f46731c07071 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:42.809951 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0765d4-a757-4675-967d-e702b65a0a07 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:42.812064 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-3463f1e2-669c-403a-b7b0-f46731c07071 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 03:56:42.813794 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 308/607] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Mar 10 03:56:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:42.820464 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3463f1e2-669c-403a-b7b0-f46731c07071 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:42.850900 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078dd6cf-028b-46c9-a0a1-c91e0746ab2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:42.852327 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078dd6cf-028b-46c9-a0a1-c91e0746ab2f None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:42.852845 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078dd6cf-028b-46c9-a0a1-c91e0746ab2f None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:42.853225 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078dd6cf-028b-46c9-a0a1-c91e0746ab2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:42.861203 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078dd6cf-028b-46c9-a0a1-c91e0746ab2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:42.863178 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078dd6cf-028b-46c9-a0a1-c91e0746ab2f None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:42.882976 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-078dd6cf-028b-46c9-a0a1-c91e0746ab2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:56:42.884796 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 300/608] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:56:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:42.891713 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078dd6cf-028b-46c9-a0a1-c91e0746ab2f None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:42.971589 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3463f1e2-669c-403a-b7b0-f46731c07071 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:43.001917 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078dd6cf-028b-46c9-a0a1-c91e0746ab2f None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:43.004860 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de91823-f72a-41a4-bb6a-032220b65bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:43.005783 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de91823-f72a-41a4-bb6a-032220b65bdc None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:43.006266 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de91823-f72a-41a4-bb6a-032220b65bdc None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:43.006765 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de91823-f72a-41a4-bb6a-032220b65bdc None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:43.007740 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de91823-f72a-41a4-bb6a-032220b65bdc None admin] RBAC: Adding query filter params (name=service) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:43.008267 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de91823-f72a-41a4-bb6a-032220b65bdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:43.009850 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de91823-f72a-41a4-bb6a-032220b65bdc None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:43.019139 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 309/609] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Mar 10 03:56:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:56:43.024854 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de91823-f72a-41a4-bb6a-032220b65bdc None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:43.040620 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f08edf-2dca-4e8c-8fa8-d43039a5268c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:43.041294 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f08edf-2dca-4e8c-8fa8-d43039a5268c None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:43.041626 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f08edf-2dca-4e8c-8fa8-d43039a5268c None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:43.041907 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f08edf-2dca-4e8c-8fa8-d43039a5268c None admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:43.043712 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f08edf-2dca-4e8c-8fa8-d43039a5268c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:43.043712 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f08edf-2dca-4e8c-8fa8-d43039a5268c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:43.047706 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f08edf-2dca-4e8c-8fa8-d43039a5268c None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:43.058445 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 301/610] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:56:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:56:43.063705 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f08edf-2dca-4e8c-8fa8-d43039a5268c None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:43.173419 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f08edf-2dca-4e8c-8fa8-d43039a5268c None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:43.210769 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011c13e-ad3e-4687-9a99-eaa6d8588c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:43.212044 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011c13e-ad3e-4687-9a99-eaa6d8588c50 None admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:43.212425 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011c13e-ad3e-4687-9a99-eaa6d8588c50 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:43.212829 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011c13e-ad3e-4687-9a99-eaa6d8588c50 None admin] PATH_INFO: `/v3/projects/0846fccaeb674395a87e45290eda74b7/users/2faf262ae9d643c0b8708dcfecd75b3f/roles/3fb134668432434eb45c3bb21cb5882e` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:43.229813 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3011c13e-ad3e-4687-9a99-eaa6d8588c50 None admin] RBAC: Authorizing `identity:create_grant(project_id=0846fccaeb674395a87e45290eda74b7, user_id=2faf262ae9d643c0b8708dcfecd75b3f, role_id=3fb134668432434eb45c3bb21cb5882e)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:43.231868 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3011c13e-ad3e-4687-9a99-eaa6d8588c50 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:43.262139 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de91823-f72a-41a4-bb6a-032220b65bdc None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:43.274815 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 302/611] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Mar 10 03:56:43 2022] PUT /identity/v3/projects/0846fccaeb674395a87e45290eda74b7/users/2faf262ae9d643c0b8708dcfecd75b3f/roles/3fb134668432434eb45c3bb21cb5882e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 03:56:43.296170 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1133a-bae0-4bc0-be64-670212df8f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:43.297047 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1133a-bae0-4bc0-be64-670212df8f3b None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:43.297325 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1133a-bae0-4bc0-be64-670212df8f3b None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:43.297596 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1133a-bae0-4bc0-be64-670212df8f3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:43.310209 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1133a-bae0-4bc0-be64-670212df8f3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:43.311668 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1133a-bae0-4bc0-be64-670212df8f3b None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:43.339781 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-edc1133a-bae0-4bc0-be64-670212df8f3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:43.346740 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011c13e-ad3e-4687-9a99-eaa6d8588c50 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:43.348086 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 310/612] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:56:43.497694 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011c13e-ad3e-4687-9a99-eaa6d8588c50 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:43.538355 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50120292-7001-44dc-b5a5-a0ca83a3de29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:43.538946 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50120292-7001-44dc-b5a5-a0ca83a3de29 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:43.539225 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50120292-7001-44dc-b5a5-a0ca83a3de29 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:43.539496 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50120292-7001-44dc-b5a5-a0ca83a3de29 None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:43.540242 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50120292-7001-44dc-b5a5-a0ca83a3de29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:43.541023 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50120292-7001-44dc-b5a5-a0ca83a3de29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:43.541957 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50120292-7001-44dc-b5a5-a0ca83a3de29 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:43.554999 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 303/613] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:43.560261 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1133a-bae0-4bc0-be64-670212df8f3b None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:43.675971 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1133a-bae0-4bc0-be64-670212df8f3b None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:43.724429 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c488a03-d99e-4253-a0cc-a77195eead4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:43.725251 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c488a03-d99e-4253-a0cc-a77195eead4e None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:43.725534 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c488a03-d99e-4253-a0cc-a77195eead4e None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:43.725812 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c488a03-d99e-4253-a0cc-a77195eead4e None admin] PATH_INFO: `/v3/users/swift` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:43.734136 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c488a03-d99e-4253-a0cc-a77195eead4e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:43.735571 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c488a03-d99e-4253-a0cc-a77195eead4e None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:43.753359 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-5c488a03-d99e-4253-a0cc-a77195eead4e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 10 03:56:43.754875 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 311/614] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:56:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:43.760455 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50120292-7001-44dc-b5a5-a0ca83a3de29 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:43.892623 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50120292-7001-44dc-b5a5-a0ca83a3de29 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:43.930265 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be5084-b9a4-443a-9683-959abd93397a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:43.930932 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be5084-b9a4-443a-9683-959abd93397a None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:43.931209 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be5084-b9a4-443a-9683-959abd93397a None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:43.931480 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be5084-b9a4-443a-9683-959abd93397a None admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:43.932400 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be5084-b9a4-443a-9683-959abd93397a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:43.932703 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be5084-b9a4-443a-9683-959abd93397a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:43.934138 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be5084-b9a4-443a-9683-959abd93397a None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:43.951623 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 304/615] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Mar 10 03:56:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:43.957314 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c488a03-d99e-4253-a0cc-a77195eead4e None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:44.124732 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c488a03-d99e-4253-a0cc-a77195eead4e None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:44.161675 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6857549-8a5c-496c-af46-f2a842cb8150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:44.162396 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6857549-8a5c-496c-af46-f2a842cb8150 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:44.162675 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6857549-8a5c-496c-af46-f2a842cb8150 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:44.162947 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6857549-8a5c-496c-af46-f2a842cb8150 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:44.173226 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6857549-8a5c-496c-af46-f2a842cb8150 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:44.175199 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6857549-8a5c-496c-af46-f2a842cb8150 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:44.196085 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-f6857549-8a5c-496c-af46-f2a842cb8150 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:44.197586 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 312/616] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:44.204791 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be5084-b9a4-443a-9683-959abd93397a None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:44.310108 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be5084-b9a4-443a-9683-959abd93397a None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:44.357543 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a5887-72d3-4baa-aee5-80f36fa13cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:44.358210 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a5887-72d3-4baa-aee5-80f36fa13cc2 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:44.358490 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a5887-72d3-4baa-aee5-80f36fa13cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:44.358764 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a5887-72d3-4baa-aee5-80f36fa13cc2 None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:44.359477 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a5887-72d3-4baa-aee5-80f36fa13cc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:44.359807 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a5887-72d3-4baa-aee5-80f36fa13cc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:44.361169 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0a5887-72d3-4baa-aee5-80f36fa13cc2 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:44.377980 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 305/617] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:44.383251 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6857549-8a5c-496c-af46-f2a842cb8150 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:44.521933 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f699702-d5b7-4780-b74f-1a6db9a60a85 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:44.522567 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f699702-d5b7-4780-b74f-1a6db9a60a85 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:44.523045 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f699702-d5b7-4780-b74f-1a6db9a60a85 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:44.526234 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 306/618] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 03:56:44.530811 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18295468-553c-4df1-9943-5aa50587bac1 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:44.531451 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18295468-553c-4df1-9943-5aa50587bac1 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:44.532059 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18295468-553c-4df1-9943-5aa50587bac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:44.540076 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6857549-8a5c-496c-af46-f2a842cb8150 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:44.555605 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-18295468-553c-4df1-9943-5aa50587bac1 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:44.557472 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-18295468-553c-4df1-9943-5aa50587bac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:44.598581 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51794f5d-72b3-4f46-ba6a-94b7e9871ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:44.600413 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51794f5d-72b3-4f46-ba6a-94b7e9871ac2 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:44.601359 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51794f5d-72b3-4f46-ba6a-94b7e9871ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:44.602201 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51794f5d-72b3-4f46-ba6a-94b7e9871ac2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:44.618756 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51794f5d-72b3-4f46-ba6a-94b7e9871ac2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:44.620570 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51794f5d-72b3-4f46-ba6a-94b7e9871ac2 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:44.641268 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-51794f5d-72b3-4f46-ba6a-94b7e9871ac2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:56:44.649381 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 313/619] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:56:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:44.655874 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51794f5d-72b3-4f46-ba6a-94b7e9871ac2 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:44.663814 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 307/620] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 03:56:44.707309 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18295468-553c-4df1-9943-5aa50587bac1 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:44.815860 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51794f5d-72b3-4f46-ba6a-94b7e9871ac2 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:44.858710 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d406ae-cbdf-444a-89e2-e3bbe99047e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:44.859751 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d406ae-cbdf-444a-89e2-e3bbe99047e0 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:44.860244 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d406ae-cbdf-444a-89e2-e3bbe99047e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:44.860720 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d406ae-cbdf-444a-89e2-e3bbe99047e0 None admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:44.861675 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d406ae-cbdf-444a-89e2-e3bbe99047e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:44.862217 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d406ae-cbdf-444a-89e2-e3bbe99047e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:44.863857 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d406ae-cbdf-444a-89e2-e3bbe99047e0 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:44.875981 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 314/621] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:56:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:44.881382 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d406ae-cbdf-444a-89e2-e3bbe99047e0 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:44.903227 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18295468-553c-4df1-9943-5aa50587bac1 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:44.982239 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4275b-acc7-4c2a-a950-cacc57e52eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:44.982991 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4275b-acc7-4c2a-a950-cacc57e52eba None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:44.983275 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4275b-acc7-4c2a-a950-cacc57e52eba None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:44.983548 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4275b-acc7-4c2a-a950-cacc57e52eba None admin] PATH_INFO: `/v3/roles/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:44.990770 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d406ae-cbdf-444a-89e2-e3bbe99047e0 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:44.999023 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4275b-acc7-4c2a-a950-cacc57e52eba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:45.014221 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-17c4275b-acc7-4c2a-a950-cacc57e52eba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 03:56:45.015452 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 308/622] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Mar 10 03:56:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:56:45.024677 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4275b-acc7-4c2a-a950-cacc57e52eba None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:45.041123 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fbdc6-0bd7-4586-a500-d24320844750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:45.042417 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fbdc6-0bd7-4586-a500-d24320844750 None admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:45.042930 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fbdc6-0bd7-4586-a500-d24320844750 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:45.043441 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fbdc6-0bd7-4586-a500-d24320844750 None admin] PATH_INFO: `/v3/projects/0846fccaeb674395a87e45290eda74b7/users/260f561c676b4d049553eac4626b5502/roles/3fb134668432434eb45c3bb21cb5882e` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:45.091619 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96fbdc6-0bd7-4586-a500-d24320844750 None admin] RBAC: Authorizing `identity:create_grant(project_id=0846fccaeb674395a87e45290eda74b7, user_id=260f561c676b4d049553eac4626b5502, role_id=3fb134668432434eb45c3bb21cb5882e)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:45.093022 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96fbdc6-0bd7-4586-a500-d24320844750 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:45.115455 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 315/623] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Mar 10 03:56:44 2022] PUT /identity/v3/projects/0846fccaeb674395a87e45290eda74b7/users/260f561c676b4d049553eac4626b5502/roles/3fb134668432434eb45c3bb21cb5882e => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 03:56:45.144316 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4275b-acc7-4c2a-a950-cacc57e52eba None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:45.179771 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a0c42-023e-4183-99b0-ca77ca20793f None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:45.180309 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8a22d-0b9d-4d65-a54d-23858542155a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:45.180602 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a0c42-023e-4183-99b0-ca77ca20793f None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:45.180975 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8a22d-0b9d-4d65-a54d-23858542155a None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:45.181262 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8a22d-0b9d-4d65-a54d-23858542155a None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:45.181507 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a0c42-023e-4183-99b0-ca77ca20793f None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:45.181604 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8a22d-0b9d-4d65-a54d-23858542155a None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:45.182353 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e8a22d-0b9d-4d65-a54d-23858542155a None admin] RBAC: Adding query filter params (name=service) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:45.182662 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e8a22d-0b9d-4d65-a54d-23858542155a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:45.184265 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e8a22d-0b9d-4d65-a54d-23858542155a None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:45.188541 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 316/624] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 03:56:45.191247 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047c7ea-1092-4da2-9af2-63baef673c8f None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:45.191536 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047c7ea-1092-4da2-9af2-63baef673c8f None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:45.191843 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047c7ea-1092-4da2-9af2-63baef673c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:45.194991 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 309/625] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Mar 10 03:56:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:45.200880 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8a22d-0b9d-4d65-a54d-23858542155a None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:45.232883 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-a047c7ea-1092-4da2-9af2-63baef673c8f None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:45.234173 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-a047c7ea-1092-4da2-9af2-63baef673c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:45.312324 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8a22d-0b9d-4d65-a54d-23858542155a None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:45.351911 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db2f99-6340-4890-a34f-6117ef1210fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:45.352781 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db2f99-6340-4890-a34f-6117ef1210fc None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:45.353067 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db2f99-6340-4890-a34f-6117ef1210fc None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:45.353351 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db2f99-6340-4890-a34f-6117ef1210fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:45.366723 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68db2f99-6340-4890-a34f-6117ef1210fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:45.368283 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68db2f99-6340-4890-a34f-6117ef1210fc None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:45.388045 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-68db2f99-6340-4890-a34f-6117ef1210fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:45.389604 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 310/626] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:45.394900 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db2f99-6340-4890-a34f-6117ef1210fc None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:45.415480 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 317/627] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:45.434236 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999675eb-9460-487b-9071-724e9e9e4009 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:45.434541 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999675eb-9460-487b-9071-724e9e9e4009 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:45.434800 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999675eb-9460-487b-9071-724e9e9e4009 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:45.436862 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 318/628] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 03:56:45.443976 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14172af-e4b5-485d-8b12-6b2d4e11e8d9 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:45.444262 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14172af-e4b5-485d-8b12-6b2d4e11e8d9 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:45.444542 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14172af-e4b5-485d-8b12-6b2d4e11e8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:45.472825 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-f14172af-e4b5-485d-8b12-6b2d4e11e8d9 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:45.474008 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-f14172af-e4b5-485d-8b12-6b2d4e11e8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:45.503211 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db2f99-6340-4890-a34f-6117ef1210fc None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:45.542708 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba957f-c06d-4ad2-a37b-94aa62a03007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:45.544216 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba957f-c06d-4ad2-a37b-94aa62a03007 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:45.544880 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba957f-c06d-4ad2-a37b-94aa62a03007 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:45.545316 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba957f-c06d-4ad2-a37b-94aa62a03007 None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:45.546342 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba957f-c06d-4ad2-a37b-94aa62a03007 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:45.546934 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba957f-c06d-4ad2-a37b-94aa62a03007 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:45.548589 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba957f-c06d-4ad2-a37b-94aa62a03007 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:45.552053 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 319/629] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:45.553175 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14172af-e4b5-485d-8b12-6b2d4e11e8d9 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:45.572687 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 311/630] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:45.578861 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba957f-c06d-4ad2-a37b-94aa62a03007 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:45.654553 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14172af-e4b5-485d-8b12-6b2d4e11e8d9 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:45.694613 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773dab0-7af3-4fbb-841a-4709a540854d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:45.695507 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773dab0-7af3-4fbb-841a-4709a540854d None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:45.695827 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773dab0-7af3-4fbb-841a-4709a540854d None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:45.696100 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773dab0-7af3-4fbb-841a-4709a540854d None admin] PATH_INFO: `/v3/roles/service` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:45.705495 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba957f-c06d-4ad2-a37b-94aa62a03007 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:45.709923 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773dab0-7af3-4fbb-841a-4709a540854d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:45.718349 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-2773dab0-7af3-4fbb-841a-4709a540854d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 03:56:45.723775 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 320/631] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Mar 10 03:56:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:45.723775 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773dab0-7af3-4fbb-841a-4709a540854d None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:45.746409 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070aa25e-dadc-485d-9dea-10a9f0a59f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:45.747607 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070aa25e-dadc-485d-9dea-10a9f0a59f62 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:45.748140 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070aa25e-dadc-485d-9dea-10a9f0a59f62 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:45.748646 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070aa25e-dadc-485d-9dea-10a9f0a59f62 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:45.758779 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070aa25e-dadc-485d-9dea-10a9f0a59f62 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:45.760694 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070aa25e-dadc-485d-9dea-10a9f0a59f62 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:45.776174 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-070aa25e-dadc-485d-9dea-10a9f0a59f62 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 10 03:56:45.778057 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 312/632] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Mar 10 03:56:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:56:45.779028 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070aa25e-dadc-485d-9dea-10a9f0a59f62 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:45.837878 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773dab0-7af3-4fbb-841a-4709a540854d None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:45.876964 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f892d-8de4-4214-9cff-db10f57d4436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:45.878277 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f892d-8de4-4214-9cff-db10f57d4436 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:45.878554 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f892d-8de4-4214-9cff-db10f57d4436 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:45.878824 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f892d-8de4-4214-9cff-db10f57d4436 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:45.890423 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f892d-8de4-4214-9cff-db10f57d4436 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:45.898257 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-7e1f892d-8de4-4214-9cff-db10f57d4436 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 03:56:45.904260 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 321/633] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Mar 10 03:56:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:45.905119 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f892d-8de4-4214-9cff-db10f57d4436 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:45.906007 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070aa25e-dadc-485d-9dea-10a9f0a59f62 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:45.940649 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aaf707-e213-423d-8d11-fda616ed3ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:45.941689 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aaf707-e213-423d-8d11-fda616ed3ca2 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:45.942162 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aaf707-e213-423d-8d11-fda616ed3ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:45.942889 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aaf707-e213-423d-8d11-fda616ed3ca2 None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:45.943858 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aaf707-e213-423d-8d11-fda616ed3ca2 None admin] RBAC: Adding query filter params (name=service) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:45.944369 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aaf707-e213-423d-8d11-fda616ed3ca2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:45.945954 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aaf707-e213-423d-8d11-fda616ed3ca2 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:45.959599 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 313/634] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Mar 10 03:56:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:45.960795 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aaf707-e213-423d-8d11-fda616ed3ca2 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:46.005053 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f892d-8de4-4214-9cff-db10f57d4436 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:46.038682 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66222b7-3543-4b40-bb92-4a176ac2d6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:46.039611 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66222b7-3543-4b40-bb92-4a176ac2d6b7 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:46.039611 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66222b7-3543-4b40-bb92-4a176ac2d6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:46.039954 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66222b7-3543-4b40-bb92-4a176ac2d6b7 None admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:46.040823 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66222b7-3543-4b40-bb92-4a176ac2d6b7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:46.041073 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66222b7-3543-4b40-bb92-4a176ac2d6b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:46.042572 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66222b7-3543-4b40-bb92-4a176ac2d6b7 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:46.061853 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aaf707-e213-423d-8d11-fda616ed3ca2 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:46.064953 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 322/635] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Mar 10 03:56:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:46.068000 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66222b7-3543-4b40-bb92-4a176ac2d6b7 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:46.102705 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955b79b-8937-461a-9e10-c2aa690c6355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:46.103772 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955b79b-8937-461a-9e10-c2aa690c6355 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:46.104249 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955b79b-8937-461a-9e10-c2aa690c6355 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:46.104716 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955b79b-8937-461a-9e10-c2aa690c6355 None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:46.105709 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955b79b-8937-461a-9e10-c2aa690c6355 None admin] RBAC: Adding query filter params (name=service) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:46.106219 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955b79b-8937-461a-9e10-c2aa690c6355 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:46.107823 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955b79b-8937-461a-9e10-c2aa690c6355 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:46.123591 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 314/636] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Mar 10 03:56:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:46.123591 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955b79b-8937-461a-9e10-c2aa690c6355 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:46.168925 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66222b7-3543-4b40-bb92-4a176ac2d6b7 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:46.202537 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8c365-dc0d-47d0-9c85-cf16ef9a1103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:46.203476 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8c365-dc0d-47d0-9c85-cf16ef9a1103 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:46.203800 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8c365-dc0d-47d0-9c85-cf16ef9a1103 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:46.204077 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8c365-dc0d-47d0-9c85-cf16ef9a1103 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:46.213986 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8c365-dc0d-47d0-9c85-cf16ef9a1103 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:46.215408 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8c365-dc0d-47d0-9c85-cf16ef9a1103 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:46.218949 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955b79b-8937-461a-9e10-c2aa690c6355 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:46.231990 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-eda8c365-dc0d-47d0-9c85-cf16ef9a1103 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:46.233309 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 323/637] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:46.234955 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ca50a-1b01-405e-b20f-b110c319c4e6 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:46.234955 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ca50a-1b01-405e-b20f-b110c319c4e6 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:46.235151 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ca50a-1b01-405e-b20f-b110c319c4e6 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:46.240573 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 324/638] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:46.240573 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ca50a-1b01-405e-b20f-b110c319c4e6 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:46.255738 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee23955-219e-4146-a4ef-64b83a74b2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:46.256393 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee23955-219e-4146-a4ef-64b83a74b2f9 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:46.256679 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee23955-219e-4146-a4ef-64b83a74b2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:46.256960 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee23955-219e-4146-a4ef-64b83a74b2f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:46.328340 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee23955-219e-4146-a4ef-64b83a74b2f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:46.330244 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee23955-219e-4146-a4ef-64b83a74b2f9 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:46.342962 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ca50a-1b01-405e-b20f-b110c319c4e6 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:46.374868 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a81be-b6b8-4efb-9c40-15e565a4844b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:46.375651 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a81be-b6b8-4efb-9c40-15e565a4844b None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:46.375957 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a81be-b6b8-4efb-9c40-15e565a4844b None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:46.376223 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a81be-b6b8-4efb-9c40-15e565a4844b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:46.385653 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a81be-b6b8-4efb-9c40-15e565a4844b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:46.387078 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a81be-b6b8-4efb-9c40-15e565a4844b None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:46.404430 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-050a81be-b6b8-4efb-9c40-15e565a4844b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:46.405689 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 325/639] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:46.406490 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a81be-b6b8-4efb-9c40-15e565a4844b None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:46.438522 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 315/640] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:56:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:56:46.439608 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852d265-c622-4268-b202-6c61f6f066e0 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:46.439937 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852d265-c622-4268-b202-6c61f6f066e0 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:46.440383 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852d265-c622-4268-b202-6c61f6f066e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:46.459168 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-f852d265-c622-4268-b202-6c61f6f066e0 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:46.461066 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-f852d265-c622-4268-b202-6c61f6f066e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:46.503825 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a81be-b6b8-4efb-9c40-15e565a4844b None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:46.529572 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 316/641] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:46.538524 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852d265-c622-4268-b202-6c61f6f066e0 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:46.549032 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a29fa0-9605-471a-90c9-a2f20e2bb8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:46.549744 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a29fa0-9605-471a-90c9-a2f20e2bb8ce None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:46.550031 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a29fa0-9605-471a-90c9-a2f20e2bb8ce None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:46.550314 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a29fa0-9605-471a-90c9-a2f20e2bb8ce None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:46.551522 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a29fa0-9605-471a-90c9-a2f20e2bb8ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:46.551868 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a29fa0-9605-471a-90c9-a2f20e2bb8ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:46.553680 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a29fa0-9605-471a-90c9-a2f20e2bb8ce None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:46.566741 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 326/642] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:46.567822 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a29fa0-9605-471a-90c9-a2f20e2bb8ce None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:46.628927 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852d265-c622-4268-b202-6c61f6f066e0 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:46.661599 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df356e-d6aa-4213-a13d-40f918a46a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:46.662251 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df356e-d6aa-4213-a13d-40f918a46a32 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:46.662538 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df356e-d6aa-4213-a13d-40f918a46a32 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:46.662819 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df356e-d6aa-4213-a13d-40f918a46a32 None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:46.663534 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df356e-d6aa-4213-a13d-40f918a46a32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:46.663973 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df356e-d6aa-4213-a13d-40f918a46a32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:46.665241 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df356e-d6aa-4213-a13d-40f918a46a32 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:46.667470 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a29fa0-9605-471a-90c9-a2f20e2bb8ce None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:46.676135 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 317/643] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:46.677129 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df356e-d6aa-4213-a13d-40f918a46a32 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:46.706941 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2c78d-fa2b-40b4-8218-37c877b1adba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:46.707663 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2c78d-fa2b-40b4-8218-37c877b1adba None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:46.707982 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2c78d-fa2b-40b4-8218-37c877b1adba None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:46.708260 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2c78d-fa2b-40b4-8218-37c877b1adba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:46.718425 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2c78d-fa2b-40b4-8218-37c877b1adba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:46.719889 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2c78d-fa2b-40b4-8218-37c877b1adba None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:46.735615 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-76a2c78d-fa2b-40b4-8218-37c877b1adba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:46.736809 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 327/644] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:46.737594 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2c78d-fa2b-40b4-8218-37c877b1adba None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:46.784761 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df356e-d6aa-4213-a13d-40f918a46a32 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:46.823736 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44bef8-cc9f-442c-a477-1e298cab604a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:46.823736 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44bef8-cc9f-442c-a477-1e298cab604a None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:46.823736 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44bef8-cc9f-442c-a477-1e298cab604a None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:46.823736 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44bef8-cc9f-442c-a477-1e298cab604a None admin] PATH_INFO: `/v3/roles/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:46.829338 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44bef8-cc9f-442c-a477-1e298cab604a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:46.836173 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2c78d-fa2b-40b4-8218-37c877b1adba None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:46.836871 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-fd44bef8-cc9f-442c-a477-1e298cab604a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 03:56:46.838260 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 318/645] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Mar 10 03:56:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:46.838820 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44bef8-cc9f-442c-a477-1e298cab604a None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:46.872695 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd3132-6127-4bf1-90b0-3ef127462d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:46.873493 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd3132-6127-4bf1-90b0-3ef127462d91 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:46.873774 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd3132-6127-4bf1-90b0-3ef127462d91 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:46.874047 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd3132-6127-4bf1-90b0-3ef127462d91 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:46.882341 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd3132-6127-4bf1-90b0-3ef127462d91 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:46.883801 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd3132-6127-4bf1-90b0-3ef127462d91 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:46.897871 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-90bd3132-6127-4bf1-90b0-3ef127462d91 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 10 03:56:46.903600 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 328/646] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:56:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:46.903600 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd3132-6127-4bf1-90b0-3ef127462d91 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:46.934687 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44bef8-cc9f-442c-a477-1e298cab604a None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:46.967769 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c87d68-3950-4dfb-9f48-31dd83bd7d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:46.968527 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c87d68-3950-4dfb-9f48-31dd83bd7d55 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:46.968815 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c87d68-3950-4dfb-9f48-31dd83bd7d55 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:46.969100 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c87d68-3950-4dfb-9f48-31dd83bd7d55 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:46.976494 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c87d68-3950-4dfb-9f48-31dd83bd7d55 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:46.977948 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c87d68-3950-4dfb-9f48-31dd83bd7d55 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:46.991654 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-b8c87d68-3950-4dfb-9f48-31dd83bd7d55 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 10 03:56:46.997392 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 319/647] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:56:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:46.997392 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c87d68-3950-4dfb-9f48-31dd83bd7d55 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:47.003958 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd3132-6127-4bf1-90b0-3ef127462d91 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:47.036156 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242d7df-6904-4d3c-ba81-86937705c7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:47.036816 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242d7df-6904-4d3c-ba81-86937705c7a0 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:47.037102 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242d7df-6904-4d3c-ba81-86937705c7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:47.037381 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242d7df-6904-4d3c-ba81-86937705c7a0 None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:47.038093 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242d7df-6904-4d3c-ba81-86937705c7a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:47.038401 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242d7df-6904-4d3c-ba81-86937705c7a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:47.039781 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242d7df-6904-4d3c-ba81-86937705c7a0 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:47.056318 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 329/648] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:47.056318 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242d7df-6904-4d3c-ba81-86937705c7a0 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:47.098698 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c87d68-3950-4dfb-9f48-31dd83bd7d55 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:47.132145 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84545930-2d00-42f5-a359-61f4c1646d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:47.132813 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84545930-2d00-42f5-a359-61f4c1646d64 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:47.133100 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84545930-2d00-42f5-a359-61f4c1646d64 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:47.133377 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84545930-2d00-42f5-a359-61f4c1646d64 None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:47.134118 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84545930-2d00-42f5-a359-61f4c1646d64 None admin] RBAC: Adding query filter params (name=service) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:47.134420 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84545930-2d00-42f5-a359-61f4c1646d64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:47.135810 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84545930-2d00-42f5-a359-61f4c1646d64 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:47.143729 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 320/649] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Mar 10 03:56:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:47.148255 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84545930-2d00-42f5-a359-61f4c1646d64 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:47.157251 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242d7df-6904-4d3c-ba81-86937705c7a0 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:47.189508 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377643bd-040b-4bf0-a442-4bff44c9b9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:47.190722 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377643bd-040b-4bf0-a442-4bff44c9b9b8 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:47.191002 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377643bd-040b-4bf0-a442-4bff44c9b9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:47.191280 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377643bd-040b-4bf0-a442-4bff44c9b9b8 None admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:47.192143 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377643bd-040b-4bf0-a442-4bff44c9b9b8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:47.192452 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377643bd-040b-4bf0-a442-4bff44c9b9b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:47.194224 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377643bd-040b-4bf0-a442-4bff44c9b9b8 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:47.212410 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 330/650] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Mar 10 03:56:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:47.213271 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377643bd-040b-4bf0-a442-4bff44c9b9b8 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:47.254181 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84545930-2d00-42f5-a359-61f4c1646d64 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:47.286294 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69709e-39f3-4b88-a277-79cab789dcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:47.286962 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69709e-39f3-4b88-a277-79cab789dcd5 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:47.287248 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69709e-39f3-4b88-a277-79cab789dcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:47.287528 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69709e-39f3-4b88-a277-79cab789dcd5 None admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:47.288393 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69709e-39f3-4b88-a277-79cab789dcd5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:47.288707 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69709e-39f3-4b88-a277-79cab789dcd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:47.290139 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69709e-39f3-4b88-a277-79cab789dcd5 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:47.307182 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 321/651] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Mar 10 03:56:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:47.307917 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69709e-39f3-4b88-a277-79cab789dcd5 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:47.316968 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377643bd-040b-4bf0-a442-4bff44c9b9b8 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:47.352359 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eccf300-5e11-43c0-bebb-165bce8b93ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:47.353148 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccf300-5e11-43c0-bebb-165bce8b93ad None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:47.353427 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccf300-5e11-43c0-bebb-165bce8b93ad None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:47.353750 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccf300-5e11-43c0-bebb-165bce8b93ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:47.360215 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eccf300-5e11-43c0-bebb-165bce8b93ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:47.361652 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eccf300-5e11-43c0-bebb-165bce8b93ad None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:47.374840 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-5eccf300-5e11-43c0-bebb-165bce8b93ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:56:47.380497 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 331/652] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:56:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:47.380497 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eccf300-5e11-43c0-bebb-165bce8b93ad None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:47.403411 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69709e-39f3-4b88-a277-79cab789dcd5 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:47.436726 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42afad-1876-440c-a91f-32a1f9bf8ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:47.437513 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42afad-1876-440c-a91f-32a1f9bf8ad8 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:47.437793 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42afad-1876-440c-a91f-32a1f9bf8ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:47.438066 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42afad-1876-440c-a91f-32a1f9bf8ad8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:47.448272 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42afad-1876-440c-a91f-32a1f9bf8ad8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:47.449740 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42afad-1876-440c-a91f-32a1f9bf8ad8 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:47.470314 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-fc42afad-1876-440c-a91f-32a1f9bf8ad8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:47.472035 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 322/653] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:47.472800 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42afad-1876-440c-a91f-32a1f9bf8ad8 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:47.485859 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eccf300-5e11-43c0-bebb-165bce8b93ad None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:47.532115 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a03312-a0b7-4b02-b363-43aefd171774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:47.532711 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a03312-a0b7-4b02-b363-43aefd171774 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:47.532960 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a03312-a0b7-4b02-b363-43aefd171774 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:47.533238 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a03312-a0b7-4b02-b363-43aefd171774 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:47.581909 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42afad-1876-440c-a91f-32a1f9bf8ad8 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:47.614870 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a03312-a0b7-4b02-b363-43aefd171774 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:47.616293 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf37a7-50a4-469a-ba2d-b681779972ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:47.616932 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a03312-a0b7-4b02-b363-43aefd171774 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:47.617076 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf37a7-50a4-469a-ba2d-b681779972ec None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:47.617215 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf37a7-50a4-469a-ba2d-b681779972ec None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:47.617496 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf37a7-50a4-469a-ba2d-b681779972ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:47.690457 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf37a7-50a4-469a-ba2d-b681779972ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:47.691937 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf37a7-50a4-469a-ba2d-b681779972ec None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:47.725166 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 332/654] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:56:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:56:47.726061 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a03312-a0b7-4b02-b363-43aefd171774 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:47.796665 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 323/655] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:56:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:56:47.797785 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf37a7-50a4-469a-ba2d-b681779972ec None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:47.822924 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a03312-a0b7-4b02-b363-43aefd171774 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:47.855132 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5af3ce-2aae-4d2f-9893-3e1fea2f2500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:47.855821 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5af3ce-2aae-4d2f-9893-3e1fea2f2500 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:47.856103 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5af3ce-2aae-4d2f-9893-3e1fea2f2500 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:47.856376 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5af3ce-2aae-4d2f-9893-3e1fea2f2500 None admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:47.857145 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5af3ce-2aae-4d2f-9893-3e1fea2f2500 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:47.857451 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5af3ce-2aae-4d2f-9893-3e1fea2f2500 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:47.858860 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5af3ce-2aae-4d2f-9893-3e1fea2f2500 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:47.869625 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 333/656] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:56:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:47.870811 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c069ae7-18d7-4ab1-8e16-75ed94456b4f None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:47.871096 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c069ae7-18d7-4ab1-8e16-75ed94456b4f None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:47.871372 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c069ae7-18d7-4ab1-8e16-75ed94456b4f None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:47.874726 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 334/657] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:47.874726 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c069ae7-18d7-4ab1-8e16-75ed94456b4f None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:47.890307 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf37a7-50a4-469a-ba2d-b681779972ec None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:47.922455 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e4049-4d11-427c-97af-046d2a523905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:47.923103 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e4049-4d11-427c-97af-046d2a523905 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:47.923386 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e4049-4d11-427c-97af-046d2a523905 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:47.923662 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e4049-4d11-427c-97af-046d2a523905 None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:47.924394 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e4049-4d11-427c-97af-046d2a523905 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:47.924697 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e4049-4d11-427c-97af-046d2a523905 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:47.926057 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e4049-4d11-427c-97af-046d2a523905 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:47.936711 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 324/658] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:47.937523 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e4049-4d11-427c-97af-046d2a523905 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:47.968248 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c069ae7-18d7-4ab1-8e16-75ed94456b4f None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:47.999135 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34c5bb-cb42-4481-81e7-95a866943359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:47.999942 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34c5bb-cb42-4481-81e7-95a866943359 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:48.000226 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34c5bb-cb42-4481-81e7-95a866943359 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:48.000501 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34c5bb-cb42-4481-81e7-95a866943359 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:48.010353 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34c5bb-cb42-4481-81e7-95a866943359 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:48.011807 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34c5bb-cb42-4481-81e7-95a866943359 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:48.027964 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-7c34c5bb-cb42-4481-81e7-95a866943359 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:48.029020 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e4049-4d11-427c-97af-046d2a523905 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:48.029378 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 335/659] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:48.030045 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34c5bb-cb42-4481-81e7-95a866943359 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:48.061334 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba922fd-6835-4bb2-84ba-cae3931f4ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:48.062048 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba922fd-6835-4bb2-84ba-cae3931f4ed4 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:48.062328 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba922fd-6835-4bb2-84ba-cae3931f4ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:48.062601 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba922fd-6835-4bb2-84ba-cae3931f4ed4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:48.073416 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba922fd-6835-4bb2-84ba-cae3931f4ed4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:48.074847 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba922fd-6835-4bb2-84ba-cae3931f4ed4 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:48.091049 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-dba922fd-6835-4bb2-84ba-cae3931f4ed4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:48.092220 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 325/660] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:48.093435 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd46fc-d1fe-461e-a95b-9ed70822e9ce None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:48.093732 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd46fc-d1fe-461e-a95b-9ed70822e9ce None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:48.093994 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd46fc-d1fe-461e-a95b-9ed70822e9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:48.110000 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-0acd46fc-d1fe-461e-a95b-9ed70822e9ce None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:48.111181 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-0acd46fc-d1fe-461e-a95b-9ed70822e9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:48.124896 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34c5bb-cb42-4481-81e7-95a866943359 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:48.156492 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68bcd5-7cd3-4e60-a5f5-e28e1977855d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:48.157158 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68bcd5-7cd3-4e60-a5f5-e28e1977855d None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:48.157417 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68bcd5-7cd3-4e60-a5f5-e28e1977855d None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:48.157694 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68bcd5-7cd3-4e60-a5f5-e28e1977855d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:48.158508 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68bcd5-7cd3-4e60-a5f5-e28e1977855d None admin] RBAC: Adding query filter params (role.id=3fb134668432434eb45c3bb21cb5882e, scope.project.id=0846fccaeb674395a87e45290eda74b7, user.id=fbd92bd14ed04621af06d68161798fe3) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:48.158845 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68bcd5-7cd3-4e60-a5f5-e28e1977855d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:48.162304 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68bcd5-7cd3-4e60-a5f5-e28e1977855d None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:48.166070 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 336/661] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:56:48 2022] GET /identity/v3/role_assignments?user.id=fbd92bd14ed04621af06d68161798fe3&scope.project.id=0846fccaeb674395a87e45290eda74b7&role.id=3fb134668432434eb45c3bb21cb5882e => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:48.166850 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68bcd5-7cd3-4e60-a5f5-e28e1977855d None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:48.183535 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 326/662] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:48.183535 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd46fc-d1fe-461e-a95b-9ed70822e9ce None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:48.272293 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68bcd5-7cd3-4e60-a5f5-e28e1977855d None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:48.294246 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd46fc-d1fe-461e-a95b-9ed70822e9ce None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:48.304849 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bc5bd-dce0-406f-a35b-08f133c5b64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:48.305657 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bc5bd-dce0-406f-a35b-08f133c5b64a None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:48.305936 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bc5bd-dce0-406f-a35b-08f133c5b64a None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:48.306206 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bc5bd-dce0-406f-a35b-08f133c5b64a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:48.314221 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930bc5bd-dce0-406f-a35b-08f133c5b64a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:48.316226 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930bc5bd-dce0-406f-a35b-08f133c5b64a None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:48.330398 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486011f-14ed-47df-839d-574150527822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:48.330613 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-930bc5bd-dce0-406f-a35b-08f133c5b64a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 10 03:56:48.332261 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486011f-14ed-47df-839d-574150527822 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:48.332371 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 337/663] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Mar 10 03:56:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:48.332842 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486011f-14ed-47df-839d-574150527822 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:48.333119 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bc5bd-dce0-406f-a35b-08f133c5b64a None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:48.333539 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486011f-14ed-47df-839d-574150527822 None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:48.334362 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2486011f-14ed-47df-839d-574150527822 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:48.334762 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2486011f-14ed-47df-839d-574150527822 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:48.336287 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2486011f-14ed-47df-839d-574150527822 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:48.354952 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 327/664] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:48.354952 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486011f-14ed-47df-839d-574150527822 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:48.450171 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486011f-14ed-47df-839d-574150527822 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:48.450661 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bc5bd-dce0-406f-a35b-08f133c5b64a None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:48.482692 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4990f5-1f6e-4a7c-893d-8198eee0061b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:48.482896 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28f936-06f1-4764-9b44-1b9314927701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:48.483350 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28f936-06f1-4764-9b44-1b9314927701 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:48.483535 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4990f5-1f6e-4a7c-893d-8198eee0061b None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:48.483629 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28f936-06f1-4764-9b44-1b9314927701 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:48.483810 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4990f5-1f6e-4a7c-893d-8198eee0061b None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:48.483908 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28f936-06f1-4764-9b44-1b9314927701 None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:48.484087 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4990f5-1f6e-4a7c-893d-8198eee0061b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:48.484612 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28f936-06f1-4764-9b44-1b9314927701 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:48.484912 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28f936-06f1-4764-9b44-1b9314927701 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:48.486251 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28f936-06f1-4764-9b44-1b9314927701 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:48.494534 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4990f5-1f6e-4a7c-893d-8198eee0061b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:48.502230 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 338/665] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:48.502230 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28f936-06f1-4764-9b44-1b9314927701 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:48.502525 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-7c4990f5-1f6e-4a7c-893d-8198eee0061b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 03:56:48.503860 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 328/666] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Mar 10 03:56:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:48.506192 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4990f5-1f6e-4a7c-893d-8198eee0061b None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:48.604067 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4990f5-1f6e-4a7c-893d-8198eee0061b None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:48.606349 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28f936-06f1-4764-9b44-1b9314927701 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:48.637478 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775be14-c82a-47d9-9554-75030e5b899b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:48.638280 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775be14-c82a-47d9-9554-75030e5b899b None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:48.638561 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775be14-c82a-47d9-9554-75030e5b899b None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:48.638852 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775be14-c82a-47d9-9554-75030e5b899b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:48.640124 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db48be-7fd5-4f5f-b390-1e5917c00e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:48.641111 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db48be-7fd5-4f5f-b390-1e5917c00e4f None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:48.641802 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db48be-7fd5-4f5f-b390-1e5917c00e4f None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:48.642251 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db48be-7fd5-4f5f-b390-1e5917c00e4f None admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:48.643241 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db48be-7fd5-4f5f-b390-1e5917c00e4f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:48.643726 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db48be-7fd5-4f5f-b390-1e5917c00e4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:48.645469 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9775be14-c82a-47d9-9554-75030e5b899b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:48.645733 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db48be-7fd5-4f5f-b390-1e5917c00e4f None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:48.646893 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9775be14-c82a-47d9-9554-75030e5b899b None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:48.660185 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-9775be14-c82a-47d9-9554-75030e5b899b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:56:48.661342 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 329/667] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:56:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:48.662099 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775be14-c82a-47d9-9554-75030e5b899b None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:48.668070 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 339/668] 10.222.0.15 () {56 vars in 1139 bytes} [Thu Mar 10 03:56:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:48.669065 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db48be-7fd5-4f5f-b390-1e5917c00e4f None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:48.757320 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775be14-c82a-47d9-9554-75030e5b899b None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:48.766756 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db48be-7fd5-4f5f-b390-1e5917c00e4f None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:48.789270 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36159f0-3dbd-42d6-9762-40be231f3a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:48.790053 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36159f0-3dbd-42d6-9762-40be231f3a74 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:48.790331 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36159f0-3dbd-42d6-9762-40be231f3a74 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:48.790598 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36159f0-3dbd-42d6-9762-40be231f3a74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:48.796992 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36159f0-3dbd-42d6-9762-40be231f3a74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:48.798441 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36159f0-3dbd-42d6-9762-40be231f3a74 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:48.800479 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d121d8-35be-4253-91b1-e3c97407e5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:48.801215 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d121d8-35be-4253-91b1-e3c97407e5f8 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:48.801508 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d121d8-35be-4253-91b1-e3c97407e5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:48.801784 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d121d8-35be-4253-91b1-e3c97407e5f8 None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:48.802519 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d121d8-35be-4253-91b1-e3c97407e5f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:48.802822 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d121d8-35be-4253-91b1-e3c97407e5f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:48.804209 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d121d8-35be-4253-91b1-e3c97407e5f8 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:48.816826 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 340/669] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Mar 10 03:56:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:48.816987 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-d36159f0-3dbd-42d6-9762-40be231f3a74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:56:48.817066 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d121d8-35be-4253-91b1-e3c97407e5f8 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:48.817134 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 330/670] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:56:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:48.817134 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36159f0-3dbd-42d6-9762-40be231f3a74 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:48.910058 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36159f0-3dbd-42d6-9762-40be231f3a74 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:48.911068 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d121d8-35be-4253-91b1-e3c97407e5f8 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:48.943142 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793d784-8078-4465-8919-b12912f84d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:48.943839 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2113f-a38f-4aa1-b80a-ec45ead1ce71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:48.943839 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2113f-a38f-4aa1-b80a-ec45ead1ce71 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:48.944035 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793d784-8078-4465-8919-b12912f84d9f None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:48.944113 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2113f-a38f-4aa1-b80a-ec45ead1ce71 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:48.944181 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793d784-8078-4465-8919-b12912f84d9f None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:48.944390 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2113f-a38f-4aa1-b80a-ec45ead1ce71 None admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:48.944484 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793d784-8078-4465-8919-b12912f84d9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:48.945102 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2113f-a38f-4aa1-b80a-ec45ead1ce71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:48.945407 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2113f-a38f-4aa1-b80a-ec45ead1ce71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:48.946803 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2113f-a38f-4aa1-b80a-ec45ead1ce71 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:48.962994 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 341/671] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:56:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:48.962994 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2113f-a38f-4aa1-b80a-ec45ead1ce71 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:49.010043 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793d784-8078-4465-8919-b12912f84d9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:49.011491 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793d784-8078-4465-8919-b12912f84d9f None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:49.057062 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2113f-a38f-4aa1-b80a-ec45ead1ce71 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:49.089873 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c5d0f-d1d0-4a81-aed5-bc59cd94ace5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:49.090988 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c5d0f-d1d0-4a81-aed5-bc59cd94ace5 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:49.091275 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c5d0f-d1d0-4a81-aed5-bc59cd94ace5 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:49.091550 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c5d0f-d1d0-4a81-aed5-bc59cd94ace5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:49.102282 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c5d0f-d1d0-4a81-aed5-bc59cd94ace5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:49.103744 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c5d0f-d1d0-4a81-aed5-bc59cd94ace5 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:49.115193 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 331/672] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:56:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:56:49.115193 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793d784-8078-4465-8919-b12912f84d9f None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:49.121528 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-bc3c5d0f-d1d0-4a81-aed5-bc59cd94ace5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:49.128032 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 342/673] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:49.128032 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c5d0f-d1d0-4a81-aed5-bc59cd94ace5 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:49.212019 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793d784-8078-4465-8919-b12912f84d9f None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:49.217960 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c5d0f-d1d0-4a81-aed5-bc59cd94ace5 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:49.245458 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63deae-fd54-4a5b-b4fc-855d4ec32d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:49.246119 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63deae-fd54-4a5b-b4fc-855d4ec32d4a None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:49.246400 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63deae-fd54-4a5b-b4fc-855d4ec32d4a None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:49.246680 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63deae-fd54-4a5b-b4fc-855d4ec32d4a None admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:49.247451 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63deae-fd54-4a5b-b4fc-855d4ec32d4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:49.247788 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63deae-fd54-4a5b-b4fc-855d4ec32d4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:49.249188 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63deae-fd54-4a5b-b4fc-855d4ec32d4a None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:49.250583 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85664c5-7f5c-4b4b-8e75-3083c784f07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:49.251236 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85664c5-7f5c-4b4b-8e75-3083c784f07b None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:49.251517 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85664c5-7f5c-4b4b-8e75-3083c784f07b None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:49.251818 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85664c5-7f5c-4b4b-8e75-3083c784f07b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:49.253187 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85664c5-7f5c-4b4b-8e75-3083c784f07b None admin] RBAC: Adding query filter params (role.id=3fb134668432434eb45c3bb21cb5882e, scope.project.id=0846fccaeb674395a87e45290eda74b7, user.id=6e7c195f91114855acc58163631544d7) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:49.253494 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85664c5-7f5c-4b4b-8e75-3083c784f07b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:49.254899 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85664c5-7f5c-4b4b-8e75-3083c784f07b None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:49.268117 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 343/674] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:56:49 2022] GET /identity/v3/role_assignments?user.id=6e7c195f91114855acc58163631544d7&scope.project.id=0846fccaeb674395a87e45290eda74b7&role.id=3fb134668432434eb45c3bb21cb5882e => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:49.268117 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85664c5-7f5c-4b4b-8e75-3083c784f07b None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:49.268366 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 332/675] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:56:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:49.268366 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63deae-fd54-4a5b-b4fc-855d4ec32d4a None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:49.375488 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63deae-fd54-4a5b-b4fc-855d4ec32d4a None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:49.376473 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85664c5-7f5c-4b4b-8e75-3083c784f07b None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:49.411359 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edd113-5a29-4f11-a048-fdcc9423d026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:49.411918 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edd113-5a29-4f11-a048-fdcc9423d026 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:49.412202 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edd113-5a29-4f11-a048-fdcc9423d026 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:49.412480 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edd113-5a29-4f11-a048-fdcc9423d026 None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:49.413260 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edd113-5a29-4f11-a048-fdcc9423d026 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:49.413508 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edd113-5a29-4f11-a048-fdcc9423d026 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:49.414905 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edd113-5a29-4f11-a048-fdcc9423d026 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:49.417720 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a466fa-a177-467a-ae5f-21bb894cc4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:49.418867 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a466fa-a177-467a-ae5f-21bb894cc4f5 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:49.419352 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a466fa-a177-467a-ae5f-21bb894cc4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:49.419992 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a466fa-a177-467a-ae5f-21bb894cc4f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:49.432007 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a466fa-a177-467a-ae5f-21bb894cc4f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:49.433189 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 333/676] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:49.434084 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a466fa-a177-467a-ae5f-21bb894cc4f5 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:49.434193 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edd113-5a29-4f11-a048-fdcc9423d026 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:49.454282 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-b4a466fa-a177-467a-ae5f-21bb894cc4f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:49.456368 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 344/677] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:49.457406 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a466fa-a177-467a-ae5f-21bb894cc4f5 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:49.546479 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edd113-5a29-4f11-a048-fdcc9423d026 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:49.581480 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a466fa-a177-467a-ae5f-21bb894cc4f5 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:49.587807 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02899933-cd96-446b-adea-2cc3004f6ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:49.588654 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02899933-cd96-446b-adea-2cc3004f6ecc None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:49.588940 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02899933-cd96-446b-adea-2cc3004f6ecc None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:49.589218 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02899933-cd96-446b-adea-2cc3004f6ecc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:49.590054 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02899933-cd96-446b-adea-2cc3004f6ecc None admin] RBAC: Adding query filter params (role.id=3fb134668432434eb45c3bb21cb5882e, scope.project.id=0846fccaeb674395a87e45290eda74b7, user.id=b6baa51b91a74ebbab55d644894acd81) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:49.590841 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02899933-cd96-446b-adea-2cc3004f6ecc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:49.592674 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02899933-cd96-446b-adea-2cc3004f6ecc None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:49.603770 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 334/678] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:56:49 2022] GET /identity/v3/role_assignments?user.id=b6baa51b91a74ebbab55d644894acd81&scope.project.id=0846fccaeb674395a87e45290eda74b7&role.id=3fb134668432434eb45c3bb21cb5882e => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:49.603770 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02899933-cd96-446b-adea-2cc3004f6ecc None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:49.622530 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f43eb-72da-402a-9c6f-944b1300121d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:49.623787 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f43eb-72da-402a-9c6f-944b1300121d None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:49.624076 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f43eb-72da-402a-9c6f-944b1300121d None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:49.624625 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f43eb-72da-402a-9c6f-944b1300121d None admin] PATH_INFO: `/v3/users/swift` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:49.635206 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f43eb-72da-402a-9c6f-944b1300121d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:49.636873 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f43eb-72da-402a-9c6f-944b1300121d None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:49.651117 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-e59f43eb-72da-402a-9c6f-944b1300121d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 10 03:56:49.652556 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 345/679] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:56:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:49.657869 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f43eb-72da-402a-9c6f-944b1300121d None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:49.759976 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02899933-cd96-446b-adea-2cc3004f6ecc None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:49.824998 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a51f5-bda3-47ca-9b20-fcb71fe82906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:49.826007 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a51f5-bda3-47ca-9b20-fcb71fe82906 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:49.826495 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a51f5-bda3-47ca-9b20-fcb71fe82906 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:49.827009 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a51f5-bda3-47ca-9b20-fcb71fe82906 None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:49.828897 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a51f5-bda3-47ca-9b20-fcb71fe82906 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:49.829427 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a51f5-bda3-47ca-9b20-fcb71fe82906 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:49.829756 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f43eb-72da-402a-9c6f-944b1300121d None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:49.831863 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a51f5-bda3-47ca-9b20-fcb71fe82906 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:49.845005 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 335/680] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:49.849920 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a51f5-bda3-47ca-9b20-fcb71fe82906 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:49.867633 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7e64b-600b-4972-ab2f-f34d6963d2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:49.868367 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7e64b-600b-4972-ab2f-f34d6963d2ee None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:49.868607 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7e64b-600b-4972-ab2f-f34d6963d2ee None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:49.868906 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7e64b-600b-4972-ab2f-f34d6963d2ee None admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:49.869714 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7e64b-600b-4972-ab2f-f34d6963d2ee None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:49.870022 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7e64b-600b-4972-ab2f-f34d6963d2ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:49.871438 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7e64b-600b-4972-ab2f-f34d6963d2ee None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:49.890405 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 346/681] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Mar 10 03:56:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:56:49.897697 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7e64b-600b-4972-ab2f-f34d6963d2ee None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:49.957369 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a51f5-bda3-47ca-9b20-fcb71fe82906 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:49.992276 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d09ea2-dee9-469c-bec9-721217f77ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:49.993441 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d09ea2-dee9-469c-bec9-721217f77ff8 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:49.994085 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d09ea2-dee9-469c-bec9-721217f77ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:49.994562 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d09ea2-dee9-469c-bec9-721217f77ff8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:49.999281 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7e64b-600b-4972-ab2f-f34d6963d2ee None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:50.001845 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d09ea2-dee9-469c-bec9-721217f77ff8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:50.004122 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d09ea2-dee9-469c-bec9-721217f77ff8 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:50.018134 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-29d09ea2-dee9-469c-bec9-721217f77ff8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:56:50.019977 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 336/682] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:56:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:50.024953 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d09ea2-dee9-469c-bec9-721217f77ff8 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:50.046293 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7748d0-1934-4963-ae9e-c52514c2d0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:50.046996 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7748d0-1934-4963-ae9e-c52514c2d0a5 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:50.047276 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7748d0-1934-4963-ae9e-c52514c2d0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:50.047549 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7748d0-1934-4963-ae9e-c52514c2d0a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:50.132288 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7748d0-1934-4963-ae9e-c52514c2d0a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:50.133756 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7748d0-1934-4963-ae9e-c52514c2d0a5 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:50.135479 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d09ea2-dee9-469c-bec9-721217f77ff8 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:50.169543 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c181a83-2899-427f-81cd-a897dc02e582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:50.170612 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c181a83-2899-427f-81cd-a897dc02e582 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:50.171101 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c181a83-2899-427f-81cd-a897dc02e582 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:50.171581 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c181a83-2899-427f-81cd-a897dc02e582 None admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:50.172661 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c181a83-2899-427f-81cd-a897dc02e582 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:50.173171 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c181a83-2899-427f-81cd-a897dc02e582 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:50.175472 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c181a83-2899-427f-81cd-a897dc02e582 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:50.187803 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 337/683] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:56:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:56:50.202191 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c181a83-2899-427f-81cd-a897dc02e582 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:50.239204 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 347/684] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:56:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:56:50.244961 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7748d0-1934-4963-ae9e-c52514c2d0a5 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:50.325349 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c181a83-2899-427f-81cd-a897dc02e582 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:50.385936 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32a171-e97d-49bc-9268-220ae24db65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:50.386936 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32a171-e97d-49bc-9268-220ae24db65d None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:50.387419 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32a171-e97d-49bc-9268-220ae24db65d None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:50.387917 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32a171-e97d-49bc-9268-220ae24db65d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:50.388973 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32a171-e97d-49bc-9268-220ae24db65d None admin] RBAC: Adding query filter params (role.id=3fb134668432434eb45c3bb21cb5882e, scope.project.id=0846fccaeb674395a87e45290eda74b7, user.id=2faf262ae9d643c0b8708dcfecd75b3f) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:50.389485 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32a171-e97d-49bc-9268-220ae24db65d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:50.391109 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32a171-e97d-49bc-9268-220ae24db65d None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:50.405957 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7748d0-1934-4963-ae9e-c52514c2d0a5 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:50.409400 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 338/685] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:56:50 2022] GET /identity/v3/role_assignments?user.id=2faf262ae9d643c0b8708dcfecd75b3f&scope.project.id=0846fccaeb674395a87e45290eda74b7&role.id=3fb134668432434eb45c3bb21cb5882e => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:50.442352 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387ed13-b97d-4d67-aa45-73d67b66024e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:50.443407 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387ed13-b97d-4d67-aa45-73d67b66024e None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:50.443718 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387ed13-b97d-4d67-aa45-73d67b66024e None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:50.444019 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387ed13-b97d-4d67-aa45-73d67b66024e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:50.454500 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387ed13-b97d-4d67-aa45-73d67b66024e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:50.456049 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387ed13-b97d-4d67-aa45-73d67b66024e None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:50.475646 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-2387ed13-b97d-4d67-aa45-73d67b66024e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:50.477252 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 348/686] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:50.482852 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32a171-e97d-49bc-9268-220ae24db65d None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:50.610695 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa740a6a-91f2-4329-a610-2fe9577f9bb1 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:50.611050 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa740a6a-91f2-4329-a610-2fe9577f9bb1 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:50.611246 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa740a6a-91f2-4329-a610-2fe9577f9bb1 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:50.613651 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 349/687] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 03:56:50.619627 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efc023-a3b5-4d81-9b37-70365723b7f0 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:50.619957 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efc023-a3b5-4d81-9b37-70365723b7f0 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:50.620204 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efc023-a3b5-4d81-9b37-70365723b7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:50.638524 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32a171-e97d-49bc-9268-220ae24db65d None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:50.646813 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-17efc023-a3b5-4d81-9b37-70365723b7f0 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:50.652349 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-17efc023-a3b5-4d81-9b37-70365723b7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:50.683450 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ccd59-e4e2-4949-b8db-b2e38b332036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:50.684172 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ccd59-e4e2-4949-b8db-b2e38b332036 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:50.684453 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ccd59-e4e2-4949-b8db-b2e38b332036 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:50.684727 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ccd59-e4e2-4949-b8db-b2e38b332036 None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:50.685464 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ccd59-e4e2-4949-b8db-b2e38b332036 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:50.685770 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ccd59-e4e2-4949-b8db-b2e38b332036 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:50.687166 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ccd59-e4e2-4949-b8db-b2e38b332036 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:50.700027 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 339/688] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:50.708650 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ccd59-e4e2-4949-b8db-b2e38b332036 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:50.746966 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 350/689] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 03:56:50.771731 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efc023-a3b5-4d81-9b37-70365723b7f0 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:50.827891 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ccd59-e4e2-4949-b8db-b2e38b332036 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:50.870846 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7dd18-33a3-483a-a85b-0141dc8dbd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:50.872436 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7dd18-33a3-483a-a85b-0141dc8dbd1d None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:50.873176 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7dd18-33a3-483a-a85b-0141dc8dbd1d None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:50.873667 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7dd18-33a3-483a-a85b-0141dc8dbd1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:50.874630 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efc023-a3b5-4d81-9b37-70365723b7f0 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:50.882228 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b7dd18-33a3-483a-a85b-0141dc8dbd1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:50.884323 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b7dd18-33a3-483a-a85b-0141dc8dbd1d None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:50.901618 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-62b7dd18-33a3-483a-a85b-0141dc8dbd1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:56:50.904040 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 340/690] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:56:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:50.911550 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7dd18-33a3-483a-a85b-0141dc8dbd1d None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:50.914382 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b556e5c-146a-46f8-adcc-dcf36a48aca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:50.915313 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b556e5c-146a-46f8-adcc-dcf36a48aca1 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:50.915661 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b556e5c-146a-46f8-adcc-dcf36a48aca1 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:50.916040 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b556e5c-146a-46f8-adcc-dcf36a48aca1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:50.928023 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b556e5c-146a-46f8-adcc-dcf36a48aca1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:50.935225 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-2b556e5c-146a-46f8-adcc-dcf36a48aca1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 03:56:50.937199 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 351/691] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:56:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:56:50.947707 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b556e5c-146a-46f8-adcc-dcf36a48aca1 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:51.073944 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7dd18-33a3-483a-a85b-0141dc8dbd1d None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:51.115180 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b556e5c-146a-46f8-adcc-dcf36a48aca1 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:51.141915 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afaa30-9e08-4f42-9af4-5de46d67b8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:51.142586 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afaa30-9e08-4f42-9af4-5de46d67b8aa None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:51.142869 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afaa30-9e08-4f42-9af4-5de46d67b8aa None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:51.143722 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afaa30-9e08-4f42-9af4-5de46d67b8aa None admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:51.145315 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afaa30-9e08-4f42-9af4-5de46d67b8aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:51.145627 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afaa30-9e08-4f42-9af4-5de46d67b8aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:51.147077 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afaa30-9e08-4f42-9af4-5de46d67b8aa None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:51.168487 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 341/692] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:56:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:51.174467 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afaa30-9e08-4f42-9af4-5de46d67b8aa None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:51.180469 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ab8e5-50c2-41ae-90b8-975d89f35a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:51.181197 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ab8e5-50c2-41ae-90b8-975d89f35a1d None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:51.181488 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ab8e5-50c2-41ae-90b8-975d89f35a1d None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:51.181764 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ab8e5-50c2-41ae-90b8-975d89f35a1d None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:51.182520 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ab8e5-50c2-41ae-90b8-975d89f35a1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:51.182828 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ab8e5-50c2-41ae-90b8-975d89f35a1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:51.184253 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ab8e5-50c2-41ae-90b8-975d89f35a1d None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:51.201746 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 352/693] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:56:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:51.207889 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ab8e5-50c2-41ae-90b8-975d89f35a1d None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:51.311334 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afaa30-9e08-4f42-9af4-5de46d67b8aa None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:51.349819 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d54b66-0efb-4d62-b7cc-a03615251615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:51.350830 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d54b66-0efb-4d62-b7cc-a03615251615 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:51.351320 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d54b66-0efb-4d62-b7cc-a03615251615 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:51.351818 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d54b66-0efb-4d62-b7cc-a03615251615 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:51.353421 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d54b66-0efb-4d62-b7cc-a03615251615 None admin] RBAC: Adding query filter params (role.id=3fb134668432434eb45c3bb21cb5882e, scope.project.id=0846fccaeb674395a87e45290eda74b7, user.id=260f561c676b4d049553eac4626b5502) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:51.354037 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d54b66-0efb-4d62-b7cc-a03615251615 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:51.355854 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d54b66-0efb-4d62-b7cc-a03615251615 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:51.362980 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 342/694] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:56:51 2022] GET /identity/v3/role_assignments?user.id=260f561c676b4d049553eac4626b5502&scope.project.id=0846fccaeb674395a87e45290eda74b7&role.id=3fb134668432434eb45c3bb21cb5882e => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:51.404918 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ab8e5-50c2-41ae-90b8-975d89f35a1d None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:51.440607 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91a886-4541-4b8a-9811-a2007cc4c471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:51.441756 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91a886-4541-4b8a-9811-a2007cc4c471 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:51.442236 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91a886-4541-4b8a-9811-a2007cc4c471 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:51.442967 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91a886-4541-4b8a-9811-a2007cc4c471 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:51.455056 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91a886-4541-4b8a-9811-a2007cc4c471 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:51.456960 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91a886-4541-4b8a-9811-a2007cc4c471 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:51.474208 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-ea91a886-4541-4b8a-9811-a2007cc4c471 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:51.476239 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 353/695] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:51.481478 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d54b66-0efb-4d62-b7cc-a03615251615 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:51.594040 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d54b66-0efb-4d62-b7cc-a03615251615 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:51.640329 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce86909-2bb1-403e-9153-5902291a00e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:51.641360 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce86909-2bb1-403e-9153-5902291a00e4 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:51.641842 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce86909-2bb1-403e-9153-5902291a00e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:51.642314 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce86909-2bb1-403e-9153-5902291a00e4 None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:51.643330 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce86909-2bb1-403e-9153-5902291a00e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:51.643881 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce86909-2bb1-403e-9153-5902291a00e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:51.645486 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce86909-2bb1-403e-9153-5902291a00e4 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:51.662890 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 343/696] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:51.669482 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91a886-4541-4b8a-9811-a2007cc4c471 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:51.777113 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91a886-4541-4b8a-9811-a2007cc4c471 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:51.811134 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d634a-dff2-48f7-a7d3-3931116f2333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:51.812282 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d634a-dff2-48f7-a7d3-3931116f2333 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:51.812763 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d634a-dff2-48f7-a7d3-3931116f2333 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:51.813235 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d634a-dff2-48f7-a7d3-3931116f2333 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:51.822640 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d634a-dff2-48f7-a7d3-3931116f2333 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:51.824349 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d634a-dff2-48f7-a7d3-3931116f2333 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:51.837998 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-373d634a-dff2-48f7-a7d3-3931116f2333 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 10 03:56:51.839802 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 354/697] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Mar 10 03:56:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:51.844937 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce86909-2bb1-403e-9153-5902291a00e4 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:51.969135 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce86909-2bb1-403e-9153-5902291a00e4 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:52.012720 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7dac1-58aa-4061-a062-516d7f80d64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:52.013421 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7dac1-58aa-4061-a062-516d7f80d64a None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:52.013709 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7dac1-58aa-4061-a062-516d7f80d64a None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:52.013994 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7dac1-58aa-4061-a062-516d7f80d64a None admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:52.014857 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7dac1-58aa-4061-a062-516d7f80d64a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:52.015171 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7dac1-58aa-4061-a062-516d7f80d64a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:52.016672 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a7dac1-58aa-4061-a062-516d7f80d64a None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:52.046552 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 344/698] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Mar 10 03:56:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:56:52.052325 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d634a-dff2-48f7-a7d3-3931116f2333 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:52.139115 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10916a-35fd-4fff-81c2-5ea018b09263 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:52.140107 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10916a-35fd-4fff-81c2-5ea018b09263 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:52.140591 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10916a-35fd-4fff-81c2-5ea018b09263 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:52.143793 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 345/699] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:52.148867 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea05a2-b664-42ae-914b-80010177b1bb None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:52.149157 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea05a2-b664-42ae-914b-80010177b1bb None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:52.149439 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea05a2-b664-42ae-914b-80010177b1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:52.180389 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-bcea05a2-b664-42ae-914b-80010177b1bb None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:52.181579 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-bcea05a2-b664-42ae-914b-80010177b1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:52.215273 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d634a-dff2-48f7-a7d3-3931116f2333 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:52.278609 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8175d-79cc-4a46-9982-cd81714ae8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:52.279265 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8175d-79cc-4a46-9982-cd81714ae8a8 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:52.279550 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8175d-79cc-4a46-9982-cd81714ae8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:52.279860 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8175d-79cc-4a46-9982-cd81714ae8a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:52.303268 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 346/700] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 03:56:52.340606 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea05a2-b664-42ae-914b-80010177b1bb None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:52.371079 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae8175d-79cc-4a46-9982-cd81714ae8a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:52.372571 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae8175d-79cc-4a46-9982-cd81714ae8a8 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:52.469813 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 355/701] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:56:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:56:52.484660 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8175d-79cc-4a46-9982-cd81714ae8a8 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:52.487959 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea05a2-b664-42ae-914b-80010177b1bb None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:52.531243 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4fd56-5b0a-4720-980f-a976021b8ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:52.532295 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4fd56-5b0a-4720-980f-a976021b8ecb None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:52.532736 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4fd56-5b0a-4720-980f-a976021b8ecb None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:52.533145 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e4fd56-5b0a-4720-980f-a976021b8ecb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:52.554594 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4fd56-5b0a-4720-980f-a976021b8ecb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:52.556541 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e4fd56-5b0a-4720-980f-a976021b8ecb None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:52.590763 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8175d-79cc-4a46-9982-cd81714ae8a8 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:52.593546 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-45e4fd56-5b0a-4720-980f-a976021b8ecb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:52.595291 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 347/702] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:52.600526 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4fd56-5b0a-4720-980f-a976021b8ecb None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:52.619634 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19153027-00e0-43eb-a43c-80cf6cbdb599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:52.620252 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19153027-00e0-43eb-a43c-80cf6cbdb599 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:52.620638 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19153027-00e0-43eb-a43c-80cf6cbdb599 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:52.621014 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19153027-00e0-43eb-a43c-80cf6cbdb599 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:52.631852 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19153027-00e0-43eb-a43c-80cf6cbdb599 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:52.633417 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19153027-00e0-43eb-a43c-80cf6cbdb599 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:52.651116 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-19153027-00e0-43eb-a43c-80cf6cbdb599 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:52.652792 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 356/703] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:52.657972 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19153027-00e0-43eb-a43c-80cf6cbdb599 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:52.747958 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e4fd56-5b0a-4720-980f-a976021b8ecb None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:52.775204 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19153027-00e0-43eb-a43c-80cf6cbdb599 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:52.790768 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11798e71-92f3-4180-b4bc-836c1571515f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:52.791449 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11798e71-92f3-4180-b4bc-836c1571515f None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:52.791928 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11798e71-92f3-4180-b4bc-836c1571515f None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:52.792212 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11798e71-92f3-4180-b4bc-836c1571515f None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:52.793252 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11798e71-92f3-4180-b4bc-836c1571515f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:52.793563 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11798e71-92f3-4180-b4bc-836c1571515f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:52.794951 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11798e71-92f3-4180-b4bc-836c1571515f None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:52.809509 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25439a9-8cdd-44c6-acca-cba05019687a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:52.809777 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 348/704] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:56:52.811095 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb26f9-dd8c-419c-8512-e20850d3e4fc None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:52.811393 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb26f9-dd8c-419c-8512-e20850d3e4fc None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:52.811677 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb26f9-dd8c-419c-8512-e20850d3e4fc None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:52.813587 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 349/705] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:52.814582 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25439a9-8cdd-44c6-acca-cba05019687a None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:52.815407 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25439a9-8cdd-44c6-acca-cba05019687a None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:52.815517 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb26f9-dd8c-419c-8512-e20850d3e4fc None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:52.815841 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25439a9-8cdd-44c6-acca-cba05019687a None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:52.816738 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25439a9-8cdd-44c6-acca-cba05019687a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:52.817149 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25439a9-8cdd-44c6-acca-cba05019687a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:52.818911 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25439a9-8cdd-44c6-acca-cba05019687a None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:52.831860 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 357/706] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:52.833271 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d06dd-4b3a-469d-a0ad-4fbfc60af758 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:52.833629 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d06dd-4b3a-469d-a0ad-4fbfc60af758 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:52.833977 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d06dd-4b3a-469d-a0ad-4fbfc60af758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:52.850430 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-4a1d06dd-4b3a-469d-a0ad-4fbfc60af758 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:52.851710 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-4a1d06dd-4b3a-469d-a0ad-4fbfc60af758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:52.923896 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 358/707] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:52.925386 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d06dd-4b3a-469d-a0ad-4fbfc60af758 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:52.949371 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb26f9-dd8c-419c-8512-e20850d3e4fc None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:52.985715 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f81ea0-aadb-4ff9-bf98-f94c298bd3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:52.986421 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f81ea0-aadb-4ff9-bf98-f94c298bd3fb None admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:52.987240 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f81ea0-aadb-4ff9-bf98-f94c298bd3fb None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:52.987525 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f81ea0-aadb-4ff9-bf98-f94c298bd3fb None admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:52.988280 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f81ea0-aadb-4ff9-bf98-f94c298bd3fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:52.989734 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f81ea0-aadb-4ff9-bf98-f94c298bd3fb None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:53.016492 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 350/708] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Mar 10 03:56:52 2022] POST /identity/v3/users => generated 254 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 03:56:53.017396 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f81ea0-aadb-4ff9-bf98-f94c298bd3fb None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:53.045949 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d06dd-4b3a-469d-a0ad-4fbfc60af758 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:53.125425 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9acb15-14cb-4106-bc96-504c33c64f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:53.126243 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9acb15-14cb-4106-bc96-504c33c64f41 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:53.126527 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9acb15-14cb-4106-bc96-504c33c64f41 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:53.126807 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9acb15-14cb-4106-bc96-504c33c64f41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:53.136010 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9acb15-14cb-4106-bc96-504c33c64f41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:53.137505 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9acb15-14cb-4106-bc96-504c33c64f41 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:53.153134 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-9a9acb15-14cb-4106-bc96-504c33c64f41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:56:53.154706 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 359/709] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:56:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:53.164170 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9acb15-14cb-4106-bc96-504c33c64f41 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:53.235722 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f81ea0-aadb-4ff9-bf98-f94c298bd3fb None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:53.274425 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe9f55-0113-4b3a-bb60-80e44a661d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:53.275240 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe9f55-0113-4b3a-bb60-80e44a661d12 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:53.275520 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe9f55-0113-4b3a-bb60-80e44a661d12 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:53.275829 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe9f55-0113-4b3a-bb60-80e44a661d12 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:53.276488 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe9f55-0113-4b3a-bb60-80e44a661d12 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:53.277853 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe9f55-0113-4b3a-bb60-80e44a661d12 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:53.291254 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-bdfe9f55-0113-4b3a-bb60-80e44a661d12 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 10 03:56:53.292771 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 351/710] 10.222.0.15 () {56 vars in 1129 bytes} [Thu Mar 10 03:56:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:53.299060 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe9f55-0113-4b3a-bb60-80e44a661d12 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:53.303881 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9acb15-14cb-4106-bc96-504c33c64f41 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:53.337766 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75aa0fe-813a-45b8-bad6-841aa4129355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:53.338438 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75aa0fe-813a-45b8-bad6-841aa4129355 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:53.338716 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75aa0fe-813a-45b8-bad6-841aa4129355 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:53.338986 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75aa0fe-813a-45b8-bad6-841aa4129355 None admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:53.339927 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75aa0fe-813a-45b8-bad6-841aa4129355 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:53.340275 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75aa0fe-813a-45b8-bad6-841aa4129355 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:53.341723 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75aa0fe-813a-45b8-bad6-841aa4129355 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:53.362789 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 360/711] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:56:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:53.368750 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75aa0fe-813a-45b8-bad6-841aa4129355 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:53.405993 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe9f55-0113-4b3a-bb60-80e44a661d12 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:53.445596 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab0344-c6d6-4322-af75-f638fef8ef74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:53.446265 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab0344-c6d6-4322-af75-f638fef8ef74 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:53.446549 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab0344-c6d6-4322-af75-f638fef8ef74 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:53.446827 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab0344-c6d6-4322-af75-f638fef8ef74 None admin] PATH_INFO: `/v3/services` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:53.447540 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab0344-c6d6-4322-af75-f638fef8ef74 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:53.447881 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab0344-c6d6-4322-af75-f638fef8ef74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:53.449266 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab0344-c6d6-4322-af75-f638fef8ef74 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:53.455253 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 352/712] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Mar 10 03:56:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:53.456565 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb6134-43dd-44d6-b7da-e6d696d780c4 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:53.456855 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb6134-43dd-44d6-b7da-e6d696d780c4 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:53.457135 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb6134-43dd-44d6-b7da-e6d696d780c4 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:53.463521 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 353/713] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:53.463521 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb6134-43dd-44d6-b7da-e6d696d780c4 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:53.497690 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75aa0fe-813a-45b8-bad6-841aa4129355 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:53.531173 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a246a-4767-491c-866f-020e2c4ba776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:53.531909 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a246a-4767-491c-866f-020e2c4ba776 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:53.532191 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a246a-4767-491c-866f-020e2c4ba776 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:53.532466 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a246a-4767-491c-866f-020e2c4ba776 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:53.533287 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a246a-4767-491c-866f-020e2c4ba776 None admin] RBAC: Adding query filter params (role.id=a8b2a5887cec4a31b7304792af3dd3f1, scope.project.id=0846fccaeb674395a87e45290eda74b7, user.id=fbd92bd14ed04621af06d68161798fe3) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:53.534175 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a246a-4767-491c-866f-020e2c4ba776 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:53.535646 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a246a-4767-491c-866f-020e2c4ba776 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:53.541645 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 361/714] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:56:53 2022] GET /identity/v3/role_assignments?user.id=fbd92bd14ed04621af06d68161798fe3&scope.project.id=0846fccaeb674395a87e45290eda74b7&role.id=a8b2a5887cec4a31b7304792af3dd3f1 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:56:53.543098 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d51704-0d6e-49c4-8518-b27e1fc8404d None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:53.543341 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d51704-0d6e-49c4-8518-b27e1fc8404d None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:53.543623 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d51704-0d6e-49c4-8518-b27e1fc8404d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:53.565848 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-73d51704-0d6e-49c4-8518-b27e1fc8404d None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:53.567100 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-73d51704-0d6e-49c4-8518-b27e1fc8404d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:53.582594 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb6134-43dd-44d6-b7da-e6d696d780c4 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:53.621598 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846ddb7-6bbc-4ccd-80b2-f8c37635f977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:53.622650 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846ddb7-6bbc-4ccd-80b2-f8c37635f977 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:53.623170 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846ddb7-6bbc-4ccd-80b2-f8c37635f977 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:53.623709 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846ddb7-6bbc-4ccd-80b2-f8c37635f977 None admin] PATH_INFO: `/v3/services` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:53.624675 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3846ddb7-6bbc-4ccd-80b2-f8c37635f977 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:53.625193 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3846ddb7-6bbc-4ccd-80b2-f8c37635f977 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:53.626888 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3846ddb7-6bbc-4ccd-80b2-f8c37635f977 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:53.633630 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 354/715] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Mar 10 03:56:53 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:53.649595 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 362/716] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:53.685654 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846ddb7-6bbc-4ccd-80b2-f8c37635f977 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:53.832169 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846ddb7-6bbc-4ccd-80b2-f8c37635f977 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:53.881004 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bcd3a1-d412-463e-b4d4-fc24d737f894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:53.882067 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcd3a1-d412-463e-b4d4-fc24d737f894 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:53.882499 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcd3a1-d412-463e-b4d4-fc24d737f894 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:53.882923 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcd3a1-d412-463e-b4d4-fc24d737f894 None admin] PATH_INFO: `/v3/services/network` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:53.883893 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bcd3a1-d412-463e-b4d4-fc24d737f894 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:53.885426 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bcd3a1-d412-463e-b4d4-fc24d737f894 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:53.903629 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-50bcd3a1-d412-463e-b4d4-fc24d737f894 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 10 03:56:53.905403 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 355/717] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:56:53 2022] GET /identity/v3/services/network => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:53.911917 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d51704-0d6e-49c4-8518-b27e1fc8404d None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:54.036076 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d51704-0d6e-49c4-8518-b27e1fc8404d None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:54.081159 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb2284-3b95-46c9-9d1f-65f2aecf1e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:54.081912 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb2284-3b95-46c9-9d1f-65f2aecf1e0b None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:54.082196 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb2284-3b95-46c9-9d1f-65f2aecf1e0b None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:54.082472 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb2284-3b95-46c9-9d1f-65f2aecf1e0b None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:54.083241 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb2284-3b95-46c9-9d1f-65f2aecf1e0b None admin] RBAC: Adding query filter params (name=network) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:54.083547 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb2284-3b95-46c9-9d1f-65f2aecf1e0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:54.084969 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb2284-3b95-46c9-9d1f-65f2aecf1e0b None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:54.090129 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 363/718] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Mar 10 03:56:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:54.095525 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bcd3a1-d412-463e-b4d4-fc24d737f894 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:54.205097 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bcd3a1-d412-463e-b4d4-fc24d737f894 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:54.243136 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79ac62-91b4-4634-9412-ba02955cb10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:54.243936 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79ac62-91b4-4634-9412-ba02955cb10c None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:54.244121 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79ac62-91b4-4634-9412-ba02955cb10c None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:54.244403 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79ac62-91b4-4634-9412-ba02955cb10c None admin] PATH_INFO: `/v3/services` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:54.245117 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79ac62-91b4-4634-9412-ba02955cb10c None admin] RBAC: Adding query filter params (type=network) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:54.245423 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79ac62-91b4-4634-9412-ba02955cb10c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:54.246793 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79ac62-91b4-4634-9412-ba02955cb10c None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:54.251451 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 356/719] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Mar 10 03:56:54 2022] GET /identity/v3/services?type=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:54.500356 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd327bb9-4b2f-41a2-bb4c-c7d5b05bf517 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:54.500922 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd327bb9-4b2f-41a2-bb4c-c7d5b05bf517 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:54.501432 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd327bb9-4b2f-41a2-bb4c-c7d5b05bf517 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:54.504442 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 364/720] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:54.509823 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ec3d9-da21-4011-bb00-ee72f7af5f1b None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:54.510110 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ec3d9-da21-4011-bb00-ee72f7af5f1b None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:54.510574 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ec3d9-da21-4011-bb00-ee72f7af5f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:54.536857 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-736ec3d9-da21-4011-bb00-ee72f7af5f1b None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:54.538331 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-736ec3d9-da21-4011-bb00-ee72f7af5f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:54.623256 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 357/721] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:54.655960 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd327bb9-4b2f-41a2-bb4c-c7d5b05bf517 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:54.783548 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd327bb9-4b2f-41a2-bb4c-c7d5b05bf517 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:54.816821 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d6885-eee7-4381-8af9-00d4cd65c656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:54.817878 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d6885-eee7-4381-8af9-00d4cd65c656 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:54.818162 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d6885-eee7-4381-8af9-00d4cd65c656 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:54.818436 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d6885-eee7-4381-8af9-00d4cd65c656 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:54.828426 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d6885-eee7-4381-8af9-00d4cd65c656 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:54.835511 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-0c9d6885-eee7-4381-8af9-00d4cd65c656 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 03:56:54.837130 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 365/722] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:56:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:54.843097 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ec3d9-da21-4011-bb00-ee72f7af5f1b None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:54.952452 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ec3d9-da21-4011-bb00-ee72f7af5f1b None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:55.005865 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9117f-b270-4915-b074-27520184b89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:55.006943 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9117f-b270-4915-b074-27520184b89c None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:55.007399 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9117f-b270-4915-b074-27520184b89c None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:55.007823 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9117f-b270-4915-b074-27520184b89c None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:55.008605 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9117f-b270-4915-b074-27520184b89c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:55.008911 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9117f-b270-4915-b074-27520184b89c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:55.010299 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9117f-b270-4915-b074-27520184b89c None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:55.023356 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 358/723] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:56:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:55.028790 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d6885-eee7-4381-8af9-00d4cd65c656 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:55.154562 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d6885-eee7-4381-8af9-00d4cd65c656 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:55.191106 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a935c9-cb8a-4b3f-ae4d-8c41a6667d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:55.191925 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a935c9-cb8a-4b3f-ae4d-8c41a6667d31 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:55.192206 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a935c9-cb8a-4b3f-ae4d-8c41a6667d31 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:55.192733 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a935c9-cb8a-4b3f-ae4d-8c41a6667d31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:55.208951 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a935c9-cb8a-4b3f-ae4d-8c41a6667d31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:55.210460 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a935c9-cb8a-4b3f-ae4d-8c41a6667d31 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:55.234264 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-42a935c9-cb8a-4b3f-ae4d-8c41a6667d31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:55.235798 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 366/724] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:56:55.241264 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9117f-b270-4915-b074-27520184b89c None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:55.365092 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9117f-b270-4915-b074-27520184b89c None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:55.409076 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e5748-9ae1-415b-8a4d-0e41db55607d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:55.409628 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e5748-9ae1-415b-8a4d-0e41db55607d None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:55.409913 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e5748-9ae1-415b-8a4d-0e41db55607d None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:55.410191 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e5748-9ae1-415b-8a4d-0e41db55607d None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:55.410914 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e5748-9ae1-415b-8a4d-0e41db55607d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:55.411217 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e5748-9ae1-415b-8a4d-0e41db55607d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:55.412619 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e5748-9ae1-415b-8a4d-0e41db55607d None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:55.430664 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 359/725] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:55.435940 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a935c9-cb8a-4b3f-ae4d-8c41a6667d31 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:55.568077 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a935c9-cb8a-4b3f-ae4d-8c41a6667d31 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:55.611116 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5b5da-29b3-4c70-b469-5523e0e37be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:55.611986 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5b5da-29b3-4c70-b469-5523e0e37be1 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:55.612265 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5b5da-29b3-4c70-b469-5523e0e37be1 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:55.612536 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5b5da-29b3-4c70-b469-5523e0e37be1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:55.620348 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5b5da-29b3-4c70-b469-5523e0e37be1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:55.621782 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5b5da-29b3-4c70-b469-5523e0e37be1 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:55.641195 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-37a5b5da-29b3-4c70-b469-5523e0e37be1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 10 03:56:55.642395 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 367/726] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:56:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:55.648764 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e5748-9ae1-415b-8a4d-0e41db55607d None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:55.784077 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e5748-9ae1-415b-8a4d-0e41db55607d None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:55.829265 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004c4ae-ff75-4c71-b0bb-6f7f4c8187ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:55.829934 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004c4ae-ff75-4c71-b0bb-6f7f4c8187ee None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:55.830274 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004c4ae-ff75-4c71-b0bb-6f7f4c8187ee None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:55.831064 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004c4ae-ff75-4c71-b0bb-6f7f4c8187ee None admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:55.831924 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004c4ae-ff75-4c71-b0bb-6f7f4c8187ee None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:55.832233 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004c4ae-ff75-4c71-b0bb-6f7f4c8187ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:55.833667 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004c4ae-ff75-4c71-b0bb-6f7f4c8187ee None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:55.851945 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 360/727] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Mar 10 03:56:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:55.861029 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5b5da-29b3-4c70-b469-5523e0e37be1 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:56.010800 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5b5da-29b3-4c70-b469-5523e0e37be1 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:56.054596 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e6d94-cbba-4d38-9516-649f8611df70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:56.055448 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e6d94-cbba-4d38-9516-649f8611df70 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:56.055636 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e6d94-cbba-4d38-9516-649f8611df70 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:56.055921 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e6d94-cbba-4d38-9516-649f8611df70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:56.130365 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e6d94-cbba-4d38-9516-649f8611df70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:56.131835 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e6d94-cbba-4d38-9516-649f8611df70 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:56.217241 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241710b7-4d49-4a79-b750-2a2f58dd1383 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:56.217526 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241710b7-4d49-4a79-b750-2a2f58dd1383 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:56.217999 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241710b7-4d49-4a79-b750-2a2f58dd1383 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:56.220192 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 361/728] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:56.228834 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb443dbb-21bf-4340-9a48-14342e8121ff None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:56.229385 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb443dbb-21bf-4340-9a48-14342e8121ff None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:56.229660 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb443dbb-21bf-4340-9a48-14342e8121ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:56.246990 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-bb443dbb-21bf-4340-9a48-14342e8121ff None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:56.248624 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-bb443dbb-21bf-4340-9a48-14342e8121ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:56.250263 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 368/729] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:56:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 10 03:56:56.256446 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e6d94-cbba-4d38-9516-649f8611df70 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:56.373889 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 362/730] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 10 03:56:56.398245 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e6d94-cbba-4d38-9516-649f8611df70 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:56.415191 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb443dbb-21bf-4340-9a48-14342e8121ff None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:56.456667 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c1d17-a4f7-4883-bfc0-8c10d8d29c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:56.457464 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c1d17-a4f7-4883-bfc0-8c10d8d29c12 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:56.457742 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c1d17-a4f7-4883-bfc0-8c10d8d29c12 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:56.458010 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c1d17-a4f7-4883-bfc0-8c10d8d29c12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:56.469668 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c1d17-a4f7-4883-bfc0-8c10d8d29c12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:56.471660 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c1d17-a4f7-4883-bfc0-8c10d8d29c12 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:56.489320 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-ce0c1d17-a4f7-4883-bfc0-8c10d8d29c12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:56.490801 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 369/731] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:56:56.492220 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa26a4d-940f-4018-9d5a-b56f59744b16 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:56.492674 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa26a4d-940f-4018-9d5a-b56f59744b16 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:56.493094 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa26a4d-940f-4018-9d5a-b56f59744b16 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:56.495304 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 370/732] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:56.496254 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa26a4d-940f-4018-9d5a-b56f59744b16 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:56.538475 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb443dbb-21bf-4340-9a48-14342e8121ff None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:56.574000 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f4182-33a9-4d76-a42c-a7b85cec6c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:56.575030 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f4182-33a9-4d76-a42c-a7b85cec6c39 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:56.575451 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f4182-33a9-4d76-a42c-a7b85cec6c39 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:56.575893 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f4182-33a9-4d76-a42c-a7b85cec6c39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:56.586142 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f4182-33a9-4d76-a42c-a7b85cec6c39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:56.593303 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-289f4182-33a9-4d76-a42c-a7b85cec6c39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 03:56:56.599881 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 363/733] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Mar 10 03:56:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:56:56.599881 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19053c04-3a03-4fa9-8749-09f0191a919d None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:56.599881 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19053c04-3a03-4fa9-8749-09f0191a919d None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:56.599881 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19053c04-3a03-4fa9-8749-09f0191a919d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:56.601529 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa26a4d-940f-4018-9d5a-b56f59744b16 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:56.621456 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-19053c04-3a03-4fa9-8749-09f0191a919d None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:56.622622 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-19053c04-3a03-4fa9-8749-09f0191a919d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:56.636706 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2c5f4-1978-4739-bc7f-71d432538a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:56.637299 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2c5f4-1978-4739-bc7f-71d432538a96 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:56.637584 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2c5f4-1978-4739-bc7f-71d432538a96 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:56.637854 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2c5f4-1978-4739-bc7f-71d432538a96 None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:56.638568 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d2c5f4-1978-4739-bc7f-71d432538a96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:56.638872 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d2c5f4-1978-4739-bc7f-71d432538a96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:56.640259 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d2c5f4-1978-4739-bc7f-71d432538a96 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:56.651590 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 371/734] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:56:56.652673 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2c5f4-1978-4739-bc7f-71d432538a96 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:56.693431 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 364/735] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:56.695074 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722ccd5-b3e0-4448-a7f9-20eeba2c3b5f None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:56.695544 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722ccd5-b3e0-4448-a7f9-20eeba2c3b5f None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:56.696076 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722ccd5-b3e0-4448-a7f9-20eeba2c3b5f None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:56.698197 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 365/736] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:56.699108 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722ccd5-b3e0-4448-a7f9-20eeba2c3b5f None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:56.751626 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2c5f4-1978-4739-bc7f-71d432538a96 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:56.784575 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bede1-eaf9-44a7-81a0-059b58311ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:56.785365 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bede1-eaf9-44a7-81a0-059b58311ac0 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:56.785657 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bede1-eaf9-44a7-81a0-059b58311ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:56.785937 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bede1-eaf9-44a7-81a0-059b58311ac0 None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:56.786685 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70bede1-eaf9-44a7-81a0-059b58311ac0 None admin] RBAC: Adding query filter params (name=service) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:56.786991 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70bede1-eaf9-44a7-81a0-059b58311ac0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:56.788375 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70bede1-eaf9-44a7-81a0-059b58311ac0 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:56.800481 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 372/737] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Mar 10 03:56:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:56.800481 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d99c67-7e69-4c0a-b32f-e855bd4ebe97 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:56.800481 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d99c67-7e69-4c0a-b32f-e855bd4ebe97 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:56.800481 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d99c67-7e69-4c0a-b32f-e855bd4ebe97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:56.815816 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-b4d99c67-7e69-4c0a-b32f-e855bd4ebe97 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:56.816608 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722ccd5-b3e0-4448-a7f9-20eeba2c3b5f None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:56.817000 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-b4d99c67-7e69-4c0a-b32f-e855bd4ebe97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:56.850416 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e22b0-d12f-4771-88cf-692921929602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:56.851214 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e22b0-d12f-4771-88cf-692921929602 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:56.851497 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e22b0-d12f-4771-88cf-692921929602 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:56.851799 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e22b0-d12f-4771-88cf-692921929602 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:56.858330 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e22b0-d12f-4771-88cf-692921929602 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:56.859798 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e22b0-d12f-4771-88cf-692921929602 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:56.872686 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-d27e22b0-d12f-4771-88cf-692921929602 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:56:56.873864 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 366/738] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:56:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:56.875648 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e22b0-d12f-4771-88cf-692921929602 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:56.891221 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 373/739] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:56.892036 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d99c67-7e69-4c0a-b32f-e855bd4ebe97 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:56.980430 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e22b0-d12f-4771-88cf-692921929602 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:57.000620 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d99c67-7e69-4c0a-b32f-e855bd4ebe97 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:57.015566 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e632070-4b27-4a09-b1f7-2b1381d8f9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:57.020219 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e632070-4b27-4a09-b1f7-2b1381d8f9c2 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:57.020219 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e632070-4b27-4a09-b1f7-2b1381d8f9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:57.020219 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e632070-4b27-4a09-b1f7-2b1381d8f9c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:57.027551 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e632070-4b27-4a09-b1f7-2b1381d8f9c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:56:57.034776 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-9e632070-4b27-4a09-b1f7-2b1381d8f9c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 03:56:57.040742 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 367/740] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:56:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:57.040742 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e632070-4b27-4a09-b1f7-2b1381d8f9c2 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:57.042304 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae8b3f-12c3-4d0b-89e5-561bbedfdce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:57.043108 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae8b3f-12c3-4d0b-89e5-561bbedfdce5 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:57.043388 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae8b3f-12c3-4d0b-89e5-561bbedfdce5 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:57.043660 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ae8b3f-12c3-4d0b-89e5-561bbedfdce5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:57.054308 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae8b3f-12c3-4d0b-89e5-561bbedfdce5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:57.055734 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ae8b3f-12c3-4d0b-89e5-561bbedfdce5 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:57.078235 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-f8ae8b3f-12c3-4d0b-89e5-561bbedfdce5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:57.079637 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 374/741] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:57.081770 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae8b3f-12c3-4d0b-89e5-561bbedfdce5 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:57.146489 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e632070-4b27-4a09-b1f7-2b1381d8f9c2 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:57.183046 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ae8b3f-12c3-4d0b-89e5-561bbedfdce5 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:57.184673 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2fd83e-d8a8-49a0-bd5b-f319c0c1d54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:57.186064 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fd83e-d8a8-49a0-bd5b-f319c0c1d54a None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:57.186350 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fd83e-d8a8-49a0-bd5b-f319c0c1d54a None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:57.186626 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fd83e-d8a8-49a0-bd5b-f319c0c1d54a None admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:57.187404 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2fd83e-d8a8-49a0-bd5b-f319c0c1d54a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:57.187733 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2fd83e-d8a8-49a0-bd5b-f319c0c1d54a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:57.189160 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2fd83e-d8a8-49a0-bd5b-f319c0c1d54a None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:57.210144 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 368/742] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:56:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:57.210144 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2fd83e-d8a8-49a0-bd5b-f319c0c1d54a None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:57.217084 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc273ceb-037d-45c5-b90e-1e86ee15acf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:57.217749 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc273ceb-037d-45c5-b90e-1e86ee15acf7 None admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:57.218224 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc273ceb-037d-45c5-b90e-1e86ee15acf7 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:57.218329 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc273ceb-037d-45c5-b90e-1e86ee15acf7 None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:57.219002 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc273ceb-037d-45c5-b90e-1e86ee15acf7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:57.220400 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc273ceb-037d-45c5-b90e-1e86ee15acf7 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:57.234700 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 375/743] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Mar 10 03:56:57 2022] POST /identity/v3/services => generated 251 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 03:56:57.235514 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc273ceb-037d-45c5-b90e-1e86ee15acf7 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:57.322386 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2fd83e-d8a8-49a0-bd5b-f319c0c1d54a None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:57.359786 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc273ceb-037d-45c5-b90e-1e86ee15acf7 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:57.363153 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69133d8b-3fa7-40b8-8a09-2f7c5d71bfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:57.363916 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69133d8b-3fa7-40b8-8a09-2f7c5d71bfbc None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:57.364253 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69133d8b-3fa7-40b8-8a09-2f7c5d71bfbc None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:57.364535 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69133d8b-3fa7-40b8-8a09-2f7c5d71bfbc None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:57.365349 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69133d8b-3fa7-40b8-8a09-2f7c5d71bfbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:57.365656 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69133d8b-3fa7-40b8-8a09-2f7c5d71bfbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:57.367062 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69133d8b-3fa7-40b8-8a09-2f7c5d71bfbc None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:57.381466 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 369/744] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:56:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:57.381466 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69133d8b-3fa7-40b8-8a09-2f7c5d71bfbc None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:57.397918 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5b68f-bf56-4c9d-9a3f-2070253cbf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:57.398513 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5b68f-bf56-4c9d-9a3f-2070253cbf53 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:57.398793 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5b68f-bf56-4c9d-9a3f-2070253cbf53 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:57.399064 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5b68f-bf56-4c9d-9a3f-2070253cbf53 None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:57.399834 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c5b68f-bf56-4c9d-9a3f-2070253cbf53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:57.400123 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c5b68f-bf56-4c9d-9a3f-2070253cbf53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:57.401514 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c5b68f-bf56-4c9d-9a3f-2070253cbf53 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:57.413178 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 376/745] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:57.414664 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03661db2-977a-436f-9f60-7347f8715b97 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:57.415006 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03661db2-977a-436f-9f60-7347f8715b97 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:57.415246 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03661db2-977a-436f-9f60-7347f8715b97 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:57.417855 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 377/746] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:57.418498 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03661db2-977a-436f-9f60-7347f8715b97 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:57.492171 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69133d8b-3fa7-40b8-8a09-2f7c5d71bfbc None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:57.517553 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03661db2-977a-436f-9f60-7347f8715b97 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:57.525617 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ed258-b2ab-4698-8c76-9e4251d3dcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:57.526267 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ed258-b2ab-4698-8c76-9e4251d3dcd2 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:57.526547 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ed258-b2ab-4698-8c76-9e4251d3dcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:57.526821 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ed258-b2ab-4698-8c76-9e4251d3dcd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:57.527637 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ed258-b2ab-4698-8c76-9e4251d3dcd2 None admin] RBAC: Adding query filter params (role.id=a8b2a5887cec4a31b7304792af3dd3f1, scope.project.id=0846fccaeb674395a87e45290eda74b7, user.id=260f561c676b4d049553eac4626b5502) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:57.527970 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ed258-b2ab-4698-8c76-9e4251d3dcd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:57.529392 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ed258-b2ab-4698-8c76-9e4251d3dcd2 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:57.534628 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 370/747] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:56:57 2022] GET /identity/v3/role_assignments?user.id=260f561c676b4d049553eac4626b5502&scope.project.id=0846fccaeb674395a87e45290eda74b7&role.id=a8b2a5887cec4a31b7304792af3dd3f1 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:57.535397 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ed258-b2ab-4698-8c76-9e4251d3dcd2 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:57.555909 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8faa8cc-e01c-4b00-9075-5b42372328aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:57.557527 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8faa8cc-e01c-4b00-9075-5b42372328aa None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:57.557972 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8faa8cc-e01c-4b00-9075-5b42372328aa None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:57.558391 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8faa8cc-e01c-4b00-9075-5b42372328aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:57.573954 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8faa8cc-e01c-4b00-9075-5b42372328aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:57.576187 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8faa8cc-e01c-4b00-9075-5b42372328aa None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:57.599928 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-b8faa8cc-e01c-4b00-9075-5b42372328aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:57.607373 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 378/748] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:57.609450 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1ff7f-7901-4a0e-9286-e5408171f798 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:57.610087 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1ff7f-7901-4a0e-9286-e5408171f798 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:57.610880 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1ff7f-7901-4a0e-9286-e5408171f798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:57.633986 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-00b1ff7f-7901-4a0e-9286-e5408171f798 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:57.636038 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-00b1ff7f-7901-4a0e-9286-e5408171f798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:56:57.662903 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ed258-b2ab-4698-8c76-9e4251d3dcd2 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:57.700444 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b5624-f48b-407b-ba6f-0d923c0cf94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:57.701379 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b5624-f48b-407b-ba6f-0d923c0cf94d None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:57.701729 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b5624-f48b-407b-ba6f-0d923c0cf94d None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:57.702155 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b5624-f48b-407b-ba6f-0d923c0cf94d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:57.710965 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b5624-f48b-407b-ba6f-0d923c0cf94d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:57.712638 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b5624-f48b-407b-ba6f-0d923c0cf94d None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:57.716520 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 379/749] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:57 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 10 03:56:57.717603 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1ff7f-7901-4a0e-9286-e5408171f798 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:57.729456 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-c01b5624-f48b-407b-ba6f-0d923c0cf94d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 10 03:56:57.731070 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 371/750] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Mar 10 03:56:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:57.740744 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b5624-f48b-407b-ba6f-0d923c0cf94d None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:57.827352 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1ff7f-7901-4a0e-9286-e5408171f798 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:57.863075 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71efe4-c822-493f-a4c1-9ad74e410671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:57.863768 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71efe4-c822-493f-a4c1-9ad74e410671 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:57.864056 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71efe4-c822-493f-a4c1-9ad74e410671 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:57.864335 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71efe4-c822-493f-a4c1-9ad74e410671 None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:57.865050 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71efe4-c822-493f-a4c1-9ad74e410671 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:57.865355 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71efe4-c822-493f-a4c1-9ad74e410671 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:57.866730 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e71efe4-c822-493f-a4c1-9ad74e410671 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:57.868183 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b5624-f48b-407b-ba6f-0d923c0cf94d None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:57.882829 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 380/751] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:57.882829 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71efe4-c822-493f-a4c1-9ad74e410671 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:57.907902 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7623df-26cc-46ed-8586-7bb4e4c99186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:57.908868 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7623df-26cc-46ed-8586-7bb4e4c99186 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:57.909303 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7623df-26cc-46ed-8586-7bb4e4c99186 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:57.909756 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7623df-26cc-46ed-8586-7bb4e4c99186 None admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:57.910761 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7623df-26cc-46ed-8586-7bb4e4c99186 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:57.911257 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7623df-26cc-46ed-8586-7bb4e4c99186 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:57.912965 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7623df-26cc-46ed-8586-7bb4e4c99186 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:57.935974 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 372/752] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Mar 10 03:56:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:57.937134 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7623df-26cc-46ed-8586-7bb4e4c99186 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:57.984340 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71efe4-c822-493f-a4c1-9ad74e410671 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:58.017320 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4d053-2995-4cb3-8652-fe20ad52abb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:58.018623 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4d053-2995-4cb3-8652-fe20ad52abb7 None admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:58.018832 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4d053-2995-4cb3-8652-fe20ad52abb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:58.019109 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4d053-2995-4cb3-8652-fe20ad52abb7 None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:58.020218 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4d053-2995-4cb3-8652-fe20ad52abb7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:58.021330 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4d053-2995-4cb3-8652-fe20ad52abb7 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:58.039214 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7623df-26cc-46ed-8586-7bb4e4c99186 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:58.041132 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 381/753] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Mar 10 03:56:57 2022] POST /identity/v3/services => generated 240 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 03:56:58.042348 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4d053-2995-4cb3-8652-fe20ad52abb7 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:58.083559 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e97a1c-5323-4516-b3e0-7855da72bfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:58.084441 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e97a1c-5323-4516-b3e0-7855da72bfac None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:58.084725 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e97a1c-5323-4516-b3e0-7855da72bfac None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:58.085002 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e97a1c-5323-4516-b3e0-7855da72bfac None admin] PATH_INFO: `/v3/users/nova` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:58.092941 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e97a1c-5323-4516-b3e0-7855da72bfac None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:58.094399 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e97a1c-5323-4516-b3e0-7855da72bfac None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:58.108458 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-e8e97a1c-5323-4516-b3e0-7855da72bfac None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 10 03:56:58.110001 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 373/754] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Mar 10 03:56:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:58.118510 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e97a1c-5323-4516-b3e0-7855da72bfac None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:58.182328 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4d053-2995-4cb3-8652-fe20ad52abb7 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:58.234493 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95174bb4-2abd-4359-8120-83d104ddac30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:58.235552 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95174bb4-2abd-4359-8120-83d104ddac30 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:58.236107 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95174bb4-2abd-4359-8120-83d104ddac30 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:58.238625 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95174bb4-2abd-4359-8120-83d104ddac30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:58.301403 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e97a1c-5323-4516-b3e0-7855da72bfac None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:58.311465 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95174bb4-2abd-4359-8120-83d104ddac30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:58.313216 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95174bb4-2abd-4359-8120-83d104ddac30 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:58.340495 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8bad6-91a2-475c-ac54-4ca3546c4941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:58.341183 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8bad6-91a2-475c-ac54-4ca3546c4941 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:58.341468 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8bad6-91a2-475c-ac54-4ca3546c4941 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:58.341755 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8bad6-91a2-475c-ac54-4ca3546c4941 None admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:58.342584 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8bad6-91a2-475c-ac54-4ca3546c4941 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:58.342882 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8bad6-91a2-475c-ac54-4ca3546c4941 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:58.344337 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8bad6-91a2-475c-ac54-4ca3546c4941 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:58.376164 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 374/755] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Mar 10 03:56:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:56:58.381478 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8bad6-91a2-475c-ac54-4ca3546c4941 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:58.432501 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 382/756] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:56:58 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 03:56:58.437450 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95174bb4-2abd-4359-8120-83d104ddac30 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:58.502874 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8bad6-91a2-475c-ac54-4ca3546c4941 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:58.537377 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6b539-59e0-41c2-ae47-b362d25b4734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:58.538567 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6b539-59e0-41c2-ae47-b362d25b4734 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:58.539046 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6b539-59e0-41c2-ae47-b362d25b4734 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:58.539515 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6b539-59e0-41c2-ae47-b362d25b4734 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:58.550673 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df6b539-59e0-41c2-ae47-b362d25b4734 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:58.552462 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df6b539-59e0-41c2-ae47-b362d25b4734 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:58.560505 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95174bb4-2abd-4359-8120-83d104ddac30 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:58.570720 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-0df6b539-59e0-41c2-ae47-b362d25b4734 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:58.573716 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 375/757] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:58.579531 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6b539-59e0-41c2-ae47-b362d25b4734 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:58.600095 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bb355-dcee-4a6d-a78b-b55c4ef75cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:58.603719 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bb355-dcee-4a6d-a78b-b55c4ef75cb7 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:58.603719 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bb355-dcee-4a6d-a78b-b55c4ef75cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:58.603719 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bb355-dcee-4a6d-a78b-b55c4ef75cb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:58.617779 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275bb355-dcee-4a6d-a78b-b55c4ef75cb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:58.619395 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275bb355-dcee-4a6d-a78b-b55c4ef75cb7 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:58.638228 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-275bb355-dcee-4a6d-a78b-b55c4ef75cb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:56:58.640189 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 383/758] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:56:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:56:58.645985 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bb355-dcee-4a6d-a78b-b55c4ef75cb7 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:58.785127 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bb355-dcee-4a6d-a78b-b55c4ef75cb7 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:58.785910 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6b539-59e0-41c2-ae47-b362d25b4734 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:58.823505 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2887529-2f85-4266-902d-1c666badde3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:58.824195 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2887529-2f85-4266-902d-1c666badde3a None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:58.824476 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2887529-2f85-4266-902d-1c666badde3a None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:58.824751 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2887529-2f85-4266-902d-1c666badde3a None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:58.825528 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2887529-2f85-4266-902d-1c666badde3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:58.825835 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2887529-2f85-4266-902d-1c666badde3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:58.827192 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2887529-2f85-4266-902d-1c666badde3a None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:58.839851 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 384/759] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:58.847755 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2887529-2f85-4266-902d-1c666badde3a None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:58.864034 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2023e8-ca98-4070-8693-b7fb14aa19e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:58.864756 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2023e8-ca98-4070-8693-b7fb14aa19e9 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:58.865081 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2023e8-ca98-4070-8693-b7fb14aa19e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:58.865368 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2023e8-ca98-4070-8693-b7fb14aa19e9 None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:58.866096 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2023e8-ca98-4070-8693-b7fb14aa19e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:58.866446 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2023e8-ca98-4070-8693-b7fb14aa19e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:58.867920 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2023e8-ca98-4070-8693-b7fb14aa19e9 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:58.891085 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 376/760] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:56:58.896749 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2023e8-ca98-4070-8693-b7fb14aa19e9 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:58.946303 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2887529-2f85-4266-902d-1c666badde3a None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:58.978993 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e30e8-e718-44c3-b79a-bc7b6a4324cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:58.979809 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e30e8-e718-44c3-b79a-bc7b6a4324cf None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:58.980091 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e30e8-e718-44c3-b79a-bc7b6a4324cf None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:58.980358 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e30e8-e718-44c3-b79a-bc7b6a4324cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:58.986992 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e30e8-e718-44c3-b79a-bc7b6a4324cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:58.988440 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e30e8-e718-44c3-b79a-bc7b6a4324cf None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:59.001772 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-385e30e8-e718-44c3-b79a-bc7b6a4324cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:56:59.003273 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 385/761] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:56:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:56:59.014339 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e30e8-e718-44c3-b79a-bc7b6a4324cf None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:59.063798 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2023e8-ca98-4070-8693-b7fb14aa19e9 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:59.148381 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da41882-69ee-41e0-9585-60bc56fb7624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:59.149245 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e30e8-e718-44c3-b79a-bc7b6a4324cf None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:59.149828 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da41882-69ee-41e0-9585-60bc56fb7624 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:59.150320 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da41882-69ee-41e0-9585-60bc56fb7624 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:59.150788 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da41882-69ee-41e0-9585-60bc56fb7624 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:59.168803 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da41882-69ee-41e0-9585-60bc56fb7624 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:59.170573 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da41882-69ee-41e0-9585-60bc56fb7624 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:59.183371 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a8d1e-4a5b-4222-92ec-a6812e3c7564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:59.184142 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a8d1e-4a5b-4222-92ec-a6812e3c7564 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:59.184426 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a8d1e-4a5b-4222-92ec-a6812e3c7564 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:59.191896 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a8d1e-4a5b-4222-92ec-a6812e3c7564 None admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:59.192961 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a8d1e-4a5b-4222-92ec-a6812e3c7564 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:59.193274 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a8d1e-4a5b-4222-92ec-a6812e3c7564 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:59.194164 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-3da41882-69ee-41e0-9585-60bc56fb7624 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:56:59.194762 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a8d1e-4a5b-4222-92ec-a6812e3c7564 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:59.196751 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 377/762] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:56:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:56:59.202347 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da41882-69ee-41e0-9585-60bc56fb7624 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:59.212966 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 386/763] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:56:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:56:59.218588 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a8d1e-4a5b-4222-92ec-a6812e3c7564 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:59.362164 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a8d1e-4a5b-4222-92ec-a6812e3c7564 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:59.372599 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da41882-69ee-41e0-9585-60bc56fb7624 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:59.424968 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574b7cc-9e32-4f5d-a224-a51ce977b33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:59.425624 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574b7cc-9e32-4f5d-a224-a51ce977b33b None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:59.425905 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574b7cc-9e32-4f5d-a224-a51ce977b33b None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:59.426180 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574b7cc-9e32-4f5d-a224-a51ce977b33b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:59.427008 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574b7cc-9e32-4f5d-a224-a51ce977b33b None admin] RBAC: Adding query filter params (role.id=3fb134668432434eb45c3bb21cb5882e, scope.project.id=0846fccaeb674395a87e45290eda74b7, user.id=7eb560db53cd4af192bb82abdfad3590) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:59.427317 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574b7cc-9e32-4f5d-a224-a51ce977b33b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:59.428791 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574b7cc-9e32-4f5d-a224-a51ce977b33b None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:59.436906 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ca4e8-1370-4775-9b5c-8c4b8847b6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:59.437701 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ca4e8-1370-4775-9b5c-8c4b8847b6e8 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:59.437987 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ca4e8-1370-4775-9b5c-8c4b8847b6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:59.438261 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ca4e8-1370-4775-9b5c-8c4b8847b6e8 None admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:59.439080 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ca4e8-1370-4775-9b5c-8c4b8847b6e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:56:59.439387 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ca4e8-1370-4775-9b5c-8c4b8847b6e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:59.441449 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ca4e8-1370-4775-9b5c-8c4b8847b6e8 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:59.446278 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 387/764] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:56:59 2022] GET /identity/v3/role_assignments?user.id=7eb560db53cd4af192bb82abdfad3590&scope.project.id=0846fccaeb674395a87e45290eda74b7&role.id=3fb134668432434eb45c3bb21cb5882e => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:56:59.465806 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 378/765] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:56:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:56:59.471797 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574b7cc-9e32-4f5d-a224-a51ce977b33b None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:56:59.579159 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574b7cc-9e32-4f5d-a224-a51ce977b33b None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:56:59.615401 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce67f2d-b5ca-4575-a24d-877699738b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:56:59.616255 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce67f2d-b5ca-4575-a24d-877699738b08 None admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:59.616539 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce67f2d-b5ca-4575-a24d-877699738b08 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:59.616814 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce67f2d-b5ca-4575-a24d-877699738b08 None admin] PATH_INFO: `/v3/projects/0846fccaeb674395a87e45290eda74b7/users/fbd92bd14ed04621af06d68161798fe3/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:59.618931 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce67f2d-b5ca-4575-a24d-877699738b08 None admin] RBAC: Authorizing `identity:create_grant(project_id=0846fccaeb674395a87e45290eda74b7, user_id=fbd92bd14ed04621af06d68161798fe3, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:56:59.620427 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce67f2d-b5ca-4575-a24d-877699738b08 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:56:59.648003 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 388/766] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Mar 10 03:56:59 2022] PUT /identity/v3/projects/0846fccaeb674395a87e45290eda74b7/users/fbd92bd14ed04621af06d68161798fe3/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 03:56:59.909932 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fae56-c619-4a12-821d-35439e804b40 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:59.910437 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fae56-c619-4a12-821d-35439e804b40 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:59.910437 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fae56-c619-4a12-821d-35439e804b40 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:59.912476 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 379/767] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:56:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:56:59.918834 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c87b7-5743-468e-9bb0-b55943eb63ef None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:56:59.919125 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c87b7-5743-468e-9bb0-b55943eb63ef None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:56:59.919406 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c87b7-5743-468e-9bb0-b55943eb63ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:56:59.938775 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-716c87b7-5743-468e-9bb0-b55943eb63ef None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:56:59.940660 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-716c87b7-5743-468e-9bb0-b55943eb63ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:00.010050 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 389/768] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:56:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:57:00.034091 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fae56-c619-4a12-821d-35439e804b40 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:00.168460 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fae56-c619-4a12-821d-35439e804b40 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:00.207853 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10844b-07d8-4e9e-9a4e-ff0c6b735759 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:00.208392 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10844b-07d8-4e9e-9a4e-ff0c6b735759 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:00.208467 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10844b-07d8-4e9e-9a4e-ff0c6b735759 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:00.210391 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 390/769] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 03:57:00.218545 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f0f3b-7f0b-4e6c-9060-5b6cca60a0f2 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:00.218835 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f0f3b-7f0b-4e6c-9060-5b6cca60a0f2 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:00.219174 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f0f3b-7f0b-4e6c-9060-5b6cca60a0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:00.234659 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5c949-52a2-4285-9d61-9c0678ccc144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:00.235488 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5c949-52a2-4285-9d61-9c0678ccc144 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:00.235795 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5c949-52a2-4285-9d61-9c0678ccc144 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:00.236076 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5c949-52a2-4285-9d61-9c0678ccc144 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:00.237447 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5c949-52a2-4285-9d61-9c0678ccc144 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:00.240553 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5c949-52a2-4285-9d61-9c0678ccc144 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:00.246317 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-026f0f3b-7f0b-4e6c-9060-5b6cca60a0f2 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:00.248367 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-026f0f3b-7f0b-4e6c-9060-5b6cca60a0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:00.264394 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-c0c5c949-52a2-4285-9d61-9c0678ccc144 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 10 03:57:00.265609 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 380/770] 10.222.0.15 () {56 vars in 1129 bytes} [Thu Mar 10 03:57:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:00.271972 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5c949-52a2-4285-9d61-9c0678ccc144 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:00.339035 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 391/771] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 03:57:00.400581 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f0f3b-7f0b-4e6c-9060-5b6cca60a0f2 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:00.428369 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5c949-52a2-4285-9d61-9c0678ccc144 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:00.501823 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad202a-2417-450b-a2a0-743478f45abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:00.502486 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad202a-2417-450b-a2a0-743478f45abf None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:00.502768 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad202a-2417-450b-a2a0-743478f45abf None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:00.503047 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad202a-2417-450b-a2a0-743478f45abf None admin] PATH_INFO: `/v3/services` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:00.503784 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad202a-2417-450b-a2a0-743478f45abf None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:00.504092 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad202a-2417-450b-a2a0-743478f45abf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:00.505510 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad202a-2417-450b-a2a0-743478f45abf None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:00.516296 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 381/772] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Mar 10 03:57:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:00.522461 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad202a-2417-450b-a2a0-743478f45abf None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:00.541665 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f0f3b-7f0b-4e6c-9060-5b6cca60a0f2 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:00.582595 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937c73c-193e-4d1d-ab12-9918d8890c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:00.585623 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937c73c-193e-4d1d-ab12-9918d8890c7d None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:00.586107 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937c73c-193e-4d1d-ab12-9918d8890c7d None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:00.587279 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937c73c-193e-4d1d-ab12-9918d8890c7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:00.607528 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f937c73c-193e-4d1d-ab12-9918d8890c7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:57:00.616514 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-f937c73c-193e-4d1d-ab12-9918d8890c7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 03:57:00.622729 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 392/773] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:57:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:57:00.628954 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937c73c-193e-4d1d-ab12-9918d8890c7d None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:00.691305 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad202a-2417-450b-a2a0-743478f45abf None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:00.727788 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ba2b5-8151-47ad-9b81-3d7c7e8a2c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:00.728863 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ba2b5-8151-47ad-9b81-3d7c7e8a2c87 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:00.729360 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ba2b5-8151-47ad-9b81-3d7c7e8a2c87 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:00.729825 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ba2b5-8151-47ad-9b81-3d7c7e8a2c87 None admin] PATH_INFO: `/v3/services` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:00.730726 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ba2b5-8151-47ad-9b81-3d7c7e8a2c87 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:00.731219 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ba2b5-8151-47ad-9b81-3d7c7e8a2c87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:00.733232 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ba2b5-8151-47ad-9b81-3d7c7e8a2c87 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:00.746058 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 382/774] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Mar 10 03:57:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:00.751815 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ba2b5-8151-47ad-9b81-3d7c7e8a2c87 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:00.832962 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937c73c-193e-4d1d-ab12-9918d8890c7d None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:00.899009 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2065e-b2d8-4046-a5d9-f4fd388569fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:00.899756 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2065e-b2d8-4046-a5d9-f4fd388569fa None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:00.900041 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2065e-b2d8-4046-a5d9-f4fd388569fa None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:00.900317 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2065e-b2d8-4046-a5d9-f4fd388569fa None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:00.901066 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2065e-b2d8-4046-a5d9-f4fd388569fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:00.901371 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2065e-b2d8-4046-a5d9-f4fd388569fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:00.902756 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2065e-b2d8-4046-a5d9-f4fd388569fa None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:00.912232 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 393/775] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:57:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:00.913674 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db8374-b420-4f79-9cfc-b3b1c2041418 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:00.913966 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db8374-b420-4f79-9cfc-b3b1c2041418 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:00.914242 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db8374-b420-4f79-9cfc-b3b1c2041418 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:00.920466 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 394/776] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:00.922136 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3bb93-0d6b-4bf0-a294-ceef6f8c7d6e None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:00.922422 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3bb93-0d6b-4bf0-a294-ceef6f8c7d6e None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:00.922693 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3bb93-0d6b-4bf0-a294-ceef6f8c7d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:00.934706 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ba2b5-8151-47ad-9b81-3d7c7e8a2c87 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:00.939955 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-c8b3bb93-0d6b-4bf0-a294-ceef6f8c7d6e None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:00.941170 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-c8b3bb93-0d6b-4bf0-a294-ceef6f8c7d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:00.972235 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dcfc08-d037-4fa9-8cc4-03a2efc4f01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:00.972811 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcfc08-d037-4fa9-8cc4-03a2efc4f01f None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:00.973089 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcfc08-d037-4fa9-8cc4-03a2efc4f01f None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:00.973367 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcfc08-d037-4fa9-8cc4-03a2efc4f01f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:00.974148 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dcfc08-d037-4fa9-8cc4-03a2efc4f01f None admin] RBAC: Adding query filter params (interface=public, service_id=76a97d7e8d7541019061359a695c2546, region_id=RegionOne) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:00.974454 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dcfc08-d037-4fa9-8cc4-03a2efc4f01f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:00.975952 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dcfc08-d037-4fa9-8cc4-03a2efc4f01f None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:00.983699 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 383/777] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Mar 10 03:57:00 2022] GET /identity/v3/endpoints?service_id=76a97d7e8d7541019061359a695c2546&interface=public®ion_id=RegionOne => generated 194 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:00.984630 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dcfc08-d037-4fa9-8cc4-03a2efc4f01f None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:01.025721 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 395/778] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 03:57:01.026674 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3bb93-0d6b-4bf0-a294-ceef6f8c7d6e None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:01.103075 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dcfc08-d037-4fa9-8cc4-03a2efc4f01f None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:01.151557 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cfc53-0256-4b97-8ed6-55679e9a4282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:01.152411 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cfc53-0256-4b97-8ed6-55679e9a4282 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:01.152701 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cfc53-0256-4b97-8ed6-55679e9a4282 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:01.152986 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cfc53-0256-4b97-8ed6-55679e9a4282 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:01.164785 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3bb93-0d6b-4bf0-a294-ceef6f8c7d6e None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:01.170808 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cfc53-0256-4b97-8ed6-55679e9a4282 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:01.173642 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cfc53-0256-4b97-8ed6-55679e9a4282 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:01.203071 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-dc5cfc53-0256-4b97-8ed6-55679e9a4282 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:57:01.204723 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 384/779] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:57:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:01.205590 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cfc53-0256-4b97-8ed6-55679e9a4282 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:01.217858 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc47ce-bbdd-4e2b-914d-449fc54bf8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:01.218673 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc47ce-bbdd-4e2b-914d-449fc54bf8c1 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:01.218841 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc47ce-bbdd-4e2b-914d-449fc54bf8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:01.219116 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc47ce-bbdd-4e2b-914d-449fc54bf8c1 None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:01.219840 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc47ce-bbdd-4e2b-914d-449fc54bf8c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:01.221889 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc47ce-bbdd-4e2b-914d-449fc54bf8c1 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:01.233081 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 396/780] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Mar 10 03:57:01 2022] GET /identity/v3/services => generated 772 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:01.235245 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc47ce-bbdd-4e2b-914d-449fc54bf8c1 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:01.371713 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cfc53-0256-4b97-8ed6-55679e9a4282 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:01.416420 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92314f09-0291-4d8f-aefd-559269b88600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:01.417305 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92314f09-0291-4d8f-aefd-559269b88600 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:01.417593 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92314f09-0291-4d8f-aefd-559269b88600 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:01.417870 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92314f09-0291-4d8f-aefd-559269b88600 None admin] PATH_INFO: `/v3/services/network` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:01.420825 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92314f09-0291-4d8f-aefd-559269b88600 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:01.420825 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92314f09-0291-4d8f-aefd-559269b88600 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:01.427202 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc47ce-bbdd-4e2b-914d-449fc54bf8c1 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:01.441508 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-92314f09-0291-4d8f-aefd-559269b88600 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 10 03:57:01.447861 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 385/781] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:57:01 2022] GET /identity/v3/services/network => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:01.451948 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92314f09-0291-4d8f-aefd-559269b88600 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:01.486882 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc958e-888a-4fb7-979f-0af64a1dd767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:01.487489 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc958e-888a-4fb7-979f-0af64a1dd767 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:01.487831 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc958e-888a-4fb7-979f-0af64a1dd767 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:01.488109 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc958e-888a-4fb7-979f-0af64a1dd767 None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:01.488848 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc958e-888a-4fb7-979f-0af64a1dd767 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:01.489151 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc958e-888a-4fb7-979f-0af64a1dd767 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:01.490617 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc958e-888a-4fb7-979f-0af64a1dd767 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:01.511155 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 397/782] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:01.517083 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc958e-888a-4fb7-979f-0af64a1dd767 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:01.591602 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92314f09-0291-4d8f-aefd-559269b88600 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:01.634980 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f9166-2e15-4c70-8a94-5284747fa544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:01.635653 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f9166-2e15-4c70-8a94-5284747fa544 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:01.635961 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f9166-2e15-4c70-8a94-5284747fa544 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:01.636237 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f9166-2e15-4c70-8a94-5284747fa544 None admin] PATH_INFO: `/v3/services` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:01.636951 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f9166-2e15-4c70-8a94-5284747fa544 None admin] RBAC: Adding query filter params (name=network) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:01.637256 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f9166-2e15-4c70-8a94-5284747fa544 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:01.638634 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f9166-2e15-4c70-8a94-5284747fa544 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:01.643830 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 386/783] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Mar 10 03:57:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:01.649383 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f9166-2e15-4c70-8a94-5284747fa544 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:01.666643 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc958e-888a-4fb7-979f-0af64a1dd767 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:01.721048 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f94a4c-bcae-4db7-9696-d8fcf2a3484e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:01.722278 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f94a4c-bcae-4db7-9696-d8fcf2a3484e None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:01.722779 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f94a4c-bcae-4db7-9696-d8fcf2a3484e None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:01.723280 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f94a4c-bcae-4db7-9696-d8fcf2a3484e None admin] PATH_INFO: `/v3/users/swift` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:01.733402 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f94a4c-bcae-4db7-9696-d8fcf2a3484e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:01.743790 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f94a4c-bcae-4db7-9696-d8fcf2a3484e None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:01.767713 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-20f94a4c-bcae-4db7-9696-d8fcf2a3484e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 10 03:57:01.769840 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 398/784] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:57:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:01.776322 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f94a4c-bcae-4db7-9696-d8fcf2a3484e None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:01.781713 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f9166-2e15-4c70-8a94-5284747fa544 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:01.817049 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb77fd2-45f6-42ae-a179-ef2e202ee9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:01.817977 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb77fd2-45f6-42ae-a179-ef2e202ee9d4 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:01.818261 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb77fd2-45f6-42ae-a179-ef2e202ee9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:01.818540 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb77fd2-45f6-42ae-a179-ef2e202ee9d4 None admin] PATH_INFO: `/v3/services` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:01.819246 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb77fd2-45f6-42ae-a179-ef2e202ee9d4 None admin] RBAC: Adding query filter params (type=network) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:01.819551 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb77fd2-45f6-42ae-a179-ef2e202ee9d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:01.820975 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb77fd2-45f6-42ae-a179-ef2e202ee9d4 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:01.826482 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 387/785] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Mar 10 03:57:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:01.832145 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb77fd2-45f6-42ae-a179-ef2e202ee9d4 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:01.932643 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f94a4c-bcae-4db7-9696-d8fcf2a3484e None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:01.968293 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f94b7-7324-4fc2-aabe-8d3028dbd6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:01.968970 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f94b7-7324-4fc2-aabe-8d3028dbd6e7 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:01.969249 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f94b7-7324-4fc2-aabe-8d3028dbd6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:01.969519 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f94b7-7324-4fc2-aabe-8d3028dbd6e7 None admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:01.970356 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f94b7-7324-4fc2-aabe-8d3028dbd6e7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:01.970699 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f94b7-7324-4fc2-aabe-8d3028dbd6e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:01.972158 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f94b7-7324-4fc2-aabe-8d3028dbd6e7 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:01.992333 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 399/786] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Mar 10 03:57:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:01.999732 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f94b7-7324-4fc2-aabe-8d3028dbd6e7 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:02.032417 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb77fd2-45f6-42ae-a179-ef2e202ee9d4 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:02.102467 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156b048-c1e7-4cf3-9cde-04bfc5f7d3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:02.103134 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156b048-c1e7-4cf3-9cde-04bfc5f7d3f5 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:02.103415 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156b048-c1e7-4cf3-9cde-04bfc5f7d3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:02.103709 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156b048-c1e7-4cf3-9cde-04bfc5f7d3f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:02.104512 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156b048-c1e7-4cf3-9cde-04bfc5f7d3f5 None admin] RBAC: Adding query filter params (interface=public, service_id=37adecce1b67404eb9870d9a1144e5cb, region_id=RegionOne) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:02.104823 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156b048-c1e7-4cf3-9cde-04bfc5f7d3f5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:02.106224 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156b048-c1e7-4cf3-9cde-04bfc5f7d3f5 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:02.113763 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 388/787] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Mar 10 03:57:01 2022] GET /identity/v3/endpoints?service_id=37adecce1b67404eb9870d9a1144e5cb&interface=public®ion_id=RegionOne => generated 194 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:02.124308 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156b048-c1e7-4cf3-9cde-04bfc5f7d3f5 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:02.197372 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f94b7-7324-4fc2-aabe-8d3028dbd6e7 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:02.222456 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156b048-c1e7-4cf3-9cde-04bfc5f7d3f5 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:02.256568 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312d5a0-81ea-4b57-aa45-9d1d42d6c40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:02.257302 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312d5a0-81ea-4b57-aa45-9d1d42d6c40c None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:02.257586 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312d5a0-81ea-4b57-aa45-9d1d42d6c40c None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:02.257859 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312d5a0-81ea-4b57-aa45-9d1d42d6c40c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:02.262026 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df3e3a-101b-440f-ab11-d22c9684dfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:02.263023 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df3e3a-101b-440f-ab11-d22c9684dfdd None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:02.263343 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df3e3a-101b-440f-ab11-d22c9684dfdd None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:02.263620 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df3e3a-101b-440f-ab11-d22c9684dfdd None admin] PATH_INFO: `/v3/services` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:02.264516 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df3e3a-101b-440f-ab11-d22c9684dfdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:02.265940 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df3e3a-101b-440f-ab11-d22c9684dfdd None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:02.272289 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 389/788] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Mar 10 03:57:02 2022] GET /identity/v3/services => generated 772 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:02.277162 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312d5a0-81ea-4b57-aa45-9d1d42d6c40c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:02.278660 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312d5a0-81ea-4b57-aa45-9d1d42d6c40c None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:02.312165 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-0312d5a0-81ea-4b57-aa45-9d1d42d6c40c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:57:02.313544 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 400/789] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:57:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:02.320099 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df3e3a-101b-440f-ab11-d22c9684dfdd None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:02.451065 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df3e3a-101b-440f-ab11-d22c9684dfdd None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:02.489401 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb02fc-ab3e-4518-b446-5dcc928f6324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:02.490089 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb02fc-ab3e-4518-b446-5dcc928f6324 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:02.490378 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb02fc-ab3e-4518-b446-5dcc928f6324 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:02.490660 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb02fc-ab3e-4518-b446-5dcc928f6324 None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:02.491402 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb02fc-ab3e-4518-b446-5dcc928f6324 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:02.491732 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb02fc-ab3e-4518-b446-5dcc928f6324 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:02.493158 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb02fc-ab3e-4518-b446-5dcc928f6324 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:02.506745 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 390/790] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:02.512204 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312d5a0-81ea-4b57-aa45-9d1d42d6c40c None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:02.560463 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611bee44-0841-4e97-99ac-fc41f2ce24fb None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:02.561093 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611bee44-0841-4e97-99ac-fc41f2ce24fb None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:02.561574 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611bee44-0841-4e97-99ac-fc41f2ce24fb None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:02.564898 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 391/791] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 03:57:02.569712 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84089d67-65ef-4daf-97f7-08acafad8116 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:02.570240 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84089d67-65ef-4daf-97f7-08acafad8116 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:02.570736 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84089d67-65ef-4daf-97f7-08acafad8116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:02.589118 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-84089d67-65ef-4daf-97f7-08acafad8116 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:02.590649 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-84089d67-65ef-4daf-97f7-08acafad8116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:02.622217 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312d5a0-81ea-4b57-aa45-9d1d42d6c40c None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:02.664656 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 392/792] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 03:57:02.665412 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978bcea-1b16-451b-b9b3-e7da7e117114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:02.665983 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85601c9-d595-4b0d-bb92-726d5ac62ebf None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:02.666295 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978bcea-1b16-451b-b9b3-e7da7e117114 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:02.666398 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85601c9-d595-4b0d-bb92-726d5ac62ebf None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:02.666565 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978bcea-1b16-451b-b9b3-e7da7e117114 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:02.666656 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85601c9-d595-4b0d-bb92-726d5ac62ebf None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:02.666807 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978bcea-1b16-451b-b9b3-e7da7e117114 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:02.668556 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 393/793] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:02.674411 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82604172-fc93-4bb5-a337-29f150dc46c8 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:02.674543 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978bcea-1b16-451b-b9b3-e7da7e117114 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:02.674713 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82604172-fc93-4bb5-a337-29f150dc46c8 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:02.674981 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82604172-fc93-4bb5-a337-29f150dc46c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:02.675956 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978bcea-1b16-451b-b9b3-e7da7e117114 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:02.690947 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-a978bcea-1b16-451b-b9b3-e7da7e117114 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:57:02.693436 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 401/794] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:57:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:02.703701 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-82604172-fc93-4bb5-a337-29f150dc46c8 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:02.703701 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-82604172-fc93-4bb5-a337-29f150dc46c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:02.703951 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978bcea-1b16-451b-b9b3-e7da7e117114 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:02.765664 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 394/795] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 03:57:02.766448 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82604172-fc93-4bb5-a337-29f150dc46c8 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:02.826722 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978bcea-1b16-451b-b9b3-e7da7e117114 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:02.869801 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9badd911-7ab7-489b-a0ee-0e44e69d24a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:02.870611 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badd911-7ab7-489b-a0ee-0e44e69d24a9 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:02.870895 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badd911-7ab7-489b-a0ee-0e44e69d24a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:02.871543 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badd911-7ab7-489b-a0ee-0e44e69d24a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:02.884656 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9badd911-7ab7-489b-a0ee-0e44e69d24a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:57:02.894129 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82604172-fc93-4bb5-a337-29f150dc46c8 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:02.894428 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-9badd911-7ab7-489b-a0ee-0e44e69d24a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 03:57:02.896073 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 402/796] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Mar 10 03:57:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:02.896870 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9badd911-7ab7-489b-a0ee-0e44e69d24a9 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:02.933756 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fcca8b-bbfb-492d-9150-ab98f0cc9374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:02.934490 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcca8b-bbfb-492d-9150-ab98f0cc9374 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:02.934783 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcca8b-bbfb-492d-9150-ab98f0cc9374 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:02.935060 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcca8b-bbfb-492d-9150-ab98f0cc9374 None admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:02.935872 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fcca8b-bbfb-492d-9150-ab98f0cc9374 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:02.936183 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fcca8b-bbfb-492d-9150-ab98f0cc9374 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:02.937681 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fcca8b-bbfb-492d-9150-ab98f0cc9374 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:02.955465 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 395/797] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:57:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:02.956388 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fcca8b-bbfb-492d-9150-ab98f0cc9374 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:03.015252 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9badd911-7ab7-489b-a0ee-0e44e69d24a9 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:03.056911 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ade971-fd9e-4ca4-b9d6-8e77260a8f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:03.057964 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ade971-fd9e-4ca4-b9d6-8e77260a8f93 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:03.058245 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ade971-fd9e-4ca4-b9d6-8e77260a8f93 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:03.058519 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ade971-fd9e-4ca4-b9d6-8e77260a8f93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:03.059727 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fcca8b-bbfb-492d-9150-ab98f0cc9374 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:03.071830 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ade971-fd9e-4ca4-b9d6-8e77260a8f93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:57:03.080690 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-25ade971-fd9e-4ca4-b9d6-8e77260a8f93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 03:57:03.086871 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 403/798] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:57:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:03.087561 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ade971-fd9e-4ca4-b9d6-8e77260a8f93 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:03.103806 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4dcde-fc7d-4ee8-9e6c-3cca2367089b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:03.104752 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4dcde-fc7d-4ee8-9e6c-3cca2367089b None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:03.105045 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4dcde-fc7d-4ee8-9e6c-3cca2367089b None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:03.105334 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4dcde-fc7d-4ee8-9e6c-3cca2367089b None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:03.106262 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c4dcde-fc7d-4ee8-9e6c-3cca2367089b None admin] RBAC: Adding query filter params (name=service) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:03.106866 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c4dcde-fc7d-4ee8-9e6c-3cca2367089b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:03.108289 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c4dcde-fc7d-4ee8-9e6c-3cca2367089b None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:03.120222 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 396/799] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Mar 10 03:57:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:03.121093 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4dcde-fc7d-4ee8-9e6c-3cca2367089b None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:03.203230 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ade971-fd9e-4ca4-b9d6-8e77260a8f93 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:03.237719 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4dcde-fc7d-4ee8-9e6c-3cca2367089b None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:03.245694 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c8bff-9602-4e45-a0ff-17219d6419a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:03.246729 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c8bff-9602-4e45-a0ff-17219d6419a4 None admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:03.247117 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c8bff-9602-4e45-a0ff-17219d6419a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:03.247463 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c8bff-9602-4e45-a0ff-17219d6419a4 None admin] PATH_INFO: `/v3/projects/0846fccaeb674395a87e45290eda74b7/users/260f561c676b4d049553eac4626b5502/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:03.249628 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c8bff-9602-4e45-a0ff-17219d6419a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=0846fccaeb674395a87e45290eda74b7, user_id=260f561c676b4d049553eac4626b5502, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:03.251275 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c8bff-9602-4e45-a0ff-17219d6419a4 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:03.271794 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 404/800] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Mar 10 03:57:03 2022] PUT /identity/v3/projects/0846fccaeb674395a87e45290eda74b7/users/260f561c676b4d049553eac4626b5502/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 03:57:03.273667 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c8bff-9602-4e45-a0ff-17219d6419a4 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:03.283989 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006b6b3-6799-4912-8b50-603f14386e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:03.286611 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006b6b3-6799-4912-8b50-603f14386e02 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:03.286899 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006b6b3-6799-4912-8b50-603f14386e02 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:03.288452 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006b6b3-6799-4912-8b50-603f14386e02 None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:03.289319 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006b6b3-6799-4912-8b50-603f14386e02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:03.289635 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006b6b3-6799-4912-8b50-603f14386e02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:03.293258 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006b6b3-6799-4912-8b50-603f14386e02 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:03.310857 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 397/801] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:57:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:03.317736 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006b6b3-6799-4912-8b50-603f14386e02 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:03.484034 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c8bff-9602-4e45-a0ff-17219d6419a4 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:03.515094 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006b6b3-6799-4912-8b50-603f14386e02 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:03.525716 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44526e07-f95a-4ec7-aa82-2cc21e349e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:03.526578 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44526e07-f95a-4ec7-aa82-2cc21e349e02 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:03.526869 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44526e07-f95a-4ec7-aa82-2cc21e349e02 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:03.527148 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44526e07-f95a-4ec7-aa82-2cc21e349e02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:03.541439 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44526e07-f95a-4ec7-aa82-2cc21e349e02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:03.543340 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44526e07-f95a-4ec7-aa82-2cc21e349e02 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:03.556543 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2eac2-529a-408a-a70a-00fc78c59afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:03.557674 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2eac2-529a-408a-a70a-00fc78c59afd None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:03.558104 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2eac2-529a-408a-a70a-00fc78c59afd None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:03.558525 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2eac2-529a-408a-a70a-00fc78c59afd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:03.562392 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-44526e07-f95a-4ec7-aa82-2cc21e349e02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:57:03.563917 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 405/802] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:57:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:03.575278 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44526e07-f95a-4ec7-aa82-2cc21e349e02 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:03.579606 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b2eac2-529a-408a-a70a-00fc78c59afd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:03.581344 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b2eac2-529a-408a-a70a-00fc78c59afd None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:03.600497 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-18b2eac2-529a-408a-a70a-00fc78c59afd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:57:03.602352 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 398/803] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:57:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:57:03.622653 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2eac2-529a-408a-a70a-00fc78c59afd None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:03.706750 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44526e07-f95a-4ec7-aa82-2cc21e349e02 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:03.742004 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d1bed-d348-4213-88ac-95399252f6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:03.743032 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d1bed-d348-4213-88ac-95399252f6b6 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:03.743554 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d1bed-d348-4213-88ac-95399252f6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:03.744079 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d1bed-d348-4213-88ac-95399252f6b6 None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:03.745014 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d1bed-d348-4213-88ac-95399252f6b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:03.745522 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d1bed-d348-4213-88ac-95399252f6b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:03.747099 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d1bed-d348-4213-88ac-95399252f6b6 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:03.760485 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 406/804] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:03.766179 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d1bed-d348-4213-88ac-95399252f6b6 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:03.826033 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2eac2-529a-408a-a70a-00fc78c59afd None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:03.866615 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d1bed-d348-4213-88ac-95399252f6b6 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:03.909492 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35146f0b-84f1-4a01-9747-1042c84b082f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:03.910418 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627550b-e66d-4b32-8b7e-b2699c8730b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:03.911524 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35146f0b-84f1-4a01-9747-1042c84b082f None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:03.912445 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627550b-e66d-4b32-8b7e-b2699c8730b0 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:03.912926 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627550b-e66d-4b32-8b7e-b2699c8730b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:03.913399 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35146f0b-84f1-4a01-9747-1042c84b082f None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:03.913892 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627550b-e66d-4b32-8b7e-b2699c8730b0 None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:03.914520 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35146f0b-84f1-4a01-9747-1042c84b082f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:03.915934 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627550b-e66d-4b32-8b7e-b2699c8730b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:03.916676 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627550b-e66d-4b32-8b7e-b2699c8730b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:03.919072 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627550b-e66d-4b32-8b7e-b2699c8730b0 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:03.941741 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35146f0b-84f1-4a01-9747-1042c84b082f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:03.948099 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35146f0b-84f1-4a01-9747-1042c84b082f None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:03.951171 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 399/805] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:03.960528 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627550b-e66d-4b32-8b7e-b2699c8730b0 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:03.978593 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-35146f0b-84f1-4a01-9747-1042c84b082f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 10 03:57:03.981316 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 407/806] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Mar 10 03:57:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:57:03.987672 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35146f0b-84f1-4a01-9747-1042c84b082f None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:04.109515 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35146f0b-84f1-4a01-9747-1042c84b082f None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:04.137821 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627550b-e66d-4b32-8b7e-b2699c8730b0 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:04.149317 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909afe1-3c51-42e8-b51b-e8aced47059a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:04.150009 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909afe1-3c51-42e8-b51b-e8aced47059a None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:04.151830 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909afe1-3c51-42e8-b51b-e8aced47059a None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:04.151830 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909afe1-3c51-42e8-b51b-e8aced47059a None admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:04.151830 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909afe1-3c51-42e8-b51b-e8aced47059a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:04.151830 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909afe1-3c51-42e8-b51b-e8aced47059a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:04.153038 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909afe1-3c51-42e8-b51b-e8aced47059a None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:04.176483 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 408/807] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Mar 10 03:57:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:04.176483 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b40c20-1588-4182-84f6-6b8ff9d2a9b1 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:04.176483 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b40c20-1588-4182-84f6-6b8ff9d2a9b1 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:04.176483 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b40c20-1588-4182-84f6-6b8ff9d2a9b1 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:04.180317 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 409/808] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:04.180924 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcc811-d00d-4604-9321-1fe800aa1e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:04.181093 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b40c20-1588-4182-84f6-6b8ff9d2a9b1 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:04.182025 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcc811-d00d-4604-9321-1fe800aa1e85 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:04.182459 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcc811-d00d-4604-9321-1fe800aa1e85 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:04.182896 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcc811-d00d-4604-9321-1fe800aa1e85 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:04.195228 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbcc811-d00d-4604-9321-1fe800aa1e85 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:04.197398 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbcc811-d00d-4604-9321-1fe800aa1e85 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:04.215313 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-0cbcc811-d00d-4604-9321-1fe800aa1e85 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 10 03:57:04.219833 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 400/809] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Mar 10 03:57:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:04.221434 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76d9e6-a320-46b3-8791-b2daa05964ee None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:04.224096 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76d9e6-a320-46b3-8791-b2daa05964ee None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:04.224380 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76d9e6-a320-46b3-8791-b2daa05964ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:04.245057 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-8f76d9e6-a320-46b3-8791-b2daa05964ee None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:04.246142 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-8f76d9e6-a320-46b3-8791-b2daa05964ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:04.309716 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b40c20-1588-4182-84f6-6b8ff9d2a9b1 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:04.319264 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 401/810] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:57:04.320506 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76d9e6-a320-46b3-8791-b2daa05964ee None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:04.351558 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a7d6e-69b5-4fb7-8cc7-8a45f047966a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:04.352394 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a7d6e-69b5-4fb7-8cc7-8a45f047966a None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:04.352675 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a7d6e-69b5-4fb7-8cc7-8a45f047966a None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:04.352952 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a7d6e-69b5-4fb7-8cc7-8a45f047966a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:04.365708 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a7d6e-69b5-4fb7-8cc7-8a45f047966a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:04.367078 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a7d6e-69b5-4fb7-8cc7-8a45f047966a None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:04.387149 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-189a7d6e-69b5-4fb7-8cc7-8a45f047966a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:57:04.387149 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 410/811] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:57:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:57:04.387671 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a7d6e-69b5-4fb7-8cc7-8a45f047966a None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:04.445532 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76d9e6-a320-46b3-8791-b2daa05964ee None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:04.479501 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe0ff7-0f40-4f6a-b5de-69153fa75e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:04.480205 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe0ff7-0f40-4f6a-b5de-69153fa75e5a None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:04.480526 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe0ff7-0f40-4f6a-b5de-69153fa75e5a None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:04.480809 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe0ff7-0f40-4f6a-b5de-69153fa75e5a None admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:04.481647 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe0ff7-0f40-4f6a-b5de-69153fa75e5a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:04.481955 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe0ff7-0f40-4f6a-b5de-69153fa75e5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:04.483390 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe0ff7-0f40-4f6a-b5de-69153fa75e5a None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:04.502855 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 402/812] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Mar 10 03:57:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:04.503936 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe0ff7-0f40-4f6a-b5de-69153fa75e5a None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:04.510170 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a7d6e-69b5-4fb7-8cc7-8a45f047966a None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:04.553609 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49567d3c-a1a9-4520-a46f-099230066245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:04.554463 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49567d3c-a1a9-4520-a46f-099230066245 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:04.554749 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49567d3c-a1a9-4520-a46f-099230066245 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:04.555301 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49567d3c-a1a9-4520-a46f-099230066245 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:04.556016 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49567d3c-a1a9-4520-a46f-099230066245 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:04.557665 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49567d3c-a1a9-4520-a46f-099230066245 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:04.575571 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-49567d3c-a1a9-4520-a46f-099230066245 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 10 03:57:04.582092 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 411/813] 10.222.0.15 () {56 vars in 1129 bytes} [Thu Mar 10 03:57:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:04.582092 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49567d3c-a1a9-4520-a46f-099230066245 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:04.631804 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe0ff7-0f40-4f6a-b5de-69153fa75e5a None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:04.681544 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b60dbf-87c5-4bdd-838a-c90945b2fa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:04.682484 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b60dbf-87c5-4bdd-838a-c90945b2fa31 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:04.682761 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49567d3c-a1a9-4520-a46f-099230066245 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:04.683096 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b60dbf-87c5-4bdd-838a-c90945b2fa31 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:04.683513 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b60dbf-87c5-4bdd-838a-c90945b2fa31 None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:04.684460 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b60dbf-87c5-4bdd-838a-c90945b2fa31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:04.685209 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b60dbf-87c5-4bdd-838a-c90945b2fa31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:04.687841 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b60dbf-87c5-4bdd-838a-c90945b2fa31 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:04.703210 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 403/814] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:04.704624 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b60dbf-87c5-4bdd-838a-c90945b2fa31 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:04.722881 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc311c5a-9115-4b8c-8ba4-7a7cd9d0153e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:04.723771 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc311c5a-9115-4b8c-8ba4-7a7cd9d0153e None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:04.724154 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc311c5a-9115-4b8c-8ba4-7a7cd9d0153e None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:04.724527 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc311c5a-9115-4b8c-8ba4-7a7cd9d0153e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:04.794193 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc311c5a-9115-4b8c-8ba4-7a7cd9d0153e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:04.795898 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc311c5a-9115-4b8c-8ba4-7a7cd9d0153e None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:04.807827 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b60dbf-87c5-4bdd-838a-c90945b2fa31 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:04.841750 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fa3c2-4b6f-4115-b156-4487bc712aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:04.842420 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fa3c2-4b6f-4115-b156-4487bc712aea None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:04.842705 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fa3c2-4b6f-4115-b156-4487bc712aea None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:04.842986 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fa3c2-4b6f-4115-b156-4487bc712aea None admin] PATH_INFO: `/v3/services` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:04.843714 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2fa3c2-4b6f-4115-b156-4487bc712aea None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:04.844034 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2fa3c2-4b6f-4115-b156-4487bc712aea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:04.845931 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2fa3c2-4b6f-4115-b156-4487bc712aea None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:04.850955 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 404/815] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Mar 10 03:57:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:04.851829 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fa3c2-4b6f-4115-b156-4487bc712aea None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:04.897175 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 412/816] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:57:04 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 03:57:04.898119 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc311c5a-9115-4b8c-8ba4-7a7cd9d0153e None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:04.955368 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fa3c2-4b6f-4115-b156-4487bc712aea None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:04.990592 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff14bb-b3e5-4d55-a275-7de94dbde00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:04.991395 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff14bb-b3e5-4d55-a275-7de94dbde00c None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:04.991694 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff14bb-b3e5-4d55-a275-7de94dbde00c None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:04.992060 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff14bb-b3e5-4d55-a275-7de94dbde00c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:04.997700 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc311c5a-9115-4b8c-8ba4-7a7cd9d0153e None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:05.000727 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff14bb-b3e5-4d55-a275-7de94dbde00c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:05.002233 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff14bb-b3e5-4d55-a275-7de94dbde00c None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:05.015897 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-b0ff14bb-b3e5-4d55-a275-7de94dbde00c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:57:05.017825 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 405/817] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:57:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:05.018389 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff14bb-b3e5-4d55-a275-7de94dbde00c None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:05.036119 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37182a94-9729-4b35-a42c-710bf9abc028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:05.036790 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37182a94-9729-4b35-a42c-710bf9abc028 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:05.037073 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37182a94-9729-4b35-a42c-710bf9abc028 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:05.037354 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37182a94-9729-4b35-a42c-710bf9abc028 None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:05.038064 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37182a94-9729-4b35-a42c-710bf9abc028 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:05.038367 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37182a94-9729-4b35-a42c-710bf9abc028 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:05.039751 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37182a94-9729-4b35-a42c-710bf9abc028 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:05.050428 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 413/818] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Mar 10 03:57:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:05.050428 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7e703-845e-439d-b4f1-494493e6c429 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:05.050428 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7e703-845e-439d-b4f1-494493e6c429 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:05.050428 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7e703-845e-439d-b4f1-494493e6c429 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:05.050428 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 414/819] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:05.050428 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7e703-845e-439d-b4f1-494493e6c429 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:05.129550 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff14bb-b3e5-4d55-a275-7de94dbde00c None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:05.157050 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7e703-845e-439d-b4f1-494493e6c429 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:05.164230 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c9dea-efe5-4e12-b09b-7818dcfa1346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:05.165027 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c9dea-efe5-4e12-b09b-7818dcfa1346 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:05.165308 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c9dea-efe5-4e12-b09b-7818dcfa1346 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:05.165595 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c9dea-efe5-4e12-b09b-7818dcfa1346 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:05.175792 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c9dea-efe5-4e12-b09b-7818dcfa1346 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:05.177247 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c9dea-efe5-4e12-b09b-7818dcfa1346 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:05.191160 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8a4c2-7c93-4001-aa17-b2d4f4bd241a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:05.191847 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8a4c2-7c93-4001-aa17-b2d4f4bd241a None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:05.192130 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8a4c2-7c93-4001-aa17-b2d4f4bd241a None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:05.192657 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8a4c2-7c93-4001-aa17-b2d4f4bd241a None admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:05.193430 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8a4c2-7c93-4001-aa17-b2d4f4bd241a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:05.193834 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8a4c2-7c93-4001-aa17-b2d4f4bd241a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:05.195244 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8a4c2-7c93-4001-aa17-b2d4f4bd241a None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:05.195545 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-4d5c9dea-efe5-4e12-b09b-7818dcfa1346 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:57:05.201931 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 406/820] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:57:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:05.201931 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c9dea-efe5-4e12-b09b-7818dcfa1346 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:05.216747 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 415/821] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:57:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:05.216747 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fedd0-4bc7-4da6-a38b-58127e014b43 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:05.216747 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fedd0-4bc7-4da6-a38b-58127e014b43 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:05.216747 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fedd0-4bc7-4da6-a38b-58127e014b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:05.230386 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-027fedd0-4bc7-4da6-a38b-58127e014b43 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:05.231566 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-027fedd0-4bc7-4da6-a38b-58127e014b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:05.297791 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 416/822] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:57:05.298668 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fedd0-4bc7-4da6-a38b-58127e014b43 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:05.311555 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c9dea-efe5-4e12-b09b-7818dcfa1346 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:05.347253 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6add5-09ac-4c55-98bd-a958c0ce0a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:05.347937 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6add5-09ac-4c55-98bd-a958c0ce0a89 None admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:05.348219 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6add5-09ac-4c55-98bd-a958c0ce0a89 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:05.348495 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6add5-09ac-4c55-98bd-a958c0ce0a89 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:05.349233 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6add5-09ac-4c55-98bd-a958c0ce0a89 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:05.350606 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6add5-09ac-4c55-98bd-a958c0ce0a89 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:05.373238 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 407/823] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Mar 10 03:57:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 03:57:05.374146 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6add5-09ac-4c55-98bd-a958c0ce0a89 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:05.430031 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fedd0-4bc7-4da6-a38b-58127e014b43 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:05.488693 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de61fa-8e4e-4ca4-84de-18ae6256d59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:05.490042 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de61fa-8e4e-4ca4-84de-18ae6256d59e None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:05.490535 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de61fa-8e4e-4ca4-84de-18ae6256d59e None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:05.490993 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de61fa-8e4e-4ca4-84de-18ae6256d59e None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:05.492021 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de61fa-8e4e-4ca4-84de-18ae6256d59e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:05.492339 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6add5-09ac-4c55-98bd-a958c0ce0a89 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:05.492737 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de61fa-8e4e-4ca4-84de-18ae6256d59e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:05.494547 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de61fa-8e4e-4ca4-84de-18ae6256d59e None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:05.518119 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 417/824] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:05.519024 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de61fa-8e4e-4ca4-84de-18ae6256d59e None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:05.541412 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ac9f3-f263-460a-8404-c52e12de37c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:05.543115 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ac9f3-f263-460a-8404-c52e12de37c1 None admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:05.543614 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ac9f3-f263-460a-8404-c52e12de37c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:05.544139 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ac9f3-f263-460a-8404-c52e12de37c1 None admin] PATH_INFO: `/v3/projects/0846fccaeb674395a87e45290eda74b7/users/7eb560db53cd4af192bb82abdfad3590/roles/3fb134668432434eb45c3bb21cb5882e` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:05.566055 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ac9f3-f263-460a-8404-c52e12de37c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0846fccaeb674395a87e45290eda74b7, user_id=7eb560db53cd4af192bb82abdfad3590, role_id=3fb134668432434eb45c3bb21cb5882e)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:05.568713 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ac9f3-f263-460a-8404-c52e12de37c1 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:05.590963 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 408/825] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Mar 10 03:57:05 2022] PUT /identity/v3/projects/0846fccaeb674395a87e45290eda74b7/users/7eb560db53cd4af192bb82abdfad3590/roles/3fb134668432434eb45c3bb21cb5882e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 03:57:05.592156 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ac9f3-f263-460a-8404-c52e12de37c1 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:05.661659 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de61fa-8e4e-4ca4-84de-18ae6256d59e None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:05.715381 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb77ab-3605-4d4b-8217-c24beecc8520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:05.716150 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb77ab-3605-4d4b-8217-c24beecc8520 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:05.716432 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb77ab-3605-4d4b-8217-c24beecc8520 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:05.716707 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb77ab-3605-4d4b-8217-c24beecc8520 None admin] PATH_INFO: `/v3/services/network` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:05.717370 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb77ab-3605-4d4b-8217-c24beecc8520 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:05.718438 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ac9f3-f263-460a-8404-c52e12de37c1 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:05.718771 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb77ab-3605-4d4b-8217-c24beecc8520 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:05.733698 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-addb77ab-3605-4d4b-8217-c24beecc8520 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 10 03:57:05.735267 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 418/826] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:57:05 2022] GET /identity/v3/services/network => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:05.741425 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb77ab-3605-4d4b-8217-c24beecc8520 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:05.763543 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9590f-12be-43ca-8e5f-3fb2488f51e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:05.764757 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9590f-12be-43ca-8e5f-3fb2488f51e0 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:05.765180 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9590f-12be-43ca-8e5f-3fb2488f51e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:05.765697 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9590f-12be-43ca-8e5f-3fb2488f51e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:05.773798 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9590f-12be-43ca-8e5f-3fb2488f51e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:05.775676 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9590f-12be-43ca-8e5f-3fb2488f51e0 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:05.790221 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-63e9590f-12be-43ca-8e5f-3fb2488f51e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:57:05.792344 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 409/827] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:57:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:05.800774 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9590f-12be-43ca-8e5f-3fb2488f51e0 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:05.888509 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb77ab-3605-4d4b-8217-c24beecc8520 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:05.924796 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9590f-12be-43ca-8e5f-3fb2488f51e0 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:05.940731 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fb9d3-cbc0-4936-864c-8f0cc8d7274f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:05.941633 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fb9d3-cbc0-4936-864c-8f0cc8d7274f None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:05.941926 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fb9d3-cbc0-4936-864c-8f0cc8d7274f None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:05.942459 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fb9d3-cbc0-4936-864c-8f0cc8d7274f None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:05.943730 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5fb9d3-cbc0-4936-864c-8f0cc8d7274f None admin] RBAC: Adding query filter params (name=network) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:05.944232 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5fb9d3-cbc0-4936-864c-8f0cc8d7274f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:05.946068 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5fb9d3-cbc0-4936-864c-8f0cc8d7274f None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:05.951918 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 419/828] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Mar 10 03:57:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:05.953899 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53925981-6223-4de6-8227-3db38b7a2fcc None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:05.954308 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53925981-6223-4de6-8227-3db38b7a2fcc None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:05.954592 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53925981-6223-4de6-8227-3db38b7a2fcc None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:05.957368 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 420/829] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:05.958124 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53925981-6223-4de6-8227-3db38b7a2fcc None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:05.968737 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687b404-6c72-4818-b223-aa4e6c022e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:05.969823 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687b404-6c72-4818-b223-aa4e6c022e92 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:05.970110 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687b404-6c72-4818-b223-aa4e6c022e92 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:05.970438 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687b404-6c72-4818-b223-aa4e6c022e92 None admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:05.971615 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687b404-6c72-4818-b223-aa4e6c022e92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:05.971964 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687b404-6c72-4818-b223-aa4e6c022e92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:05.974042 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687b404-6c72-4818-b223-aa4e6c022e92 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:05.994563 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 410/830] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:57:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:05.995974 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6e49d-8465-47bd-94d5-6bc05178fd04 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:05.996268 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6e49d-8465-47bd-94d5-6bc05178fd04 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:05.996547 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6e49d-8465-47bd-94d5-6bc05178fd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:06.019355 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-aba6e49d-8465-47bd-94d5-6bc05178fd04 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:06.021080 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-aba6e49d-8465-47bd-94d5-6bc05178fd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:06.066512 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53925981-6223-4de6-8227-3db38b7a2fcc None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:06.101815 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658f20a-25cf-437c-aa19-5166a307a99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:06.102512 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658f20a-25cf-437c-aa19-5166a307a99b None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:06.102848 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658f20a-25cf-437c-aa19-5166a307a99b None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:06.103129 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658f20a-25cf-437c-aa19-5166a307a99b None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:06.103866 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658f20a-25cf-437c-aa19-5166a307a99b None admin] RBAC: Adding query filter params (type=network) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:06.104170 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658f20a-25cf-437c-aa19-5166a307a99b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:06.105601 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658f20a-25cf-437c-aa19-5166a307a99b None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:06.111668 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 421/831] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Mar 10 03:57:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:06.112535 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658f20a-25cf-437c-aa19-5166a307a99b None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:06.121390 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 411/832] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:57:06.122784 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6e49d-8465-47bd-94d5-6bc05178fd04 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:06.210668 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658f20a-25cf-437c-aa19-5166a307a99b None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:06.249974 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6e49d-8465-47bd-94d5-6bc05178fd04 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:06.255727 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fd53f-b407-407d-b17b-4e2162d06014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:06.255727 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fd53f-b407-407d-b17b-4e2162d06014 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:06.255727 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fd53f-b407-407d-b17b-4e2162d06014 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:06.255727 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fd53f-b407-407d-b17b-4e2162d06014 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:06.256402 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19fd53f-b407-407d-b17b-4e2162d06014 None admin] RBAC: Adding query filter params (role.id=a8b2a5887cec4a31b7304792af3dd3f1, scope.project.id=0846fccaeb674395a87e45290eda74b7, user.id=fbd92bd14ed04621af06d68161798fe3) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:06.256402 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19fd53f-b407-407d-b17b-4e2162d06014 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:06.256402 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19fd53f-b407-407d-b17b-4e2162d06014 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:06.263753 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 422/833] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:57:06 2022] GET /identity/v3/role_assignments?user.id=fbd92bd14ed04621af06d68161798fe3&scope.project.id=0846fccaeb674395a87e45290eda74b7&role.id=a8b2a5887cec4a31b7304792af3dd3f1 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:06.265222 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fd53f-b407-407d-b17b-4e2162d06014 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:06.285929 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19006dab-f4bb-40b7-9089-02f3c73c032d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:06.286806 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19006dab-f4bb-40b7-9089-02f3c73c032d None admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:06.287182 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19006dab-f4bb-40b7-9089-02f3c73c032d None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:06.287586 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19006dab-f4bb-40b7-9089-02f3c73c032d None admin] PATH_INFO: `/v3/endpoints` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:06.288527 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19006dab-f4bb-40b7-9089-02f3c73c032d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:06.290158 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19006dab-f4bb-40b7-9089-02f3c73c032d None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:06.325925 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 412/834] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Mar 10 03:57:06 2022] POST /identity/v3/endpoints => generated 327 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 03:57:06.385640 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fd53f-b407-407d-b17b-4e2162d06014 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:06.432490 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95662718-1492-4f86-ae76-755935ff9058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:06.433338 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95662718-1492-4f86-ae76-755935ff9058 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:06.433595 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95662718-1492-4f86-ae76-755935ff9058 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:06.433871 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95662718-1492-4f86-ae76-755935ff9058 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:06.446411 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95662718-1492-4f86-ae76-755935ff9058 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:57:06.453672 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-95662718-1492-4f86-ae76-755935ff9058 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 03:57:06.455903 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 423/835] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:57:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:06.461522 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19006dab-f4bb-40b7-9089-02f3c73c032d None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:06.593480 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19006dab-f4bb-40b7-9089-02f3c73c032d None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:06.634324 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962fcfe-491f-4d5b-9283-ad2b2f8d8799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:06.635001 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962fcfe-491f-4d5b-9283-ad2b2f8d8799 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:06.635283 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962fcfe-491f-4d5b-9283-ad2b2f8d8799 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:06.635562 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962fcfe-491f-4d5b-9283-ad2b2f8d8799 None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:06.636370 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962fcfe-491f-4d5b-9283-ad2b2f8d8799 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:06.636673 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962fcfe-491f-4d5b-9283-ad2b2f8d8799 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:06.638067 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962fcfe-491f-4d5b-9283-ad2b2f8d8799 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:06.648041 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 413/836] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:57:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:06.653272 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95662718-1492-4f86-ae76-755935ff9058 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:06.764353 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95662718-1492-4f86-ae76-755935ff9058 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:06.803707 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a78216-570d-4a38-b115-799431a4b994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:06.804520 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a78216-570d-4a38-b115-799431a4b994 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:06.804815 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a78216-570d-4a38-b115-799431a4b994 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:06.805095 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a78216-570d-4a38-b115-799431a4b994 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:06.820377 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a78216-570d-4a38-b115-799431a4b994 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:06.821908 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a78216-570d-4a38-b115-799431a4b994 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:06.839540 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-f3a78216-570d-4a38-b115-799431a4b994 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:57:06.843635 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 424/837] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:57:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:06.849246 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962fcfe-491f-4d5b-9283-ad2b2f8d8799 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:06.948834 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962fcfe-491f-4d5b-9283-ad2b2f8d8799 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:06.984678 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0921b-1acf-4d17-8fb8-c1e2994a8a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:06.985352 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0921b-1acf-4d17-8fb8-c1e2994a8a43 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:06.985636 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0921b-1acf-4d17-8fb8-c1e2994a8a43 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:06.985939 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0921b-1acf-4d17-8fb8-c1e2994a8a43 None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:06.986667 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0921b-1acf-4d17-8fb8-c1e2994a8a43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:06.987067 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0921b-1acf-4d17-8fb8-c1e2994a8a43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:06.988469 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0921b-1acf-4d17-8fb8-c1e2994a8a43 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:07.001007 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 414/838] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:07.006656 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a78216-570d-4a38-b115-799431a4b994 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:07.115229 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a78216-570d-4a38-b115-799431a4b994 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:07.149902 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6be13-bfcf-4411-a516-eed80f4b544c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:07.150704 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6be13-bfcf-4411-a516-eed80f4b544c None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:07.150986 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6be13-bfcf-4411-a516-eed80f4b544c None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:07.151261 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6be13-bfcf-4411-a516-eed80f4b544c None admin] PATH_INFO: `/v3/users/swift` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:07.159145 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6be13-bfcf-4411-a516-eed80f4b544c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:07.160664 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6be13-bfcf-4411-a516-eed80f4b544c None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:07.175178 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-e4d6be13-bfcf-4411-a516-eed80f4b544c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 10 03:57:07.176723 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 425/839] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:57:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:07.182291 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0921b-1acf-4d17-8fb8-c1e2994a8a43 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:07.282453 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0921b-1acf-4d17-8fb8-c1e2994a8a43 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:07.317546 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608f1c1-445b-4625-b5f5-919370475e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:07.318225 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608f1c1-445b-4625-b5f5-919370475e8d None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:07.318507 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608f1c1-445b-4625-b5f5-919370475e8d None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:07.318787 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5608f1c1-445b-4625-b5f5-919370475e8d None admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:07.319626 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608f1c1-445b-4625-b5f5-919370475e8d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:07.319966 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608f1c1-445b-4625-b5f5-919370475e8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:07.321422 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5608f1c1-445b-4625-b5f5-919370475e8d None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:07.340934 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 415/840] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Mar 10 03:57:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:07.346420 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6be13-bfcf-4411-a516-eed80f4b544c None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:07.450433 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6be13-bfcf-4411-a516-eed80f4b544c None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:07.483858 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1852c0-5dd9-45bc-80b2-f23d4003ff9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:07.484526 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1852c0-5dd9-45bc-80b2-f23d4003ff9f None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:07.484810 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1852c0-5dd9-45bc-80b2-f23d4003ff9f None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:07.485090 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1852c0-5dd9-45bc-80b2-f23d4003ff9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:07.555178 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1852c0-5dd9-45bc-80b2-f23d4003ff9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:07.556766 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1852c0-5dd9-45bc-80b2-f23d4003ff9f None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:07.660288 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 426/841] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:57:07 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 03:57:07.665791 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608f1c1-445b-4625-b5f5-919370475e8d None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:07.773686 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5608f1c1-445b-4625-b5f5-919370475e8d None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:07.808574 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0910a-9215-4031-8508-c3eef250b584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:07.809387 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0910a-9215-4031-8508-c3eef250b584 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:07.809671 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0910a-9215-4031-8508-c3eef250b584 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:07.809949 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0910a-9215-4031-8508-c3eef250b584 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:07.820834 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0910a-9215-4031-8508-c3eef250b584 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:07.822293 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0910a-9215-4031-8508-c3eef250b584 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:07.839193 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-e8b0910a-9215-4031-8508-c3eef250b584 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:57:07.840801 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 416/842] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:57:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:07.846787 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1852c0-5dd9-45bc-80b2-f23d4003ff9f None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:07.956535 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1852c0-5dd9-45bc-80b2-f23d4003ff9f None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:07.990905 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ea316-4b5b-493d-acba-5a7a7504e9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:07.991573 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ea316-4b5b-493d-acba-5a7a7504e9b0 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:07.991886 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ea316-4b5b-493d-acba-5a7a7504e9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:07.992164 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ea316-4b5b-493d-acba-5a7a7504e9b0 None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:07.992895 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ea316-4b5b-493d-acba-5a7a7504e9b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:07.993197 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ea316-4b5b-493d-acba-5a7a7504e9b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:07.994580 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ea316-4b5b-493d-acba-5a7a7504e9b0 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:08.006604 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 427/843] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:08.012084 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0910a-9215-4031-8508-c3eef250b584 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:08.042860 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d85d7e-f310-4042-b927-de9fcb229343 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:08.043181 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d85d7e-f310-4042-b927-de9fcb229343 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:08.043430 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d85d7e-f310-4042-b927-de9fcb229343 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:08.045483 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 428/844] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 03:57:08.053323 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e84c2-4d64-4994-ad92-9c39ed7f4add None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:08.053611 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e84c2-4d64-4994-ad92-9c39ed7f4add None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:08.053891 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e84c2-4d64-4994-ad92-9c39ed7f4add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:08.077016 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-259e84c2-4d64-4994-ad92-9c39ed7f4add None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:08.078548 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-259e84c2-4d64-4994-ad92-9c39ed7f4add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:08.138204 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0910a-9215-4031-8508-c3eef250b584 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:08.170700 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 429/845] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 03:57:08.174184 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7cb05-ab8c-49ce-b827-f15e5d225e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:08.175043 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7cb05-ab8c-49ce-b827-f15e5d225e1c None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:08.175325 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7cb05-ab8c-49ce-b827-f15e5d225e1c None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:08.175632 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7cb05-ab8c-49ce-b827-f15e5d225e1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:08.182882 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7cb05-ab8c-49ce-b827-f15e5d225e1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:08.184428 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7cb05-ab8c-49ce-b827-f15e5d225e1c None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:08.188369 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e84c2-4d64-4994-ad92-9c39ed7f4add None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:08.198857 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-60c7cb05-ab8c-49ce-b827-f15e5d225e1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:57:08.200586 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 417/846] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:57:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:08.206473 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7cb05-ab8c-49ce-b827-f15e5d225e1c None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:08.289282 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e84c2-4d64-4994-ad92-9c39ed7f4add None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:08.309002 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7cb05-ab8c-49ce-b827-f15e5d225e1c None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:08.323190 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606d8b7-9ae2-4198-91ce-ce1adf6d85d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:08.324021 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606d8b7-9ae2-4198-91ce-ce1adf6d85d0 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:08.324302 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606d8b7-9ae2-4198-91ce-ce1adf6d85d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:08.324576 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606d8b7-9ae2-4198-91ce-ce1adf6d85d0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:08.325223 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606d8b7-9ae2-4198-91ce-ce1adf6d85d0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:08.326598 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606d8b7-9ae2-4198-91ce-ce1adf6d85d0 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:08.337662 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-a606d8b7-9ae2-4198-91ce-ce1adf6d85d0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 10 03:57:08.338877 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 430/847] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Mar 10 03:57:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:08.340146 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1f4c1-ca0e-4eef-9a84-c2e1e4744bb1 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:08.340410 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1f4c1-ca0e-4eef-9a84-c2e1e4744bb1 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:08.340683 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f1f4c1-ca0e-4eef-9a84-c2e1e4744bb1 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:08.342517 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 431/848] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:08.347129 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1f4c1-ca0e-4eef-9a84-c2e1e4744bb1 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:08.353657 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ba433-3555-4938-8e86-e9ab0b6c37e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:08.354333 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ba433-3555-4938-8e86-e9ab0b6c37e0 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:08.354618 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ba433-3555-4938-8e86-e9ab0b6c37e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:08.354894 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ba433-3555-4938-8e86-e9ab0b6c37e0 None admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:08.355694 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ba433-3555-4938-8e86-e9ab0b6c37e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:08.356452 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ba433-3555-4938-8e86-e9ab0b6c37e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:08.357464 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ba433-3555-4938-8e86-e9ab0b6c37e0 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:08.370411 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 418/849] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:57:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:08.371660 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ea39c-6d29-45d2-9ab7-0c4779377c76 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:08.371980 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ea39c-6d29-45d2-9ab7-0c4779377c76 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:08.372265 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ea39c-6d29-45d2-9ab7-0c4779377c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:08.389045 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-870ea39c-6d29-45d2-9ab7-0c4779377c76 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:08.390252 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-870ea39c-6d29-45d2-9ab7-0c4779377c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:08.456442 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f1f4c1-ca0e-4eef-9a84-c2e1e4744bb1 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:08.467894 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 419/850] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:57:08.467894 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ea39c-6d29-45d2-9ab7-0c4779377c76 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:08.506623 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2cd81-72bd-4d98-9cef-a62b697bb493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:08.507286 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2cd81-72bd-4d98-9cef-a62b697bb493 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:08.507567 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2cd81-72bd-4d98-9cef-a62b697bb493 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:08.508238 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2cd81-72bd-4d98-9cef-a62b697bb493 None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:08.508574 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2cd81-72bd-4d98-9cef-a62b697bb493 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:08.508878 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2cd81-72bd-4d98-9cef-a62b697bb493 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:08.510240 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2cd81-72bd-4d98-9cef-a62b697bb493 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:08.519987 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 432/851] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Mar 10 03:57:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:08.519987 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2cd81-72bd-4d98-9cef-a62b697bb493 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:08.559948 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ea39c-6d29-45d2-9ab7-0c4779377c76 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:08.595672 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c30e20-cf77-4cdd-b12c-4e13386978e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:08.596355 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c30e20-cf77-4cdd-b12c-4e13386978e0 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:08.596637 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c30e20-cf77-4cdd-b12c-4e13386978e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:08.596913 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c30e20-cf77-4cdd-b12c-4e13386978e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:08.597749 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c30e20-cf77-4cdd-b12c-4e13386978e0 None admin] RBAC: Adding query filter params (role.id=a8b2a5887cec4a31b7304792af3dd3f1, scope.project.id=0846fccaeb674395a87e45290eda74b7, user.id=260f561c676b4d049553eac4626b5502) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:08.598057 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c30e20-cf77-4cdd-b12c-4e13386978e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:08.599548 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c30e20-cf77-4cdd-b12c-4e13386978e0 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:08.615713 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 420/852] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:57:08 2022] GET /identity/v3/role_assignments?user.id=260f561c676b4d049553eac4626b5502&scope.project.id=0846fccaeb674395a87e45290eda74b7&role.id=a8b2a5887cec4a31b7304792af3dd3f1 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:08.615713 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c30e20-cf77-4cdd-b12c-4e13386978e0 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:08.634787 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2cd81-72bd-4d98-9cef-a62b697bb493 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:08.680928 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f742f-1a20-4396-9613-f9cb768481d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:08.681856 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f742f-1a20-4396-9613-f9cb768481d4 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:08.682234 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f742f-1a20-4396-9613-f9cb768481d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:08.682585 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f742f-1a20-4396-9613-f9cb768481d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:08.698288 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f742f-1a20-4396-9613-f9cb768481d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:57:08.708872 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-995f742f-1a20-4396-9613-f9cb768481d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 03:57:08.710834 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 433/853] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Mar 10 03:57:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:08.712545 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c30e20-cf77-4cdd-b12c-4e13386978e0 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:08.716874 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f742f-1a20-4396-9613-f9cb768481d4 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:08.749221 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282280df-a738-46c4-99e3-416e7135987e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:08.749957 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282280df-a738-46c4-99e3-416e7135987e None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:08.750240 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282280df-a738-46c4-99e3-416e7135987e None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:08.750516 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282280df-a738-46c4-99e3-416e7135987e None admin] PATH_INFO: `/v3/services` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:08.751238 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282280df-a738-46c4-99e3-416e7135987e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:08.753177 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282280df-a738-46c4-99e3-416e7135987e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:08.753613 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282280df-a738-46c4-99e3-416e7135987e None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:08.758928 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 421/854] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Mar 10 03:57:08 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:08.844062 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f742f-1a20-4396-9613-f9cb768481d4 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:08.881575 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bec1fd-5430-4eb9-9361-9ff23f7d1421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:08.882256 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bec1fd-5430-4eb9-9361-9ff23f7d1421 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:08.882541 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bec1fd-5430-4eb9-9361-9ff23f7d1421 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:08.882817 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bec1fd-5430-4eb9-9361-9ff23f7d1421 None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:08.883588 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bec1fd-5430-4eb9-9361-9ff23f7d1421 None admin] RBAC: Adding query filter params (name=service) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:08.883915 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bec1fd-5430-4eb9-9361-9ff23f7d1421 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:08.885315 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bec1fd-5430-4eb9-9361-9ff23f7d1421 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:08.894695 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 434/855] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Mar 10 03:57:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:08.900591 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282280df-a738-46c4-99e3-416e7135987e None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:08.920487 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a38919-94e8-4854-9376-8449da318abf None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:08.920777 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a38919-94e8-4854-9376-8449da318abf None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:08.921032 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a38919-94e8-4854-9376-8449da318abf None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:08.922952 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 435/856] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 03:57:08.929311 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723a39e-3e3f-448e-8782-3c6793c5bddc None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:08.929826 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723a39e-3e3f-448e-8782-3c6793c5bddc None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:08.930285 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723a39e-3e3f-448e-8782-3c6793c5bddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:08.951519 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-0723a39e-3e3f-448e-8782-3c6793c5bddc None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:08.953000 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-0723a39e-3e3f-448e-8782-3c6793c5bddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:09.029975 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282280df-a738-46c4-99e3-416e7135987e None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:09.038502 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 436/857] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 03:57:09.060554 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723a39e-3e3f-448e-8782-3c6793c5bddc None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:09.073558 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6a2b1-b489-4324-a1fd-4d3559b83a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:09.074681 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6a2b1-b489-4324-a1fd-4d3559b83a21 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:09.075147 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6a2b1-b489-4324-a1fd-4d3559b83a21 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:09.075594 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6a2b1-b489-4324-a1fd-4d3559b83a21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:09.086994 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f6a2b1-b489-4324-a1fd-4d3559b83a21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:09.088777 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f6a2b1-b489-4324-a1fd-4d3559b83a21 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:09.107408 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-16f6a2b1-b489-4324-a1fd-4d3559b83a21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:57:09.109264 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 422/858] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:57:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:09.116462 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6a2b1-b489-4324-a1fd-4d3559b83a21 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:09.166621 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723a39e-3e3f-448e-8782-3c6793c5bddc None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:09.203332 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5828219-9989-4fde-adaa-ed0d357d5cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:09.204565 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5828219-9989-4fde-adaa-ed0d357d5cd3 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:09.205063 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5828219-9989-4fde-adaa-ed0d357d5cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:09.205539 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5828219-9989-4fde-adaa-ed0d357d5cd3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:09.206372 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5828219-9989-4fde-adaa-ed0d357d5cd3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:09.207962 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5828219-9989-4fde-adaa-ed0d357d5cd3 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:09.217705 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6a2b1-b489-4324-a1fd-4d3559b83a21 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:09.220099 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-e5828219-9989-4fde-adaa-ed0d357d5cd3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 10 03:57:09.226976 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 437/859] 10.222.0.15 () {56 vars in 1132 bytes} [Thu Mar 10 03:57:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:57:09.228291 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5828219-9989-4fde-adaa-ed0d357d5cd3 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:09.253466 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ec668-cb0f-42e7-a080-cdf9fa5b962e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:09.254191 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ec668-cb0f-42e7-a080-cdf9fa5b962e None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:09.254482 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ec668-cb0f-42e7-a080-cdf9fa5b962e None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:09.254805 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ec668-cb0f-42e7-a080-cdf9fa5b962e None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:09.255537 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ec668-cb0f-42e7-a080-cdf9fa5b962e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:09.255887 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ec668-cb0f-42e7-a080-cdf9fa5b962e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:09.257327 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ec668-cb0f-42e7-a080-cdf9fa5b962e None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:09.273402 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 423/860] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:09.275981 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ec668-cb0f-42e7-a080-cdf9fa5b962e None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:09.354907 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5828219-9989-4fde-adaa-ed0d357d5cd3 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:09.379562 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ec668-cb0f-42e7-a080-cdf9fa5b962e None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:09.398359 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178d489-a455-45a2-8770-a90c528b511d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:09.399879 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178d489-a455-45a2-8770-a90c528b511d None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:09.400396 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178d489-a455-45a2-8770-a90c528b511d None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:09.401095 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178d489-a455-45a2-8770-a90c528b511d None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:09.402135 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178d489-a455-45a2-8770-a90c528b511d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:09.402610 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178d489-a455-45a2-8770-a90c528b511d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:09.404696 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178d489-a455-45a2-8770-a90c528b511d None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:09.415922 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 438/861] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Mar 10 03:57:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:09.416944 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178d489-a455-45a2-8770-a90c528b511d None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:09.421792 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8e43b-594f-4c25-ad95-e1334a6ef33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:09.422843 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8e43b-594f-4c25-ad95-e1334a6ef33a None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:09.423938 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8e43b-594f-4c25-ad95-e1334a6ef33a None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:09.424430 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8e43b-594f-4c25-ad95-e1334a6ef33a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:09.434583 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a8e43b-594f-4c25-ad95-e1334a6ef33a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:09.436768 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a8e43b-594f-4c25-ad95-e1334a6ef33a None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:09.455779 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-10a8e43b-594f-4c25-ad95-e1334a6ef33a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 10 03:57:09.462463 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 424/862] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Mar 10 03:57:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:09.464542 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8e43b-594f-4c25-ad95-e1334a6ef33a None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:09.536595 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178d489-a455-45a2-8770-a90c528b511d None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:09.569877 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8e43b-594f-4c25-ad95-e1334a6ef33a None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:09.578398 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709139d-c9a3-4541-b7d3-89f7dec25e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:09.580294 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709139d-c9a3-4541-b7d3-89f7dec25e2a None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:09.581150 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709139d-c9a3-4541-b7d3-89f7dec25e2a None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:09.581779 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709139d-c9a3-4541-b7d3-89f7dec25e2a None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:09.582765 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709139d-c9a3-4541-b7d3-89f7dec25e2a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:09.583243 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709139d-c9a3-4541-b7d3-89f7dec25e2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:09.585364 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709139d-c9a3-4541-b7d3-89f7dec25e2a None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:09.603715 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 439/863] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Mar 10 03:57:09 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:09.617414 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf090f-9f11-49b3-bc62-3c8673c02227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:09.618115 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf090f-9f11-49b3-bc62-3c8673c02227 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:09.618401 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf090f-9f11-49b3-bc62-3c8673c02227 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:09.618678 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf090f-9f11-49b3-bc62-3c8673c02227 None admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:09.619623 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf090f-9f11-49b3-bc62-3c8673c02227 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:09.619976 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf090f-9f11-49b3-bc62-3c8673c02227 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:09.621520 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf090f-9f11-49b3-bc62-3c8673c02227 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:09.643050 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 425/864] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Mar 10 03:57:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:09.648859 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709139d-c9a3-4541-b7d3-89f7dec25e2a None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:09.763080 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709139d-c9a3-4541-b7d3-89f7dec25e2a None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:09.803675 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2413808-b034-49b2-8cb7-1cf344e16d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:09.805168 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2413808-b034-49b2-8cb7-1cf344e16d7e None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:09.805168 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2413808-b034-49b2-8cb7-1cf344e16d7e None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:09.805168 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2413808-b034-49b2-8cb7-1cf344e16d7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:09.876136 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2413808-b034-49b2-8cb7-1cf344e16d7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:09.878140 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2413808-b034-49b2-8cb7-1cf344e16d7e None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:09.982414 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 440/865] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:57:09 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 03:57:09.987932 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf090f-9f11-49b3-bc62-3c8673c02227 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:10.087632 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf090f-9f11-49b3-bc62-3c8673c02227 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:10.121396 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e69e7-ba83-4318-93e3-8c47e790cc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:10.122195 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e69e7-ba83-4318-93e3-8c47e790cc5e None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:10.122476 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e69e7-ba83-4318-93e3-8c47e790cc5e None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:10.122748 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e69e7-ba83-4318-93e3-8c47e790cc5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:10.133541 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e69e7-ba83-4318-93e3-8c47e790cc5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:10.134979 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e69e7-ba83-4318-93e3-8c47e790cc5e None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:10.152394 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-400e69e7-ba83-4318-93e3-8c47e790cc5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:57:10.153870 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 426/866] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:57:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:10.159312 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2413808-b034-49b2-8cb7-1cf344e16d7e None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:10.259779 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2413808-b034-49b2-8cb7-1cf344e16d7e None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:10.294628 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5f61b-2117-4ad6-97e8-a529a0a9018d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:10.295646 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5f61b-2117-4ad6-97e8-a529a0a9018d None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:10.296157 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5f61b-2117-4ad6-97e8-a529a0a9018d None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:10.296628 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5f61b-2117-4ad6-97e8-a529a0a9018d None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:10.297637 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5f61b-2117-4ad6-97e8-a529a0a9018d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:10.298137 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5f61b-2117-4ad6-97e8-a529a0a9018d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:10.299798 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5f61b-2117-4ad6-97e8-a529a0a9018d None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:10.312231 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 441/867] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:10.319724 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e69e7-ba83-4318-93e3-8c47e790cc5e None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:10.421570 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e69e7-ba83-4318-93e3-8c47e790cc5e None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:10.457947 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a15c2-c46c-4240-b255-fd87c728c5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:10.458762 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a15c2-c46c-4240-b255-fd87c728c5c7 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:10.459044 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a15c2-c46c-4240-b255-fd87c728c5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:10.459318 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a15c2-c46c-4240-b255-fd87c728c5c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:10.467035 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a15c2-c46c-4240-b255-fd87c728c5c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:10.468524 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a15c2-c46c-4240-b255-fd87c728c5c7 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:10.482708 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-2d1a15c2-c46c-4240-b255-fd87c728c5c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:57:10.484242 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 427/868] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:57:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:10.489912 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5f61b-2117-4ad6-97e8-a529a0a9018d None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:10.589653 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5f61b-2117-4ad6-97e8-a529a0a9018d None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:10.622038 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92063c97-7271-4fc5-9b19-7830c4f53520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:10.622702 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92063c97-7271-4fc5-9b19-7830c4f53520 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:10.622978 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92063c97-7271-4fc5-9b19-7830c4f53520 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:10.623249 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92063c97-7271-4fc5-9b19-7830c4f53520 None admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:10.624064 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92063c97-7271-4fc5-9b19-7830c4f53520 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:10.624366 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92063c97-7271-4fc5-9b19-7830c4f53520 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:10.625784 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92063c97-7271-4fc5-9b19-7830c4f53520 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:10.639083 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 442/869] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:57:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:10.645757 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a15c2-c46c-4240-b255-fd87c728c5c7 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:10.752363 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a15c2-c46c-4240-b255-fd87c728c5c7 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:10.787079 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b80bf8-9d19-499b-bbd5-30e00fde1a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:10.787759 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b80bf8-9d19-499b-bbd5-30e00fde1a29 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:10.788047 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b80bf8-9d19-499b-bbd5-30e00fde1a29 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:10.788322 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b80bf8-9d19-499b-bbd5-30e00fde1a29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:10.789157 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b80bf8-9d19-499b-bbd5-30e00fde1a29 None admin] RBAC: Adding query filter params (role.id=3fb134668432434eb45c3bb21cb5882e, scope.project.id=0846fccaeb674395a87e45290eda74b7, user.id=7eb560db53cd4af192bb82abdfad3590) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:10.789463 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b80bf8-9d19-499b-bbd5-30e00fde1a29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:10.790948 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b80bf8-9d19-499b-bbd5-30e00fde1a29 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:10.797653 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 428/870] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:57:10 2022] GET /identity/v3/role_assignments?user.id=7eb560db53cd4af192bb82abdfad3590&scope.project.id=0846fccaeb674395a87e45290eda74b7&role.id=3fb134668432434eb45c3bb21cb5882e => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:11.035376 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73272d90-0cf0-4f2d-8e01-4bb9c7a34286 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:11.035745 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73272d90-0cf0-4f2d-8e01-4bb9c7a34286 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:11.035933 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73272d90-0cf0-4f2d-8e01-4bb9c7a34286 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:11.037920 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 443/871] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:11.043089 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafc1af-148a-45bc-82b0-89a9a1bd0211 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:11.043383 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafc1af-148a-45bc-82b0-89a9a1bd0211 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:11.043669 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafc1af-148a-45bc-82b0-89a9a1bd0211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:11.062902 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-cfafc1af-148a-45bc-82b0-89a9a1bd0211 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:11.064695 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-cfafc1af-148a-45bc-82b0-89a9a1bd0211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:11.136896 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 429/872] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:57:11.158771 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73272d90-0cf0-4f2d-8e01-4bb9c7a34286 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:11.268089 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73272d90-0cf0-4f2d-8e01-4bb9c7a34286 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:11.286468 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea0daf-9c9a-44fb-8b84-4fa0946f3ee4 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:11.287058 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea0daf-9c9a-44fb-8b84-4fa0946f3ee4 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:11.287537 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea0daf-9c9a-44fb-8b84-4fa0946f3ee4 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:11.289868 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 430/873] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 03:57:11.295302 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394a9ed-7fdb-42fc-bbd1-72927b6aacb5 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:11.295929 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394a9ed-7fdb-42fc-bbd1-72927b6aacb5 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:11.296414 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394a9ed-7fdb-42fc-bbd1-72927b6aacb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:11.303652 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780ca16-556e-4655-b93e-c4cc4a21bc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:11.304862 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780ca16-556e-4655-b93e-c4cc4a21bc6c None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:11.305151 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780ca16-556e-4655-b93e-c4cc4a21bc6c None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:11.305428 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780ca16-556e-4655-b93e-c4cc4a21bc6c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:11.306083 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780ca16-556e-4655-b93e-c4cc4a21bc6c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:11.307464 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780ca16-556e-4655-b93e-c4cc4a21bc6c None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:11.317806 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-0394a9ed-7fdb-42fc-bbd1-72927b6aacb5 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:11.319295 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-0394a9ed-7fdb-42fc-bbd1-72927b6aacb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:11.319973 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-b780ca16-556e-4655-b93e-c4cc4a21bc6c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 10 03:57:11.321512 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 444/874] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Mar 10 03:57:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:11.328677 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780ca16-556e-4655-b93e-c4cc4a21bc6c None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:11.403325 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 431/875] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:57:11.426307 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0394a9ed-7fdb-42fc-bbd1-72927b6aacb5 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:11.431052 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780ca16-556e-4655-b93e-c4cc4a21bc6c None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:11.463530 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c56b2-806a-40c3-9efc-c4d48b2a06b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:11.464289 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c56b2-806a-40c3-9efc-c4d48b2a06b5 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:11.464568 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c56b2-806a-40c3-9efc-c4d48b2a06b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:11.464838 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c56b2-806a-40c3-9efc-c4d48b2a06b5 None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:11.465539 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c56b2-806a-40c3-9efc-c4d48b2a06b5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:11.465835 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c56b2-806a-40c3-9efc-c4d48b2a06b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:11.467191 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c56b2-806a-40c3-9efc-c4d48b2a06b5 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:11.472557 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 445/876] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Mar 10 03:57:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:11.478316 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c56b2-806a-40c3-9efc-c4d48b2a06b5 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:11.543260 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0394a9ed-7fdb-42fc-bbd1-72927b6aacb5 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:11.579756 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a1c4d-1624-4226-9f01-55aea9d3b6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:11.580427 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a1c4d-1624-4226-9f01-55aea9d3b6c8 None admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:11.580705 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a1c4d-1624-4226-9f01-55aea9d3b6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:11.580976 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a1c4d-1624-4226-9f01-55aea9d3b6c8 None admin] PATH_INFO: `/v3/services` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:11.581697 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a1c4d-1624-4226-9f01-55aea9d3b6c8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:11.583078 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33a1c4d-1624-4226-9f01-55aea9d3b6c8 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:11.601872 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 432/877] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Mar 10 03:57:11 2022] POST /identity/v3/services => generated 251 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 03:57:11.615674 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c56b2-806a-40c3-9efc-c4d48b2a06b5 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:11.665901 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1a93e-ce10-496b-a503-685a17a9aaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:11.666953 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1a93e-ce10-496b-a503-685a17a9aaa2 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:11.667417 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1a93e-ce10-496b-a503-685a17a9aaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:11.667944 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1a93e-ce10-496b-a503-685a17a9aaa2 None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:11.668933 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1a93e-ce10-496b-a503-685a17a9aaa2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:11.669523 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1a93e-ce10-496b-a503-685a17a9aaa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:11.671176 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1a93e-ce10-496b-a503-685a17a9aaa2 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:11.677838 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 446/878] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Mar 10 03:57:11 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:12.095098 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf19cdb-06b9-4abd-a236-bb667605c49e None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:12.095385 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf19cdb-06b9-4abd-a236-bb667605c49e None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:12.095799 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf19cdb-06b9-4abd-a236-bb667605c49e None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:12.097696 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 433/879] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:12.103234 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33e49f-3f54-4afa-9ab9-95eb4220e11c None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:12.103522 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33e49f-3f54-4afa-9ab9-95eb4220e11c None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:12.103824 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33e49f-3f54-4afa-9ab9-95eb4220e11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:12.124335 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-9b33e49f-3f54-4afa-9ab9-95eb4220e11c None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:12.125565 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-9b33e49f-3f54-4afa-9ab9-95eb4220e11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:12.196719 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 447/880] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:12 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 03:57:12.221324 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf19cdb-06b9-4abd-a236-bb667605c49e None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:12.380521 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf19cdb-06b9-4abd-a236-bb667605c49e None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:12.437745 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67a30e-d315-41df-8e0e-0980f70832aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:12.440615 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67a30e-d315-41df-8e0e-0980f70832aa None admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:12.441365 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67a30e-d315-41df-8e0e-0980f70832aa None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:12.442382 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67a30e-d315-41df-8e0e-0980f70832aa None admin] PATH_INFO: `/v3/services` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:12.443993 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67a30e-d315-41df-8e0e-0980f70832aa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:12.446685 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67a30e-d315-41df-8e0e-0980f70832aa None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:12.470981 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 434/881] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Mar 10 03:57:12 2022] POST /identity/v3/services => generated 269 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 03:57:13.581429 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73e003-641a-47bb-b399-41e05099bca1 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:13.582469 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73e003-641a-47bb-b399-41e05099bca1 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:13.582956 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73e003-641a-47bb-b399-41e05099bca1 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:13.585278 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 448/882] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:13.590875 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f3f18-405f-4dd3-8783-912ebe99f341 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:13.591776 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f3f18-405f-4dd3-8783-912ebe99f341 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:13.592277 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f3f18-405f-4dd3-8783-912ebe99f341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:13.609524 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-ea4f3f18-405f-4dd3-8783-912ebe99f341 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:13.611073 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-ea4f3f18-405f-4dd3-8783-912ebe99f341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:13.695754 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 435/883] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:57:13.714854 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73e003-641a-47bb-b399-41e05099bca1 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:13.818171 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73e003-641a-47bb-b399-41e05099bca1 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:13.852818 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408d9c3-1ee7-4510-9e94-8262afc1d6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:13.853617 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408d9c3-1ee7-4510-9e94-8262afc1d6f1 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:13.853893 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408d9c3-1ee7-4510-9e94-8262afc1d6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:13.854163 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408d9c3-1ee7-4510-9e94-8262afc1d6f1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:13.864410 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408d9c3-1ee7-4510-9e94-8262afc1d6f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:57:13.871857 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-e408d9c3-1ee7-4510-9e94-8262afc1d6f1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 10 03:57:13.873374 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 449/884] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Mar 10 03:57:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:13.879770 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f3f18-405f-4dd3-8783-912ebe99f341 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:13.988281 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f3f18-405f-4dd3-8783-912ebe99f341 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:14.022406 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032fb66-b2cf-4bf2-8142-6c1cff819493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:14.023074 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032fb66-b2cf-4bf2-8142-6c1cff819493 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:14.023354 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032fb66-b2cf-4bf2-8142-6c1cff819493 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:14.023623 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032fb66-b2cf-4bf2-8142-6c1cff819493 None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:14.024406 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032fb66-b2cf-4bf2-8142-6c1cff819493 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:14.024705 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032fb66-b2cf-4bf2-8142-6c1cff819493 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:14.026067 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032fb66-b2cf-4bf2-8142-6c1cff819493 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:14.031634 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5897e-5cc9-4a73-899b-52872e828446 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:14.032256 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5897e-5cc9-4a73-899b-52872e828446 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:14.032796 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5897e-5cc9-4a73-899b-52872e828446 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:14.035073 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 436/886] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Mar 10 03:57:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:14.035281 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 450/886] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:14.040669 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572f1c2-f2fc-4612-aa7d-ed62b201406e None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:14.040835 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5897e-5cc9-4a73-899b-52872e828446 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:14.041448 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572f1c2-f2fc-4612-aa7d-ed62b201406e None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:14.041944 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572f1c2-f2fc-4612-aa7d-ed62b201406e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:14.059356 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-b572f1c2-f2fc-4612-aa7d-ed62b201406e None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:14.060766 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-b572f1c2-f2fc-4612-aa7d-ed62b201406e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:14.155004 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 437/887] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:57:14.157583 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5897e-5cc9-4a73-899b-52872e828446 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:14.177956 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572f1c2-f2fc-4612-aa7d-ed62b201406e None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:14.199742 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54a0e4-44e5-4902-9da9-f426282b59af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:14.201119 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54a0e4-44e5-4902-9da9-f426282b59af None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:14.201739 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54a0e4-44e5-4902-9da9-f426282b59af None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:14.202515 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54a0e4-44e5-4902-9da9-f426282b59af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:14.220373 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54a0e4-44e5-4902-9da9-f426282b59af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:14.222714 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54a0e4-44e5-4902-9da9-f426282b59af None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:14.245092 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-9e54a0e4-44e5-4902-9da9-f426282b59af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:57:14.252596 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 451/888] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:57:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:14.254287 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54a0e4-44e5-4902-9da9-f426282b59af None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:14.281822 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572f1c2-f2fc-4612-aa7d-ed62b201406e None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:14.318351 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38b6ea-c585-4c53-8b64-3b730399f289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:14.319151 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38b6ea-c585-4c53-8b64-3b730399f289 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:14.319430 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38b6ea-c585-4c53-8b64-3b730399f289 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:14.319717 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38b6ea-c585-4c53-8b64-3b730399f289 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:14.320372 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38b6ea-c585-4c53-8b64-3b730399f289 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:14.321757 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38b6ea-c585-4c53-8b64-3b730399f289 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:14.332685 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-ce38b6ea-c585-4c53-8b64-3b730399f289 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 10 03:57:14.333886 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 438/889] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Mar 10 03:57:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:57:14.335089 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df2ad0-0103-4f34-9be0-74d9ce000547 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:14.335370 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df2ad0-0103-4f34-9be0-74d9ce000547 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:14.335640 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df2ad0-0103-4f34-9be0-74d9ce000547 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:14.337494 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 439/890] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:14.339716 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df2ad0-0103-4f34-9be0-74d9ce000547 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:14.365759 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54a0e4-44e5-4902-9da9-f426282b59af None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:14.401356 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc416751-4034-4554-b476-76d54dec80c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:14.402207 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc416751-4034-4554-b476-76d54dec80c7 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:14.402564 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc416751-4034-4554-b476-76d54dec80c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:14.402837 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc416751-4034-4554-b476-76d54dec80c7 None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:14.403554 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc416751-4034-4554-b476-76d54dec80c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:14.404085 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc416751-4034-4554-b476-76d54dec80c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:14.405231 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc416751-4034-4554-b476-76d54dec80c7 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:14.422250 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 452/891] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:14.422250 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482283d-b6d6-418a-aea6-5e0f5934dc4f None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:14.422250 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482283d-b6d6-418a-aea6-5e0f5934dc4f None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:14.422250 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482283d-b6d6-418a-aea6-5e0f5934dc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:14.438517 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-6482283d-b6d6-418a-aea6-5e0f5934dc4f None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:14.440371 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-6482283d-b6d6-418a-aea6-5e0f5934dc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:14.451379 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df2ad0-0103-4f34-9be0-74d9ce000547 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:14.485571 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97d24a-6a4f-48cc-b56a-fb7832fa0f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:14.486266 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97d24a-6a4f-48cc-b56a-fb7832fa0f8b None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:14.486544 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97d24a-6a4f-48cc-b56a-fb7832fa0f8b None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:14.486823 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97d24a-6a4f-48cc-b56a-fb7832fa0f8b None admin] PATH_INFO: `/v3/services` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:14.487571 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97d24a-6a4f-48cc-b56a-fb7832fa0f8b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:14.487893 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97d24a-6a4f-48cc-b56a-fb7832fa0f8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:14.489316 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97d24a-6a4f-48cc-b56a-fb7832fa0f8b None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:14.495180 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 440/892] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Mar 10 03:57:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:14.496462 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97d24a-6a4f-48cc-b56a-fb7832fa0f8b None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:14.511801 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 453/893] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:57:14.512805 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482283d-b6d6-418a-aea6-5e0f5934dc4f None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:14.605892 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97d24a-6a4f-48cc-b56a-fb7832fa0f8b None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:14.625021 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482283d-b6d6-418a-aea6-5e0f5934dc4f None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:14.639147 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df5979-a0e6-4f53-bf18-de3babc70821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:14.639994 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df5979-a0e6-4f53-bf18-de3babc70821 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:14.640278 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df5979-a0e6-4f53-bf18-de3babc70821 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:14.640555 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df5979-a0e6-4f53-bf18-de3babc70821 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:14.648563 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df5979-a0e6-4f53-bf18-de3babc70821 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:14.650009 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df5979-a0e6-4f53-bf18-de3babc70821 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:14.658558 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28eafc7-e96d-452a-8925-8dc0c65dd30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:14.659161 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28eafc7-e96d-452a-8925-8dc0c65dd30f None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:14.659474 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28eafc7-e96d-452a-8925-8dc0c65dd30f None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:14.660135 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28eafc7-e96d-452a-8925-8dc0c65dd30f None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:14.660513 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28eafc7-e96d-452a-8925-8dc0c65dd30f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:14.660819 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28eafc7-e96d-452a-8925-8dc0c65dd30f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:14.662173 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28eafc7-e96d-452a-8925-8dc0c65dd30f None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:14.663509 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-66df5979-a0e6-4f53-bf18-de3babc70821 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 10 03:57:14.669562 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 441/894] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Mar 10 03:57:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:14.669562 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df5979-a0e6-4f53-bf18-de3babc70821 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:14.669779 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 454/895] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Mar 10 03:57:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:14.670317 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28eafc7-e96d-452a-8925-8dc0c65dd30f None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:14.768840 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df5979-a0e6-4f53-bf18-de3babc70821 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:14.769188 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28eafc7-e96d-452a-8925-8dc0c65dd30f None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:14.802030 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35b8e4-4aed-4e7f-90ee-69b3ad6a2298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:14.802586 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c91f3-8844-487f-a1a7-f5726173cda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:14.802719 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35b8e4-4aed-4e7f-90ee-69b3ad6a2298 None admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:14.802964 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35b8e4-4aed-4e7f-90ee-69b3ad6a2298 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:14.803244 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35b8e4-4aed-4e7f-90ee-69b3ad6a2298 None admin] PATH_INFO: `/v3/services` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:14.803337 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c91f3-8844-487f-a1a7-f5726173cda5 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:14.803521 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c91f3-8844-487f-a1a7-f5726173cda5 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:14.803833 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c91f3-8844-487f-a1a7-f5726173cda5 None admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:14.803997 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35b8e4-4aed-4e7f-90ee-69b3ad6a2298 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:14.804657 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c91f3-8844-487f-a1a7-f5726173cda5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:14.804960 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c91f3-8844-487f-a1a7-f5726173cda5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:14.805367 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35b8e4-4aed-4e7f-90ee-69b3ad6a2298 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:14.806364 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c91f3-8844-487f-a1a7-f5726173cda5 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:14.827710 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 442/896] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Mar 10 03:57:14 2022] POST /identity/v3/services => generated 241 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 03:57:14.827710 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35b8e4-4aed-4e7f-90ee-69b3ad6a2298 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:14.834441 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 455/897] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Mar 10 03:57:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:14.840439 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c91f3-8844-487f-a1a7-f5726173cda5 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:14.950169 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35b8e4-4aed-4e7f-90ee-69b3ad6a2298 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:14.953866 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c91f3-8844-487f-a1a7-f5726173cda5 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:14.986412 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70f980-0297-4cff-8833-9931c687cf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:14.987310 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70f980-0297-4cff-8833-9931c687cf14 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:14.987717 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70f980-0297-4cff-8833-9931c687cf14 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:14.988212 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70f980-0297-4cff-8833-9931c687cf14 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:14.988686 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28adc2-c2bf-4e07-a501-88a41fb442fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:14.989247 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70f980-0297-4cff-8833-9931c687cf14 None admin] RBAC: Adding query filter params (interface=public, service_id=bbb1fa19ffd84967a6ba4b333245e777, region_id=RegionOne) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:14.989350 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28adc2-c2bf-4e07-a501-88a41fb442fb None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:14.989602 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28adc2-c2bf-4e07-a501-88a41fb442fb None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:14.989810 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70f980-0297-4cff-8833-9931c687cf14 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:14.989898 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28adc2-c2bf-4e07-a501-88a41fb442fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:14.991454 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70f980-0297-4cff-8833-9931c687cf14 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:15.000098 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 443/898] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Mar 10 03:57:14 2022] GET /identity/v3/endpoints?service_id=bbb1fa19ffd84967a6ba4b333245e777&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:15.002592 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72e3d4-5b8a-4adc-ad5b-c03e874448a7 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:15.002891 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72e3d4-5b8a-4adc-ad5b-c03e874448a7 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:15.003173 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72e3d4-5b8a-4adc-ad5b-c03e874448a7 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:15.005146 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 444/899] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:15.008594 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72e3d4-5b8a-4adc-ad5b-c03e874448a7 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:15.061608 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e28adc2-c2bf-4e07-a501-88a41fb442fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:15.063109 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e28adc2-c2bf-4e07-a501-88a41fb442fb None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:15.123322 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72e3d4-5b8a-4adc-ad5b-c03e874448a7 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:15.157726 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5874c6d-410c-40a1-b796-a5101c13f6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:15.158393 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5874c6d-410c-40a1-b796-a5101c13f6c7 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:15.158676 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5874c6d-410c-40a1-b796-a5101c13f6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:15.158952 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5874c6d-410c-40a1-b796-a5101c13f6c7 None admin] PATH_INFO: `/v3/services` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:15.159631 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5874c6d-410c-40a1-b796-a5101c13f6c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:15.164598 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 456/900] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:57:14 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 03:57:15.164740 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5874c6d-410c-40a1-b796-a5101c13f6c7 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:15.164847 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac17bdc-98d4-4912-a146-113de91e3798 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:15.164847 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac17bdc-98d4-4912-a146-113de91e3798 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:15.164847 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac17bdc-98d4-4912-a146-113de91e3798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:15.170660 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 445/901] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Mar 10 03:57:15 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 03:57:15.179766 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5874c6d-410c-40a1-b796-a5101c13f6c7 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:15.189454 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-6ac17bdc-98d4-4912-a146-113de91e3798 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:15.191053 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-6ac17bdc-98d4-4912-a146-113de91e3798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:15.284503 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 457/902] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:57:15.285594 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5874c6d-410c-40a1-b796-a5101c13f6c7 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:15.307596 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac17bdc-98d4-4912-a146-113de91e3798 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:15.333229 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c86ae5-dea2-430a-a71d-2884e7d20bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:15.334331 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c86ae5-dea2-430a-a71d-2884e7d20bd4 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:15.334615 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c86ae5-dea2-430a-a71d-2884e7d20bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:15.334892 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c86ae5-dea2-430a-a71d-2884e7d20bd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:15.350247 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c86ae5-dea2-430a-a71d-2884e7d20bd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:15.351758 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c86ae5-dea2-430a-a71d-2884e7d20bd4 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:15.375477 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-27c86ae5-dea2-430a-a71d-2884e7d20bd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:57:15.378003 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 446/903] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:57:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:15.382909 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c86ae5-dea2-430a-a71d-2884e7d20bd4 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:15.419510 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac17bdc-98d4-4912-a146-113de91e3798 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:15.456381 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b043c-3f0b-4c33-8ccb-f4d24aabc0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:15.457195 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b043c-3f0b-4c33-8ccb-f4d24aabc0bc None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:15.457492 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b043c-3f0b-4c33-8ccb-f4d24aabc0bc None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:15.457753 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b043c-3f0b-4c33-8ccb-f4d24aabc0bc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:15.458405 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b043c-3f0b-4c33-8ccb-f4d24aabc0bc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:15.459799 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b043c-3f0b-4c33-8ccb-f4d24aabc0bc None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:15.471356 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-989b043c-3f0b-4c33-8ccb-f4d24aabc0bc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 10 03:57:15.473113 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 458/904] 10.222.0.15 () {56 vars in 1132 bytes} [Thu Mar 10 03:57:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:57:15.478890 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b043c-3f0b-4c33-8ccb-f4d24aabc0bc None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:15.504983 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c86ae5-dea2-430a-a71d-2884e7d20bd4 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:15.547514 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878ed16-832b-4457-ad94-5591def3e568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:15.549808 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878ed16-832b-4457-ad94-5591def3e568 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:15.550198 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878ed16-832b-4457-ad94-5591def3e568 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:15.550572 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878ed16-832b-4457-ad94-5591def3e568 None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:15.551459 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878ed16-832b-4457-ad94-5591def3e568 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:15.551873 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878ed16-832b-4457-ad94-5591def3e568 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:15.553404 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878ed16-832b-4457-ad94-5591def3e568 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:15.571734 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 447/905] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:15.575296 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878ed16-832b-4457-ad94-5591def3e568 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:15.586239 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b043c-3f0b-4c33-8ccb-f4d24aabc0bc None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:15.620875 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09337dc-515c-4df5-baf3-208063eb0dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:15.621444 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09337dc-515c-4df5-baf3-208063eb0dba None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:15.621797 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09337dc-515c-4df5-baf3-208063eb0dba None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:15.622147 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09337dc-515c-4df5-baf3-208063eb0dba None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:15.622926 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09337dc-515c-4df5-baf3-208063eb0dba None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:15.623457 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09337dc-515c-4df5-baf3-208063eb0dba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:15.624804 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09337dc-515c-4df5-baf3-208063eb0dba None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:15.635190 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 459/906] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Mar 10 03:57:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:15.636253 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09337dc-515c-4df5-baf3-208063eb0dba None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:15.685801 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878ed16-832b-4457-ad94-5591def3e568 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:15.724192 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ca751-d969-47c5-bd86-1c55b7918d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:15.725425 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ca751-d969-47c5-bd86-1c55b7918d91 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:15.725927 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ca751-d969-47c5-bd86-1c55b7918d91 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:15.726399 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ca751-d969-47c5-bd86-1c55b7918d91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:15.733920 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ca751-d969-47c5-bd86-1c55b7918d91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:15.736234 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ca751-d969-47c5-bd86-1c55b7918d91 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:15.736973 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09337dc-515c-4df5-baf3-208063eb0dba None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:15.750200 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-d73ca751-d969-47c5-bd86-1c55b7918d91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:57:15.752328 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 448/907] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:57:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:57:15.758556 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ca751-d969-47c5-bd86-1c55b7918d91 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:15.776354 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89c4a7-482c-474a-b8e1-27cb43743632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:15.777021 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89c4a7-482c-474a-b8e1-27cb43743632 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:15.777305 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89c4a7-482c-474a-b8e1-27cb43743632 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:15.777582 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89c4a7-482c-474a-b8e1-27cb43743632 None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:15.778287 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c89c4a7-482c-474a-b8e1-27cb43743632 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:15.778593 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c89c4a7-482c-474a-b8e1-27cb43743632 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:15.779975 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c89c4a7-482c-474a-b8e1-27cb43743632 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:15.789664 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 460/908] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Mar 10 03:57:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:15.790540 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89c4a7-482c-474a-b8e1-27cb43743632 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:15.880473 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ca751-d969-47c5-bd86-1c55b7918d91 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:15.895479 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89c4a7-482c-474a-b8e1-27cb43743632 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:15.919630 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af824e31-fd69-4e35-8413-1f1d9e395be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:15.920322 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af824e31-fd69-4e35-8413-1f1d9e395be8 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:15.920606 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af824e31-fd69-4e35-8413-1f1d9e395be8 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:15.920881 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af824e31-fd69-4e35-8413-1f1d9e395be8 None admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:15.921668 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af824e31-fd69-4e35-8413-1f1d9e395be8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:15.921980 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af824e31-fd69-4e35-8413-1f1d9e395be8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:15.924043 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af824e31-fd69-4e35-8413-1f1d9e395be8 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:15.929983 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd55e4c-f1e0-4c97-8c50-38bd3c824a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:15.930653 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd55e4c-f1e0-4c97-8c50-38bd3c824a3b None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:15.930933 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd55e4c-f1e0-4c97-8c50-38bd3c824a3b None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:15.931204 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd55e4c-f1e0-4c97-8c50-38bd3c824a3b None admin] PATH_INFO: `/v3/endpoints` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:15.932038 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd55e4c-f1e0-4c97-8c50-38bd3c824a3b None admin] RBAC: Adding query filter params (interface=public, service_id=cd5bb629899949e69565a54679988540, region_id=RegionOne) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:15.932405 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd55e4c-f1e0-4c97-8c50-38bd3c824a3b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:15.933768 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd55e4c-f1e0-4c97-8c50-38bd3c824a3b None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:15.941498 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 449/909] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:57:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:15.942418 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 461/910] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Mar 10 03:57:15 2022] GET /identity/v3/endpoints?service_id=cd5bb629899949e69565a54679988540&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:15.942703 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af824e31-fd69-4e35-8413-1f1d9e395be8 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:15.948707 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd55e4c-f1e0-4c97-8c50-38bd3c824a3b None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:16.066536 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af824e31-fd69-4e35-8413-1f1d9e395be8 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:16.071462 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd55e4c-f1e0-4c97-8c50-38bd3c824a3b None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:16.109108 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75d248-d3b5-446b-bf09-8c33590aabe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:16.109800 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75d248-d3b5-446b-bf09-8c33590aabe4 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:16.110086 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75d248-d3b5-446b-bf09-8c33590aabe4 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:16.110364 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75d248-d3b5-446b-bf09-8c33590aabe4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:16.112073 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a75d248-d3b5-446b-bf09-8c33590aabe4 None admin] RBAC: Adding query filter params (role.id=0bfe9ff936144b8987acb9d8a5188913, scope.project.id=0846fccaeb674395a87e45290eda74b7, user.id=7eb560db53cd4af192bb82abdfad3590) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:16.112389 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a75d248-d3b5-446b-bf09-8c33590aabe4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:16.113956 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a75d248-d3b5-446b-bf09-8c33590aabe4 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:16.115295 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0646d57-d236-440b-a5d2-c38a955a61ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:16.116455 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0646d57-d236-440b-a5d2-c38a955a61ad None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:16.120134 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0646d57-d236-440b-a5d2-c38a955a61ad None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:16.120134 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0646d57-d236-440b-a5d2-c38a955a61ad None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:16.120134 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0646d57-d236-440b-a5d2-c38a955a61ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:16.120444 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 450/911] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:57:15 2022] GET /identity/v3/role_assignments?user.id=7eb560db53cd4af192bb82abdfad3590&scope.project.id=0846fccaeb674395a87e45290eda74b7&role.id=0bfe9ff936144b8987acb9d8a5188913 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:16.124151 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0646d57-d236-440b-a5d2-c38a955a61ad None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:16.131520 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 462/912] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Mar 10 03:57:15 2022] GET /identity/v3/services => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 03:57:17.219286 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56393e7-28be-4050-8c6a-de3288e15e87 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:17.219842 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56393e7-28be-4050-8c6a-de3288e15e87 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:17.219950 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56393e7-28be-4050-8c6a-de3288e15e87 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:17.221893 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 451/913] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:17.227512 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f262043-f618-4835-a722-703fbd60dfba None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:17.228019 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f262043-f618-4835-a722-703fbd60dfba None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:17.228122 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f262043-f618-4835-a722-703fbd60dfba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:17.246978 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-0f262043-f618-4835-a722-703fbd60dfba None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:17.248247 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-0f262043-f618-4835-a722-703fbd60dfba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:17.321269 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 463/914] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 03:57:17.344434 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56393e7-28be-4050-8c6a-de3288e15e87 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:17.447193 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56393e7-28be-4050-8c6a-de3288e15e87 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:17.480967 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c77866-04a0-4cc6-8011-03988cf46db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:17.481771 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c77866-04a0-4cc6-8011-03988cf46db5 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:17.482050 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c77866-04a0-4cc6-8011-03988cf46db5 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:17.482321 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c77866-04a0-4cc6-8011-03988cf46db5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:17.483023 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c77866-04a0-4cc6-8011-03988cf46db5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:17.484413 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c77866-04a0-4cc6-8011-03988cf46db5 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:17.496136 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-89c77866-04a0-4cc6-8011-03988cf46db5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 10 03:57:17.497593 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 452/915] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Mar 10 03:57:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:17.503490 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f262043-f618-4835-a722-703fbd60dfba None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:17.600053 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f262043-f618-4835-a722-703fbd60dfba None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:17.612971 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115258a-7092-44a2-a441-4acc58d546c5 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:17.613253 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115258a-7092-44a2-a441-4acc58d546c5 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:17.613516 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115258a-7092-44a2-a441-4acc58d546c5 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:17.615538 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 453/916] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:17.621151 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68d9ba-e8bd-49c0-8907-647041d10fef None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:17.621572 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68d9ba-e8bd-49c0-8907-647041d10fef None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:17.621950 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68d9ba-e8bd-49c0-8907-647041d10fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:17.635098 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3e7b9-efee-49a5-a41a-b8e7f16403bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:17.635805 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3e7b9-efee-49a5-a41a-b8e7f16403bb None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:17.636089 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3e7b9-efee-49a5-a41a-b8e7f16403bb None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:17.636364 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3e7b9-efee-49a5-a41a-b8e7f16403bb None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:17.637069 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3e7b9-efee-49a5-a41a-b8e7f16403bb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:17.637372 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3e7b9-efee-49a5-a41a-b8e7f16403bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:17.638861 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3e7b9-efee-49a5-a41a-b8e7f16403bb None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:17.639452 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-ca68d9ba-e8bd-49c0-8907-647041d10fef None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:17.640771 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-ca68d9ba-e8bd-49c0-8907-647041d10fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:17.644284 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 464/917] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Mar 10 03:57:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:17.649458 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3e7b9-efee-49a5-a41a-b8e7f16403bb None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:17.727818 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 454/918] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:57:17.751074 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68d9ba-e8bd-49c0-8907-647041d10fef None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:17.776007 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3e7b9-efee-49a5-a41a-b8e7f16403bb None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:17.821640 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb115d-d43a-47e7-a1e0-dd0bd7aa7f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:17.822487 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb115d-d43a-47e7-a1e0-dd0bd7aa7f6d None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:17.822780 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb115d-d43a-47e7-a1e0-dd0bd7aa7f6d None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:17.823053 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb115d-d43a-47e7-a1e0-dd0bd7aa7f6d None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:17.823783 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb115d-d43a-47e7-a1e0-dd0bd7aa7f6d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:17.824089 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb115d-d43a-47e7-a1e0-dd0bd7aa7f6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:17.826269 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb115d-d43a-47e7-a1e0-dd0bd7aa7f6d None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:17.835768 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 465/919] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Mar 10 03:57:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:17.839113 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb115d-d43a-47e7-a1e0-dd0bd7aa7f6d None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:17.863672 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68d9ba-e8bd-49c0-8907-647041d10fef None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:17.898758 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebc4a8-7281-4908-89a5-b6ceae6f3038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:17.900021 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebc4a8-7281-4908-89a5-b6ceae6f3038 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:17.900500 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebc4a8-7281-4908-89a5-b6ceae6f3038 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:17.901016 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebc4a8-7281-4908-89a5-b6ceae6f3038 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:17.901885 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebc4a8-7281-4908-89a5-b6ceae6f3038 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:17.903459 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebc4a8-7281-4908-89a5-b6ceae6f3038 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:17.915750 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-c7ebc4a8-7281-4908-89a5-b6ceae6f3038 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 10 03:57:17.922148 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 455/920] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Mar 10 03:57:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:17.923401 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebc4a8-7281-4908-89a5-b6ceae6f3038 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:17.961646 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb115d-d43a-47e7-a1e0-dd0bd7aa7f6d None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:17.996992 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2e6d8-8a08-4e57-8a6b-bb83a249efc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:17.997975 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2e6d8-8a08-4e57-8a6b-bb83a249efc2 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:17.998496 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2e6d8-8a08-4e57-8a6b-bb83a249efc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:17.998964 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2e6d8-8a08-4e57-8a6b-bb83a249efc2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:18.000011 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2e6d8-8a08-4e57-8a6b-bb83a249efc2 None admin] RBAC: Adding query filter params (interface=public, service_id=45d15759141f4bdb8434c2a3c878faaf, region_id=RegionOne) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:18.000522 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2e6d8-8a08-4e57-8a6b-bb83a249efc2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:18.002138 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2e6d8-8a08-4e57-8a6b-bb83a249efc2 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:18.012277 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 466/921] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Mar 10 03:57:17 2022] GET /identity/v3/endpoints?service_id=45d15759141f4bdb8434c2a3c878faaf&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:18.013474 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2e6d8-8a08-4e57-8a6b-bb83a249efc2 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:18.040027 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebc4a8-7281-4908-89a5-b6ceae6f3038 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:18.082501 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828127f-1d67-4c2a-980f-4093b367be57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:18.083443 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828127f-1d67-4c2a-980f-4093b367be57 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:18.083745 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828127f-1d67-4c2a-980f-4093b367be57 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:18.084026 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828127f-1d67-4c2a-980f-4093b367be57 None admin] PATH_INFO: `/v3/services` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:18.084742 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6828127f-1d67-4c2a-980f-4093b367be57 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:18.085205 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6828127f-1d67-4c2a-980f-4093b367be57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:18.087231 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6828127f-1d67-4c2a-980f-4093b367be57 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:18.095727 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 456/922] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Mar 10 03:57:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:18.101682 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828127f-1d67-4c2a-980f-4093b367be57 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:18.139843 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2e6d8-8a08-4e57-8a6b-bb83a249efc2 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:18.177206 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef96fe-15af-4fc1-939f-0674f4fbf135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:18.177647 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef96fe-15af-4fc1-939f-0674f4fbf135 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:18.177937 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef96fe-15af-4fc1-939f-0674f4fbf135 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:18.178213 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef96fe-15af-4fc1-939f-0674f4fbf135 None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:18.178943 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef96fe-15af-4fc1-939f-0674f4fbf135 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:18.180371 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef96fe-15af-4fc1-939f-0674f4fbf135 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:18.196162 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 467/923] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Mar 10 03:57:18 2022] GET /identity/v3/services => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 03:57:18.227551 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828127f-1d67-4c2a-980f-4093b367be57 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:18.266340 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f97bb86-e0c9-4482-abaf-17bec43b1fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:18.268058 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97bb86-e0c9-4482-abaf-17bec43b1fe0 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:18.268542 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97bb86-e0c9-4482-abaf-17bec43b1fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:18.269005 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97bb86-e0c9-4482-abaf-17bec43b1fe0 None admin] PATH_INFO: `/v3/services` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:18.269945 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f97bb86-e0c9-4482-abaf-17bec43b1fe0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:18.270468 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f97bb86-e0c9-4482-abaf-17bec43b1fe0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:18.272105 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f97bb86-e0c9-4482-abaf-17bec43b1fe0 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:18.278444 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 457/924] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Mar 10 03:57:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:18.284308 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef96fe-15af-4fc1-939f-0674f4fbf135 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:18.392896 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef96fe-15af-4fc1-939f-0674f4fbf135 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:18.433789 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79133e99-693c-4107-9ed9-cf5445eb9fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:18.434462 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79133e99-693c-4107-9ed9-cf5445eb9fc9 None admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:18.434747 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79133e99-693c-4107-9ed9-cf5445eb9fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:18.435022 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79133e99-693c-4107-9ed9-cf5445eb9fc9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:18.435810 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79133e99-693c-4107-9ed9-cf5445eb9fc9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:18.437190 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79133e99-693c-4107-9ed9-cf5445eb9fc9 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:18.465623 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 468/925] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Mar 10 03:57:18 2022] POST /identity/v3/endpoints => generated 346 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 03:57:18.509804 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc02ac6-f595-43ba-a57d-fa1c473d3270 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:18.510136 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc02ac6-f595-43ba-a57d-fa1c473d3270 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:18.510370 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc02ac6-f595-43ba-a57d-fa1c473d3270 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:18.512632 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 458/926] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:18.518475 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40b52e-1a42-4694-9e72-8cb9aac96e99 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:18.518733 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40b52e-1a42-4694-9e72-8cb9aac96e99 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:18.518955 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40b52e-1a42-4694-9e72-8cb9aac96e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:18.537396 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-fb40b52e-1a42-4694-9e72-8cb9aac96e99 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:18.538654 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-fb40b52e-1a42-4694-9e72-8cb9aac96e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:18.553082 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015e63b-1d09-420e-983e-0cc85b3125f2 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:18.553401 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015e63b-1d09-420e-983e-0cc85b3125f2 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:18.553642 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015e63b-1d09-420e-983e-0cc85b3125f2 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:18.555506 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 459/927] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:18.561765 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d90c8-b7a3-413b-adaa-76ebbb685180 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:18.562063 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d90c8-b7a3-413b-adaa-76ebbb685180 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:18.562333 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d90c8-b7a3-413b-adaa-76ebbb685180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:18.580362 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-d05d90c8-b7a3-413b-adaa-76ebbb685180 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:18.581568 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-d05d90c8-b7a3-413b-adaa-76ebbb685180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:18.618338 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 469/928] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:57:18.642398 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40b52e-1a42-4694-9e72-8cb9aac96e99 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:18.666063 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 460/929] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 03:57:18.690806 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d90c8-b7a3-413b-adaa-76ebbb685180 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:18.761677 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40b52e-1a42-4694-9e72-8cb9aac96e99 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:18.796021 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90fc99-14d0-4017-89eb-2d0ede49dd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:18.796837 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90fc99-14d0-4017-89eb-2d0ede49dd7f None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:18.797125 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90fc99-14d0-4017-89eb-2d0ede49dd7f None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:18.797400 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90fc99-14d0-4017-89eb-2d0ede49dd7f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:18.802529 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d90c8-b7a3-413b-adaa-76ebbb685180 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:18.808427 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb90fc99-14d0-4017-89eb-2d0ede49dd7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:57:18.816527 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-cb90fc99-14d0-4017-89eb-2d0ede49dd7f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 10 03:57:18.818318 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 470/930] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Mar 10 03:57:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:57:18.823792 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90fc99-14d0-4017-89eb-2d0ede49dd7f None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:18.842675 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05062df8-8467-4c5d-940d-42a83747ed5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:18.843489 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05062df8-8467-4c5d-940d-42a83747ed5b None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:18.843862 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05062df8-8467-4c5d-940d-42a83747ed5b None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:18.844100 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05062df8-8467-4c5d-940d-42a83747ed5b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:18.845341 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05062df8-8467-4c5d-940d-42a83747ed5b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:18.847505 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05062df8-8467-4c5d-940d-42a83747ed5b None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:18.862569 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-05062df8-8467-4c5d-940d-42a83747ed5b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 10 03:57:18.867772 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 461/931] 10.222.0.15 () {56 vars in 1132 bytes} [Thu Mar 10 03:57:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:57:18.870933 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05062df8-8467-4c5d-940d-42a83747ed5b None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:18.929329 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90fc99-14d0-4017-89eb-2d0ede49dd7f None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:18.967282 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c592ef1-fe16-414a-9e3f-c7279842c507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:18.968340 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c592ef1-fe16-414a-9e3f-c7279842c507 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:18.968622 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c592ef1-fe16-414a-9e3f-c7279842c507 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:18.968896 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c592ef1-fe16-414a-9e3f-c7279842c507 None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:18.970496 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c592ef1-fe16-414a-9e3f-c7279842c507 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:18.971084 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c592ef1-fe16-414a-9e3f-c7279842c507 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:18.972648 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c592ef1-fe16-414a-9e3f-c7279842c507 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:18.988336 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 471/932] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Mar 10 03:57:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:18.989575 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c592ef1-fe16-414a-9e3f-c7279842c507 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:18.992351 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05062df8-8467-4c5d-940d-42a83747ed5b None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:19.028396 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70330bb-66ba-42ff-a87e-b967637a995a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:19.029071 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70330bb-66ba-42ff-a87e-b967637a995a None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:19.029354 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70330bb-66ba-42ff-a87e-b967637a995a None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:19.029629 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70330bb-66ba-42ff-a87e-b967637a995a None admin] PATH_INFO: `/v3/services` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:19.030403 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70330bb-66ba-42ff-a87e-b967637a995a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:19.030707 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70330bb-66ba-42ff-a87e-b967637a995a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:19.032686 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70330bb-66ba-42ff-a87e-b967637a995a None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:19.038008 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 462/933] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Mar 10 03:57:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:19.044222 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70330bb-66ba-42ff-a87e-b967637a995a None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:19.109599 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c592ef1-fe16-414a-9e3f-c7279842c507 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:19.152823 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6629101-77e0-41e1-9dda-8e3827f85863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:19.153677 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6629101-77e0-41e1-9dda-8e3827f85863 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:19.153832 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70330bb-66ba-42ff-a87e-b967637a995a None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:19.153937 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6629101-77e0-41e1-9dda-8e3827f85863 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:19.154211 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6629101-77e0-41e1-9dda-8e3827f85863 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:19.168541 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6629101-77e0-41e1-9dda-8e3827f85863 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:19.170413 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6629101-77e0-41e1-9dda-8e3827f85863 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:19.188273 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9900dab-8a0d-41b4-bb2f-594c6c455fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:19.189104 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9900dab-8a0d-41b4-bb2f-594c6c455fe9 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:19.189480 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9900dab-8a0d-41b4-bb2f-594c6c455fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:19.189868 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9900dab-8a0d-41b4-bb2f-594c6c455fe9 None admin] PATH_INFO: `/v3/services` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:19.190669 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9900dab-8a0d-41b4-bb2f-594c6c455fe9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:19.190934 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-c6629101-77e0-41e1-9dda-8e3827f85863 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:57:19.191150 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9900dab-8a0d-41b4-bb2f-594c6c455fe9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:19.192741 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 472/934] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:57:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:57:19.192973 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9900dab-8a0d-41b4-bb2f-594c6c455fe9 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:19.198171 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6629101-77e0-41e1-9dda-8e3827f85863 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:19.198306 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 463/935] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Mar 10 03:57:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:19.205190 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9900dab-8a0d-41b4-bb2f-594c6c455fe9 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:19.308994 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6629101-77e0-41e1-9dda-8e3827f85863 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:19.339119 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9900dab-8a0d-41b4-bb2f-594c6c455fe9 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:19.342711 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8a24d-0c90-4030-b15c-ade4a3b47a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:19.343174 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8a24d-0c90-4030-b15c-ade4a3b47a9b None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:19.343466 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8a24d-0c90-4030-b15c-ade4a3b47a9b None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:19.343764 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8a24d-0c90-4030-b15c-ade4a3b47a9b None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:19.344486 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8a24d-0c90-4030-b15c-ade4a3b47a9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:19.345352 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8a24d-0c90-4030-b15c-ade4a3b47a9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:19.346722 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8a24d-0c90-4030-b15c-ade4a3b47a9b None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:19.365463 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 473/936] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:19.366581 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8a24d-0c90-4030-b15c-ade4a3b47a9b None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:19.383537 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e018866-a4a9-45b7-8dec-2b1453616239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:19.384767 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e018866-a4a9-45b7-8dec-2b1453616239 None admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:19.385561 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e018866-a4a9-45b7-8dec-2b1453616239 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:19.386019 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e018866-a4a9-45b7-8dec-2b1453616239 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:19.386936 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e018866-a4a9-45b7-8dec-2b1453616239 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:19.389124 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e018866-a4a9-45b7-8dec-2b1453616239 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:19.428220 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 464/937] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Mar 10 03:57:19 2022] POST /identity/v3/endpoints => generated 347 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 03:57:19.484881 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8a24d-0c90-4030-b15c-ade4a3b47a9b None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:19.531509 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd36324a-d852-4345-8322-54eb711cc0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:19.533224 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36324a-d852-4345-8322-54eb711cc0d2 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:19.533719 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36324a-d852-4345-8322-54eb711cc0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:19.534167 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36324a-d852-4345-8322-54eb711cc0d2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:19.542547 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd36324a-d852-4345-8322-54eb711cc0d2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:19.544320 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd36324a-d852-4345-8322-54eb711cc0d2 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:19.561009 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-dd36324a-d852-4345-8322-54eb711cc0d2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 10 03:57:19.563024 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 474/938] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Mar 10 03:57:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:19.569762 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e018866-a4a9-45b7-8dec-2b1453616239 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:19.679177 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e018866-a4a9-45b7-8dec-2b1453616239 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:19.714246 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da544e3c-6d6d-4b8a-8e1d-03338c430345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:19.715215 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da544e3c-6d6d-4b8a-8e1d-03338c430345 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:19.715713 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da544e3c-6d6d-4b8a-8e1d-03338c430345 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:19.716168 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da544e3c-6d6d-4b8a-8e1d-03338c430345 None admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:19.717185 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da544e3c-6d6d-4b8a-8e1d-03338c430345 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:19.717667 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da544e3c-6d6d-4b8a-8e1d-03338c430345 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:19.719272 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da544e3c-6d6d-4b8a-8e1d-03338c430345 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:19.737527 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 465/939] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Mar 10 03:57:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:19.743638 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd36324a-d852-4345-8322-54eb711cc0d2 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:19.847831 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd36324a-d852-4345-8322-54eb711cc0d2 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:19.881322 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b61f3a-bfec-4772-a7f6-3647a1a2f48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:19.882113 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b61f3a-bfec-4772-a7f6-3647a1a2f48b None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:19.882392 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b61f3a-bfec-4772-a7f6-3647a1a2f48b None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:19.882663 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b61f3a-bfec-4772-a7f6-3647a1a2f48b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:19.893411 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b61f3a-bfec-4772-a7f6-3647a1a2f48b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:19.894858 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b61f3a-bfec-4772-a7f6-3647a1a2f48b None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:19.912659 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-e7b61f3a-bfec-4772-a7f6-3647a1a2f48b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:57:19.918642 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 475/940] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:57:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:19.920005 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da544e3c-6d6d-4b8a-8e1d-03338c430345 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:20.022259 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da544e3c-6d6d-4b8a-8e1d-03338c430345 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:20.056683 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927556b-373a-47cc-bfae-babbdbb1864e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:20.057347 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927556b-373a-47cc-bfae-babbdbb1864e None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:20.057625 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927556b-373a-47cc-bfae-babbdbb1864e None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:20.057898 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927556b-373a-47cc-bfae-babbdbb1864e None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:20.058621 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927556b-373a-47cc-bfae-babbdbb1864e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:20.058922 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927556b-373a-47cc-bfae-babbdbb1864e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:20.060366 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927556b-373a-47cc-bfae-babbdbb1864e None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:20.083391 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 466/941] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:20.084766 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b61f3a-bfec-4772-a7f6-3647a1a2f48b None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:20.190250 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b61f3a-bfec-4772-a7f6-3647a1a2f48b None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:20.224415 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039c416-3d33-4337-b0f7-6c6d1ffe7ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:20.225585 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039c416-3d33-4337-b0f7-6c6d1ffe7ed8 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:20.226149 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039c416-3d33-4337-b0f7-6c6d1ffe7ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:20.226627 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039c416-3d33-4337-b0f7-6c6d1ffe7ed8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:20.233805 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039c416-3d33-4337-b0f7-6c6d1ffe7ed8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:20.236142 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039c416-3d33-4337-b0f7-6c6d1ffe7ed8 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:20.250067 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-4039c416-3d33-4337-b0f7-6c6d1ffe7ed8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:57:20.252678 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 476/942] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:57:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:20.263752 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927556b-373a-47cc-bfae-babbdbb1864e None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:20.361715 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927556b-373a-47cc-bfae-babbdbb1864e None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:20.396010 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6d3e4-d1c1-4d9b-a9bb-4f95f9446c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:20.396676 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6d3e4-d1c1-4d9b-a9bb-4f95f9446c91 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:20.396956 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6d3e4-d1c1-4d9b-a9bb-4f95f9446c91 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:20.397230 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6d3e4-d1c1-4d9b-a9bb-4f95f9446c91 None admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:20.398014 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6d3e4-d1c1-4d9b-a9bb-4f95f9446c91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:20.398318 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6d3e4-d1c1-4d9b-a9bb-4f95f9446c91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:20.399761 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6d3e4-d1c1-4d9b-a9bb-4f95f9446c91 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:20.417418 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 467/943] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:57:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:20.418772 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039c416-3d33-4337-b0f7-6c6d1ffe7ed8 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:20.519093 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039c416-3d33-4337-b0f7-6c6d1ffe7ed8 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:20.558204 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27cca7-5cb3-43b1-bb51-5c646d8ae055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:20.559113 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27cca7-5cb3-43b1-bb51-5c646d8ae055 None admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:20.559394 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27cca7-5cb3-43b1-bb51-5c646d8ae055 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:20.559676 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27cca7-5cb3-43b1-bb51-5c646d8ae055 None admin] PATH_INFO: `/v3/projects/0846fccaeb674395a87e45290eda74b7/users/7eb560db53cd4af192bb82abdfad3590/roles/0bfe9ff936144b8987acb9d8a5188913` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:20.561963 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27cca7-5cb3-43b1-bb51-5c646d8ae055 None admin] RBAC: Authorizing `identity:create_grant(project_id=0846fccaeb674395a87e45290eda74b7, user_id=7eb560db53cd4af192bb82abdfad3590, role_id=0bfe9ff936144b8987acb9d8a5188913)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:20.563436 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27cca7-5cb3-43b1-bb51-5c646d8ae055 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:20.579395 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 477/944] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Mar 10 03:57:20 2022] PUT /identity/v3/projects/0846fccaeb674395a87e45290eda74b7/users/7eb560db53cd4af192bb82abdfad3590/roles/0bfe9ff936144b8987acb9d8a5188913 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 03:57:20.625176 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae451f-965a-489a-b635-0e06b2be454f None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:20.625772 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae451f-965a-489a-b635-0e06b2be454f None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:20.626329 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae451f-965a-489a-b635-0e06b2be454f None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:20.628432 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 468/945] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:20.634737 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0fd56-fd23-4628-90c4-f4778272dc0a None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:20.635033 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0fd56-fd23-4628-90c4-f4778272dc0a None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:20.635312 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0fd56-fd23-4628-90c4-f4778272dc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:20.654732 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-89f0fd56-fd23-4628-90c4-f4778272dc0a None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:20.656082 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-89f0fd56-fd23-4628-90c4-f4778272dc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:20.733685 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 478/946] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:57:20.756956 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae451f-965a-489a-b635-0e06b2be454f None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:20.863484 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae451f-965a-489a-b635-0e06b2be454f None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:20.897992 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe0ec7-1158-438f-8f68-b30823344afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:20.899067 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe0ec7-1158-438f-8f68-b30823344afd None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:20.899527 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe0ec7-1158-438f-8f68-b30823344afd None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:20.899970 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe0ec7-1158-438f-8f68-b30823344afd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:20.900866 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe0ec7-1158-438f-8f68-b30823344afd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:20.902428 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe0ec7-1158-438f-8f68-b30823344afd None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:20.914894 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-25fe0ec7-1158-438f-8f68-b30823344afd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 10 03:57:20.916757 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 469/947] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Mar 10 03:57:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:20.927738 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0fd56-fd23-4628-90c4-f4778272dc0a None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:21.022884 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940f3f4-c7c8-42e2-88ee-4986f4876e81 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:21.023520 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940f3f4-c7c8-42e2-88ee-4986f4876e81 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:21.023623 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0fd56-fd23-4628-90c4-f4778272dc0a None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:21.024126 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940f3f4-c7c8-42e2-88ee-4986f4876e81 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:21.029987 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 470/948] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 03:57:21.031867 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0291cd-6347-420f-9f84-865ffdd00b69 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:21.032938 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0291cd-6347-420f-9f84-865ffdd00b69 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:21.033409 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0291cd-6347-420f-9f84-865ffdd00b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:21.050253 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-cb0291cd-6347-420f-9f84-865ffdd00b69 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:21.051794 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-cb0291cd-6347-420f-9f84-865ffdd00b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:21.061264 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7bb0b-c23b-4130-9b99-e9f87189a925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:21.062295 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7bb0b-c23b-4130-9b99-e9f87189a925 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:21.062596 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7bb0b-c23b-4130-9b99-e9f87189a925 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:21.062877 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7bb0b-c23b-4130-9b99-e9f87189a925 None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:21.064148 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7bb0b-c23b-4130-9b99-e9f87189a925 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:21.067566 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7bb0b-c23b-4130-9b99-e9f87189a925 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:21.067566 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7bb0b-c23b-4130-9b99-e9f87189a925 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:21.071931 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 479/949] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Mar 10 03:57:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:21.078895 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7bb0b-c23b-4130-9b99-e9f87189a925 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:21.147824 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 471/950] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:57:21.164539 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0291cd-6347-420f-9f84-865ffdd00b69 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:21.193854 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7bb0b-c23b-4130-9b99-e9f87189a925 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:21.227590 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c0960-ab30-4692-8d0d-a7ffc5042b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:21.228304 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c0960-ab30-4692-8d0d-a7ffc5042b92 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:21.228584 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c0960-ab30-4692-8d0d-a7ffc5042b92 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:21.228855 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c0960-ab30-4692-8d0d-a7ffc5042b92 None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:21.229547 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c0960-ab30-4692-8d0d-a7ffc5042b92 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:21.229846 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c0960-ab30-4692-8d0d-a7ffc5042b92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:21.231276 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c0960-ab30-4692-8d0d-a7ffc5042b92 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:21.236883 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 480/951] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Mar 10 03:57:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:21.242222 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c0960-ab30-4692-8d0d-a7ffc5042b92 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:21.268097 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0291cd-6347-420f-9f84-865ffdd00b69 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:21.304774 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915411d0-3f7b-4b01-a4c5-2902142cf82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:21.305836 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915411d0-3f7b-4b01-a4c5-2902142cf82f None admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:21.306372 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915411d0-3f7b-4b01-a4c5-2902142cf82f None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:21.306856 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915411d0-3f7b-4b01-a4c5-2902142cf82f None admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:21.307793 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915411d0-3f7b-4b01-a4c5-2902142cf82f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:21.309439 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915411d0-3f7b-4b01-a4c5-2902142cf82f None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:21.311010 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.common [None req-915411d0-3f7b-4b01-a4c5-2902142cf82f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Mar 10 03:57:21.330368 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.sql.core [None req-915411d0-3f7b-4b01-a4c5-2902142cf82f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Mar 10 03:57:21.330368 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Mar 10 03:57:21.330368 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [parameters: {'id': '60b434f2f024403b9bb8f3c12adf5613', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Mar 10 03:57:21.330368 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79560) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 10 03:57:21.337844 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-915411d0-3f7b-4b01-a4c5-2902142cf82f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 60b434f2f024403b9bb8f3c12adf5613.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 60b434f2f024403b9bb8f3c12adf5613. Mar 10 03:57:21.339897 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 472/952] 10.222.0.15 () {60 vars in 1140 bytes} [Thu Mar 10 03:57:21 2022] POST /identity/v3/projects => generated 262 bytes in 176 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:57:21.345610 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915411d0-3f7b-4b01-a4c5-2902142cf82f None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:21.348502 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c0960-ab30-4692-8d0d-a7ffc5042b92 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:21.393748 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe86eca-595c-4a5b-9f19-f4f60d6b963e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:21.394411 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe86eca-595c-4a5b-9f19-f4f60d6b963e None admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:21.394692 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe86eca-595c-4a5b-9f19-f4f60d6b963e None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:21.394966 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe86eca-595c-4a5b-9f19-f4f60d6b963e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:21.395964 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe86eca-595c-4a5b-9f19-f4f60d6b963e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:21.397920 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe86eca-595c-4a5b-9f19-f4f60d6b963e None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:21.428064 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 481/953] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Mar 10 03:57:21 2022] POST /identity/v3/endpoints => generated 349 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 03:57:21.472736 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915411d0-3f7b-4b01-a4c5-2902142cf82f None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:21.524849 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926a252-c52f-42cb-8758-0a83d160ecdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:21.525691 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926a252-c52f-42cb-8758-0a83d160ecdc None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:21.525971 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926a252-c52f-42cb-8758-0a83d160ecdc None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:21.526245 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926a252-c52f-42cb-8758-0a83d160ecdc None admin] PATH_INFO: `/v3/projects/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:21.535095 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926a252-c52f-42cb-8758-0a83d160ecdc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:21.536793 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926a252-c52f-42cb-8758-0a83d160ecdc None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:21.553566 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-d926a252-c52f-42cb-8758-0a83d160ecdc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:57:21.555857 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 473/954] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:57:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:21.561487 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe86eca-595c-4a5b-9f19-f4f60d6b963e None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:21.666165 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe86eca-595c-4a5b-9f19-f4f60d6b963e None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:21.700857 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190165f-5ec6-439d-aa73-6b904700b8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:21.701884 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190165f-5ec6-439d-aa73-6b904700b8d1 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:21.702417 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190165f-5ec6-439d-aa73-6b904700b8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:21.702880 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190165f-5ec6-439d-aa73-6b904700b8d1 None admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:21.703849 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190165f-5ec6-439d-aa73-6b904700b8d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:21.704392 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190165f-5ec6-439d-aa73-6b904700b8d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:21.706011 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190165f-5ec6-439d-aa73-6b904700b8d1 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:21.723742 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 482/955] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Mar 10 03:57:21 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:21.908770 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3e44a-34cd-4bc8-bce9-093d59af4428 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:21.908770 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3e44a-34cd-4bc8-bce9-093d59af4428 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:21.908770 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3e44a-34cd-4bc8-bce9-093d59af4428 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:21.910547 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 474/956] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:21.916044 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1c31f-9412-46b2-b899-36d54f705217 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:21.916609 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1c31f-9412-46b2-b899-36d54f705217 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:21.917158 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1c31f-9412-46b2-b899-36d54f705217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:21.935330 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-3da1c31f-9412-46b2-b899-36d54f705217 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:21.936799 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-3da1c31f-9412-46b2-b899-36d54f705217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:22.004270 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 483/957] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:57:22.026381 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3e44a-34cd-4bc8-bce9-093d59af4428 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:22.129906 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3e44a-34cd-4bc8-bce9-093d59af4428 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:22.164528 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f98be8-cace-415b-a1e1-37bd29aa8c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:22.165327 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f98be8-cace-415b-a1e1-37bd29aa8c86 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:22.165604 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f98be8-cace-415b-a1e1-37bd29aa8c86 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:22.165877 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f98be8-cace-415b-a1e1-37bd29aa8c86 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:22.166534 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f98be8-cace-415b-a1e1-37bd29aa8c86 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:22.167934 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f98be8-cace-415b-a1e1-37bd29aa8c86 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:22.179776 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-b0f98be8-cace-415b-a1e1-37bd29aa8c86 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 10 03:57:22.181303 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 475/958] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:57:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:22.187222 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1c31f-9412-46b2-b899-36d54f705217 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:22.288592 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1c31f-9412-46b2-b899-36d54f705217 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:22.323070 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6281d-0a75-49e1-a6fb-0dfbfe6a52b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:22.324132 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6281d-0a75-49e1-a6fb-0dfbfe6a52b6 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:22.324649 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6281d-0a75-49e1-a6fb-0dfbfe6a52b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:22.325144 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6281d-0a75-49e1-a6fb-0dfbfe6a52b6 None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:22.326048 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6281d-0a75-49e1-a6fb-0dfbfe6a52b6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:22.326553 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6281d-0a75-49e1-a6fb-0dfbfe6a52b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:22.328136 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6281d-0a75-49e1-a6fb-0dfbfe6a52b6 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:22.333952 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 484/959] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Mar 10 03:57:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:22.341254 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f98be8-cace-415b-a1e1-37bd29aa8c86 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:22.440019 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f98be8-cace-415b-a1e1-37bd29aa8c86 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:22.474661 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a79df-de8d-4031-aa4d-b72dc43ba4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:22.475397 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a79df-de8d-4031-aa4d-b72dc43ba4c0 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:22.475601 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a79df-de8d-4031-aa4d-b72dc43ba4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:22.476143 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a79df-de8d-4031-aa4d-b72dc43ba4c0 None admin] PATH_INFO: `/v3/services` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:22.476814 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a79df-de8d-4031-aa4d-b72dc43ba4c0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:22.477122 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a79df-de8d-4031-aa4d-b72dc43ba4c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:22.478502 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a79df-de8d-4031-aa4d-b72dc43ba4c0 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:22.484145 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 476/960] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Mar 10 03:57:22 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:23.028053 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19e42a-5e6a-4cc0-aba3-f71284688cc7 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:23.029079 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19e42a-5e6a-4cc0-aba3-f71284688cc7 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:23.029596 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19e42a-5e6a-4cc0-aba3-f71284688cc7 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:23.031828 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 485/961] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:23.037350 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79458f61-83dc-4622-8059-b7593e4c4087 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:23.037865 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79458f61-83dc-4622-8059-b7593e4c4087 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:23.038342 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79458f61-83dc-4622-8059-b7593e4c4087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:23.056575 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-79458f61-83dc-4622-8059-b7593e4c4087 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:23.058425 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-79458f61-83dc-4622-8059-b7593e4c4087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:23.130174 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 477/962] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:57:23.153879 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19e42a-5e6a-4cc0-aba3-f71284688cc7 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:23.259941 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19e42a-5e6a-4cc0-aba3-f71284688cc7 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:23.293930 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bce75-ce38-4c09-86ad-1530c68dbba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:23.294755 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bce75-ce38-4c09-86ad-1530c68dbba7 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:23.295036 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bce75-ce38-4c09-86ad-1530c68dbba7 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:23.295310 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bce75-ce38-4c09-86ad-1530c68dbba7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:23.306584 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280bce75-ce38-4c09-86ad-1530c68dbba7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:57:23.314632 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-280bce75-ce38-4c09-86ad-1530c68dbba7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 10 03:57:23.316186 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 486/963] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Mar 10 03:57:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:23.322002 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79458f61-83dc-4622-8059-b7593e4c4087 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:23.424655 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79458f61-83dc-4622-8059-b7593e4c4087 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:23.458933 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fd240-08d4-4cdd-8618-dbde6f9f84eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:23.459603 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fd240-08d4-4cdd-8618-dbde6f9f84eb None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:23.459917 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fd240-08d4-4cdd-8618-dbde6f9f84eb None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:23.460198 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fd240-08d4-4cdd-8618-dbde6f9f84eb None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:23.461012 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445fd240-08d4-4cdd-8618-dbde6f9f84eb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:23.461320 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445fd240-08d4-4cdd-8618-dbde6f9f84eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:23.462746 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445fd240-08d4-4cdd-8618-dbde6f9f84eb None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:23.472191 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 478/964] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Mar 10 03:57:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:23.481068 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bce75-ce38-4c09-86ad-1530c68dbba7 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:23.586913 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280bce75-ce38-4c09-86ad-1530c68dbba7 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:23.621336 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcdb40-7a81-48c3-bf01-6cff6db87f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:23.622137 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcdb40-7a81-48c3-bf01-6cff6db87f0f None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:23.622423 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcdb40-7a81-48c3-bf01-6cff6db87f0f None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:23.622700 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcdb40-7a81-48c3-bf01-6cff6db87f0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:23.635127 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dcdb40-7a81-48c3-bf01-6cff6db87f0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:23.636633 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dcdb40-7a81-48c3-bf01-6cff6db87f0f None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:23.653695 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-a0dcdb40-7a81-48c3-bf01-6cff6db87f0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:57:23.655244 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 487/965] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:57:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:23.661459 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fd240-08d4-4cdd-8618-dbde6f9f84eb None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:23.768918 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fd240-08d4-4cdd-8618-dbde6f9f84eb None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:23.806201 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ba01d-b000-4fe4-90b8-2db29353e965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:23.806885 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ba01d-b000-4fe4-90b8-2db29353e965 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:23.807170 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ba01d-b000-4fe4-90b8-2db29353e965 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:23.807447 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ba01d-b000-4fe4-90b8-2db29353e965 None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:23.808252 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ba01d-b000-4fe4-90b8-2db29353e965 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:23.808558 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ba01d-b000-4fe4-90b8-2db29353e965 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:23.809965 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ba01d-b000-4fe4-90b8-2db29353e965 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:23.824045 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 479/966] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:23.832825 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcdb40-7a81-48c3-bf01-6cff6db87f0f None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:23.873897 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7642f3-02d9-4204-a57f-856f479529c5 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:23.874497 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7642f3-02d9-4204-a57f-856f479529c5 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:23.874841 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7642f3-02d9-4204-a57f-856f479529c5 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:23.880617 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 480/967] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 03:57:23.882203 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69975cd7-9caa-4867-ae87-fd2773fffdbc None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:23.882487 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69975cd7-9caa-4867-ae87-fd2773fffdbc None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:23.882808 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69975cd7-9caa-4867-ae87-fd2773fffdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:23.903384 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-69975cd7-9caa-4867-ae87-fd2773fffdbc None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:23.904734 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-69975cd7-9caa-4867-ae87-fd2773fffdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:23.947085 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcdb40-7a81-48c3-bf01-6cff6db87f0f None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:23.981890 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 481/968] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 03:57:23.995568 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51bc9c-e3d6-4ed3-932b-a39c72afd14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:23.996556 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51bc9c-e3d6-4ed3-932b-a39c72afd14f None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:23.996889 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51bc9c-e3d6-4ed3-932b-a39c72afd14f None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:23.997161 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51bc9c-e3d6-4ed3-932b-a39c72afd14f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:24.005251 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51bc9c-e3d6-4ed3-932b-a39c72afd14f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:24.006703 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51bc9c-e3d6-4ed3-932b-a39c72afd14f None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:24.008672 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69975cd7-9caa-4867-ae87-fd2773fffdbc None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:24.021923 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-0d51bc9c-e3d6-4ed3-932b-a39c72afd14f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 10 03:57:24.023444 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 488/969] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Mar 10 03:57:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:24.028915 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51bc9c-e3d6-4ed3-932b-a39c72afd14f None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:24.124087 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69975cd7-9caa-4867-ae87-fd2773fffdbc None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:24.139491 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51bc9c-e3d6-4ed3-932b-a39c72afd14f None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:24.159514 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756afba6-74e7-476e-acdc-4f2da0a5aaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:24.160833 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756afba6-74e7-476e-acdc-4f2da0a5aaf4 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:24.160833 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756afba6-74e7-476e-acdc-4f2da0a5aaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:24.161105 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756afba6-74e7-476e-acdc-4f2da0a5aaf4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:24.161689 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756afba6-74e7-476e-acdc-4f2da0a5aaf4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:24.163063 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756afba6-74e7-476e-acdc-4f2da0a5aaf4 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:24.174272 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630ef8e-e58b-429a-9579-92ae16a8143f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:24.174455 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-756afba6-74e7-476e-acdc-4f2da0a5aaf4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 10 03:57:24.174942 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630ef8e-e58b-429a-9579-92ae16a8143f None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:24.175277 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630ef8e-e58b-429a-9579-92ae16a8143f None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:24.179783 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630ef8e-e58b-429a-9579-92ae16a8143f None admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:24.179929 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 482/970] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Mar 10 03:57:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:57:24.180040 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8630ef8e-e58b-429a-9579-92ae16a8143f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:24.180040 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8630ef8e-e58b-429a-9579-92ae16a8143f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:24.180200 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f83e0-fbca-4703-83ab-e6b0b6b24c05 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:24.180200 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f83e0-fbca-4703-83ab-e6b0b6b24c05 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:24.180200 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f83e0-fbca-4703-83ab-e6b0b6b24c05 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:24.180421 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8630ef8e-e58b-429a-9579-92ae16a8143f None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:24.180507 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 483/971] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:24.182219 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f83e0-fbca-4703-83ab-e6b0b6b24c05 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:24.207641 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 489/972] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Mar 10 03:57:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:24.207641 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0d46a-fa35-4cc7-a519-1201efb095b5 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:24.207641 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0d46a-fa35-4cc7-a519-1201efb095b5 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:24.207641 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0d46a-fa35-4cc7-a519-1201efb095b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:24.221278 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-d6a0d46a-fa35-4cc7-a519-1201efb095b5 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:24.222465 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-d6a0d46a-fa35-4cc7-a519-1201efb095b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:24.288270 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 490/973] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:57:24.289371 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0d46a-fa35-4cc7-a519-1201efb095b5 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:24.301186 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f83e0-fbca-4703-83ab-e6b0b6b24c05 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:24.340350 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36801a9-696e-41b1-848e-a5ac7ac01bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:24.341024 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36801a9-696e-41b1-848e-a5ac7ac01bbe None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:24.341309 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36801a9-696e-41b1-848e-a5ac7ac01bbe None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:24.341587 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36801a9-696e-41b1-848e-a5ac7ac01bbe None admin] PATH_INFO: `/v3/services` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:24.342295 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36801a9-696e-41b1-848e-a5ac7ac01bbe None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:24.342601 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36801a9-696e-41b1-848e-a5ac7ac01bbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:24.344001 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36801a9-696e-41b1-848e-a5ac7ac01bbe None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:24.349353 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 484/974] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Mar 10 03:57:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:24.352631 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36801a9-696e-41b1-848e-a5ac7ac01bbe None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:24.391110 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0d46a-fa35-4cc7-a519-1201efb095b5 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:24.432526 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654961cf-7a27-4395-ad2d-7e2d34211785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:24.433304 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654961cf-7a27-4395-ad2d-7e2d34211785 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:24.433586 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654961cf-7a27-4395-ad2d-7e2d34211785 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:24.433921 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654961cf-7a27-4395-ad2d-7e2d34211785 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:24.453185 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36801a9-696e-41b1-848e-a5ac7ac01bbe None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:24.487883 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987232f7-8c68-4c6d-821f-e5830a4f45b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:24.488552 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987232f7-8c68-4c6d-821f-e5830a4f45b3 None admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:24.488830 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987232f7-8c68-4c6d-821f-e5830a4f45b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:24.489107 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987232f7-8c68-4c6d-821f-e5830a4f45b3 None admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:24.489802 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987232f7-8c68-4c6d-821f-e5830a4f45b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:24.491229 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987232f7-8c68-4c6d-821f-e5830a4f45b3 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:24.504626 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654961cf-7a27-4395-ad2d-7e2d34211785 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:24.505770 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.sql.core [None req-987232f7-8c68-4c6d-821f-e5830a4f45b3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Mar 10 03:57:24.505770 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Mar 10 03:57:24.505770 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [parameters: {'user_id': '44776962c8b246bab146aa1694de3eb6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Mar 10 03:57:24.505770 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79560) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 10 03:57:24.506136 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654961cf-7a27-4395-ad2d-7e2d34211785 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:24.511371 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-987232f7-8c68-4c6d-821f-e5830a4f45b3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Mar 10 03:57:24.515727 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 485/975] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Mar 10 03:57:24 2022] POST /identity/v3/users => generated 160 bytes in 160 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:24.515727 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987232f7-8c68-4c6d-821f-e5830a4f45b3 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:24.613913 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 491/976] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:57:24 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 03:57:24.614886 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654961cf-7a27-4395-ad2d-7e2d34211785 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:24.625284 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987232f7-8c68-4c6d-821f-e5830a4f45b3 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:24.658148 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fbc78b-622d-4252-9b13-c2aafd49a6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:24.658859 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbc78b-622d-4252-9b13-c2aafd49a6b7 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:24.659143 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbc78b-622d-4252-9b13-c2aafd49a6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:24.659418 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbc78b-622d-4252-9b13-c2aafd49a6b7 None admin] PATH_INFO: `/v3/services` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:24.660164 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fbc78b-622d-4252-9b13-c2aafd49a6b7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:24.660466 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fbc78b-622d-4252-9b13-c2aafd49a6b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:24.662047 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fbc78b-622d-4252-9b13-c2aafd49a6b7 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:24.675146 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 486/977] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Mar 10 03:57:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:24.675146 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fbc78b-622d-4252-9b13-c2aafd49a6b7 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:24.718208 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654961cf-7a27-4395-ad2d-7e2d34211785 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:24.753171 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb730b2-b290-4bde-8a6e-2a558b927050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:24.753973 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb730b2-b290-4bde-8a6e-2a558b927050 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:24.754245 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb730b2-b290-4bde-8a6e-2a558b927050 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:24.754526 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb730b2-b290-4bde-8a6e-2a558b927050 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:24.762602 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb730b2-b290-4bde-8a6e-2a558b927050 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:24.764068 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb730b2-b290-4bde-8a6e-2a558b927050 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:24.772535 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fbc78b-622d-4252-9b13-c2aafd49a6b7 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:24.777790 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-cfb730b2-b290-4bde-8a6e-2a558b927050 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 10 03:57:24.783672 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 492/978] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:57:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:24.783672 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb730b2-b290-4bde-8a6e-2a558b927050 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:24.810969 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276a607-d3ce-4df9-9933-41a19dc32c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:24.812105 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276a607-d3ce-4df9-9933-41a19dc32c01 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:24.812600 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276a607-d3ce-4df9-9933-41a19dc32c01 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:24.813057 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276a607-d3ce-4df9-9933-41a19dc32c01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:24.824874 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f276a607-d3ce-4df9-9933-41a19dc32c01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:24.826410 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f276a607-d3ce-4df9-9933-41a19dc32c01 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:24.842803 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-f276a607-d3ce-4df9-9933-41a19dc32c01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:57:24.849119 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 487/979] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:57:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:24.849119 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276a607-d3ce-4df9-9933-41a19dc32c01 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:24.882501 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb730b2-b290-4bde-8a6e-2a558b927050 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:24.915579 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f050ee8-8009-464c-a1f3-137acf954cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:24.916178 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f050ee8-8009-464c-a1f3-137acf954cb8 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:24.916461 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f050ee8-8009-464c-a1f3-137acf954cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:24.916732 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f050ee8-8009-464c-a1f3-137acf954cb8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:24.917522 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f050ee8-8009-464c-a1f3-137acf954cb8 None admin] RBAC: Adding query filter params (interface=admin, service_id=45d15759141f4bdb8434c2a3c878faaf, region_id=RegionOne) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:24.917830 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f050ee8-8009-464c-a1f3-137acf954cb8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:24.919180 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f050ee8-8009-464c-a1f3-137acf954cb8 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:24.924638 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 493/980] 10.222.0.15 () {56 vars in 1249 bytes} [Thu Mar 10 03:57:24 2022] GET /identity/v3/endpoints?service_id=45d15759141f4bdb8434c2a3c878faaf&interface=admin®ion_id=RegionOne => generated 193 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:24.925416 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f050ee8-8009-464c-a1f3-137acf954cb8 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:24.947081 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276a607-d3ce-4df9-9933-41a19dc32c01 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:24.979041 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ff121-9c4e-446c-b192-d9a897bd6590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:24.979731 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ff121-9c4e-446c-b192-d9a897bd6590 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:24.980025 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ff121-9c4e-446c-b192-d9a897bd6590 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:24.980322 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ff121-9c4e-446c-b192-d9a897bd6590 None admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:24.981114 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ff121-9c4e-446c-b192-d9a897bd6590 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:24.981418 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ff121-9c4e-446c-b192-d9a897bd6590 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:24.982841 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ff121-9c4e-446c-b192-d9a897bd6590 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:25.017194 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 488/981] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Mar 10 03:57:24 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:25.017838 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f050ee8-8009-464c-a1f3-137acf954cb8 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:25.018379 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472d2c5-0152-45a4-a7ec-aed062c53b68 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:25.018670 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472d2c5-0152-45a4-a7ec-aed062c53b68 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:25.018949 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472d2c5-0152-45a4-a7ec-aed062c53b68 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:25.020675 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 489/982] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:25.021406 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472d2c5-0152-45a4-a7ec-aed062c53b68 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:25.068233 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bde1d-8325-4c03-ab92-17f3f54f0ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:25.068932 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bde1d-8325-4c03-ab92-17f3f54f0ba9 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:25.069200 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bde1d-8325-4c03-ab92-17f3f54f0ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:25.069870 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bde1d-8325-4c03-ab92-17f3f54f0ba9 None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:25.070923 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506bde1d-8325-4c03-ab92-17f3f54f0ba9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:25.071252 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506bde1d-8325-4c03-ab92-17f3f54f0ba9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:25.072759 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506bde1d-8325-4c03-ab92-17f3f54f0ba9 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:25.090135 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 494/983] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:25.091657 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff1508-1834-429b-b9e3-3f665088c583 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:25.091978 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff1508-1834-429b-b9e3-3f665088c583 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:25.092260 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff1508-1834-429b-b9e3-3f665088c583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:25.110976 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-1dff1508-1834-429b-b9e3-3f665088c583 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:25.112274 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-1dff1508-1834-429b-b9e3-3f665088c583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:25.133928 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472d2c5-0152-45a4-a7ec-aed062c53b68 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:25.169558 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e13933-6f11-4526-82e6-72f4af1f305c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:25.170172 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e13933-6f11-4526-82e6-72f4af1f305c None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:25.170453 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e13933-6f11-4526-82e6-72f4af1f305c None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:25.170729 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e13933-6f11-4526-82e6-72f4af1f305c None admin] PATH_INFO: `/v3/services` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:25.171414 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e13933-6f11-4526-82e6-72f4af1f305c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:25.173479 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e13933-6f11-4526-82e6-72f4af1f305c None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:25.187723 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 490/984] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Mar 10 03:57:25 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 03:57:25.187723 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e13933-6f11-4526-82e6-72f4af1f305c None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:25.190300 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 495/985] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:57:25.228952 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff1508-1834-429b-b9e3-3f665088c583 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:25.318584 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e13933-6f11-4526-82e6-72f4af1f305c None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:25.350246 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff1508-1834-429b-b9e3-3f665088c583 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:25.356008 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e94302-ae3c-4e99-af9b-dcd3ed3dec15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:25.356831 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e94302-ae3c-4e99-af9b-dcd3ed3dec15 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:25.357117 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e94302-ae3c-4e99-af9b-dcd3ed3dec15 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:25.357392 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e94302-ae3c-4e99-af9b-dcd3ed3dec15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:25.365164 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e94302-ae3c-4e99-af9b-dcd3ed3dec15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:25.366639 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e94302-ae3c-4e99-af9b-dcd3ed3dec15 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:25.383637 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-f7e94302-ae3c-4e99-af9b-dcd3ed3dec15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:57:25.389890 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 491/986] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:57:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:25.390056 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4c5d9-8b49-48eb-b9d9-a1c372c92cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:25.390056 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4c5d9-8b49-48eb-b9d9-a1c372c92cbf None admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:25.390056 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4c5d9-8b49-48eb-b9d9-a1c372c92cbf None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:25.390056 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4c5d9-8b49-48eb-b9d9-a1c372c92cbf None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:25.390504 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4c5d9-8b49-48eb-b9d9-a1c372c92cbf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:25.392030 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e94302-ae3c-4e99-af9b-dcd3ed3dec15 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:25.392472 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4c5d9-8b49-48eb-b9d9-a1c372c92cbf None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:25.409603 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 496/987] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Mar 10 03:57:25 2022] POST /identity/v3/services => generated 242 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 03:57:25.502132 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e94302-ae3c-4e99-af9b-dcd3ed3dec15 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:25.545129 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b1288-0264-4cda-b70f-4fac1655cfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:25.545810 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b1288-0264-4cda-b70f-4fac1655cfa7 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:25.546095 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b1288-0264-4cda-b70f-4fac1655cfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:25.546375 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b1288-0264-4cda-b70f-4fac1655cfa7 None admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:25.547168 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b1288-0264-4cda-b70f-4fac1655cfa7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:25.547500 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b1288-0264-4cda-b70f-4fac1655cfa7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:25.551730 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b1288-0264-4cda-b70f-4fac1655cfa7 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:25.568847 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 492/988] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:57:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:25.572129 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4c5d9-8b49-48eb-b9d9-a1c372c92cbf None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:25.679198 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4c5d9-8b49-48eb-b9d9-a1c372c92cbf None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:25.712576 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f93ee-9d0e-4fdf-b3b0-eff99ab64307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:25.713280 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f93ee-9d0e-4fdf-b3b0-eff99ab64307 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:25.713562 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f93ee-9d0e-4fdf-b3b0-eff99ab64307 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:25.713887 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f93ee-9d0e-4fdf-b3b0-eff99ab64307 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:25.714712 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f93ee-9d0e-4fdf-b3b0-eff99ab64307 None admin] RBAC: Adding query filter params (role.id=0bfe9ff936144b8987acb9d8a5188913, scope.project.id=0846fccaeb674395a87e45290eda74b7, user.id=7eb560db53cd4af192bb82abdfad3590) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:25.715023 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f93ee-9d0e-4fdf-b3b0-eff99ab64307 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:25.716477 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f93ee-9d0e-4fdf-b3b0-eff99ab64307 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:25.722624 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 497/989] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:57:25 2022] GET /identity/v3/role_assignments?user.id=7eb560db53cd4af192bb82abdfad3590&scope.project.id=0846fccaeb674395a87e45290eda74b7&role.id=0bfe9ff936144b8987acb9d8a5188913 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:27.539940 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbe117-f233-4709-9b79-893be0b23c21 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:27.540426 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbe117-f233-4709-9b79-893be0b23c21 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:27.540501 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbe117-f233-4709-9b79-893be0b23c21 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:27.542431 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 493/990] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:27.548083 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa8610-680a-4218-a4b5-c52d13c1d01a None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:27.548515 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa8610-680a-4218-a4b5-c52d13c1d01a None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:27.548751 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa8610-680a-4218-a4b5-c52d13c1d01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:27.565517 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-e4fa8610-680a-4218-a4b5-c52d13c1d01a None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:27.567053 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-e4fa8610-680a-4218-a4b5-c52d13c1d01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:27.630798 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 498/991] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:57:27.653663 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbe117-f233-4709-9b79-893be0b23c21 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:27.744530 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd81129-d721-45d2-a918-bc470c7b04da None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:27.744864 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd81129-d721-45d2-a918-bc470c7b04da None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:27.745095 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd81129-d721-45d2-a918-bc470c7b04da None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:27.746885 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 499/992] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 03:57:27.752292 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ae6a9-a2a8-4ee4-bab5-f887b8fe591c None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:27.752579 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ae6a9-a2a8-4ee4-bab5-f887b8fe591c None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:27.752851 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ae6a9-a2a8-4ee4-bab5-f887b8fe591c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:27.755384 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbe117-f233-4709-9b79-893be0b23c21 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:27.769509 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-a27ae6a9-a2a8-4ee4-bab5-f887b8fe591c None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:27.770680 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-a27ae6a9-a2a8-4ee4-bab5-f887b8fe591c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:27.792686 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d58a8-187c-40a9-b35d-9c792065aab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:27.793546 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d58a8-187c-40a9-b35d-9c792065aab3 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:27.793880 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d58a8-187c-40a9-b35d-9c792065aab3 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:27.794169 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d58a8-187c-40a9-b35d-9c792065aab3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:27.794826 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d58a8-187c-40a9-b35d-9c792065aab3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:27.796262 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d58a8-187c-40a9-b35d-9c792065aab3 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:27.807660 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-f51d58a8-187c-40a9-b35d-9c792065aab3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 10 03:57:27.814199 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 494/993] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Mar 10 03:57:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:27.815798 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d58a8-187c-40a9-b35d-9c792065aab3 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:27.837043 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 500/994] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 03:57:27.859138 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ae6a9-a2a8-4ee4-bab5-f887b8fe591c None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:27.914183 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d58a8-187c-40a9-b35d-9c792065aab3 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:27.948531 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c5900-7ef8-42ab-9bab-21863ac573a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:27.949191 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c5900-7ef8-42ab-9bab-21863ac573a6 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:27.949473 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c5900-7ef8-42ab-9bab-21863ac573a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:27.949749 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c5900-7ef8-42ab-9bab-21863ac573a6 None admin] PATH_INFO: `/v3/services` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:27.950453 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c5900-7ef8-42ab-9bab-21863ac573a6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:27.950752 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c5900-7ef8-42ab-9bab-21863ac573a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:27.952152 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c5900-7ef8-42ab-9bab-21863ac573a6 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:27.957097 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ae6a9-a2a8-4ee4-bab5-f887b8fe591c None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:27.959986 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 495/995] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Mar 10 03:57:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:27.963170 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c5900-7ef8-42ab-9bab-21863ac573a6 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:27.991284 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345de22a-3668-48a6-9b91-05d60a7e0039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:27.992145 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345de22a-3668-48a6-9b91-05d60a7e0039 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:27.992428 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345de22a-3668-48a6-9b91-05d60a7e0039 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:27.992701 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345de22a-3668-48a6-9b91-05d60a7e0039 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:27.993354 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345de22a-3668-48a6-9b91-05d60a7e0039 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:27.994715 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345de22a-3668-48a6-9b91-05d60a7e0039 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:28.006255 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-345de22a-3668-48a6-9b91-05d60a7e0039 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 10 03:57:28.007450 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 501/996] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:57:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:57:28.013144 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345de22a-3668-48a6-9b91-05d60a7e0039 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:28.062852 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c5900-7ef8-42ab-9bab-21863ac573a6 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:28.098866 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877dfd6b-0159-47a2-92a0-3c06f2c547b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:28.099542 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877dfd6b-0159-47a2-92a0-3c06f2c547b5 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:28.099860 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877dfd6b-0159-47a2-92a0-3c06f2c547b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:28.100142 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877dfd6b-0159-47a2-92a0-3c06f2c547b5 None admin] PATH_INFO: `/v3/services` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:28.100849 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877dfd6b-0159-47a2-92a0-3c06f2c547b5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:28.101155 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877dfd6b-0159-47a2-92a0-3c06f2c547b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:28.102527 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877dfd6b-0159-47a2-92a0-3c06f2c547b5 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:28.107449 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 496/997] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Mar 10 03:57:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:28.108719 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf42e31-c8c1-4a0e-a7fb-a54d13e4cff5 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:28.109006 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf42e31-c8c1-4a0e-a7fb-a54d13e4cff5 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:28.109285 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf42e31-c8c1-4a0e-a7fb-a54d13e4cff5 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:28.113675 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 497/998] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:28.113675 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf42e31-c8c1-4a0e-a7fb-a54d13e4cff5 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:28.123489 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345de22a-3668-48a6-9b91-05d60a7e0039 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:28.155329 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2697ad5d-5748-4538-8ba6-7aac523d92d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:28.156016 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697ad5d-5748-4538-8ba6-7aac523d92d9 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:28.156304 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697ad5d-5748-4538-8ba6-7aac523d92d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:28.156575 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697ad5d-5748-4538-8ba6-7aac523d92d9 None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:28.157307 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2697ad5d-5748-4538-8ba6-7aac523d92d9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:28.157608 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2697ad5d-5748-4538-8ba6-7aac523d92d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:28.158980 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2697ad5d-5748-4538-8ba6-7aac523d92d9 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:28.163579 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 502/999] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Mar 10 03:57:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:28.164856 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a2fa7-8823-4ca0-b3dd-4ca9c5ec3212 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:28.165150 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a2fa7-8823-4ca0-b3dd-4ca9c5ec3212 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:28.165477 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a2fa7-8823-4ca0-b3dd-4ca9c5ec3212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:28.185396 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-d90a2fa7-8823-4ca0-b3dd-4ca9c5ec3212 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:28.186640 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-d90a2fa7-8823-4ca0-b3dd-4ca9c5ec3212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:28.213808 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf42e31-c8c1-4a0e-a7fb-a54d13e4cff5 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:28.245867 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ea60d-7d73-48e0-be84-785276b46964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:28.246522 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ea60d-7d73-48e0-be84-785276b46964 None admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:28.246805 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ea60d-7d73-48e0-be84-785276b46964 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:28.247089 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ea60d-7d73-48e0-be84-785276b46964 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:28.247848 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ea60d-7d73-48e0-be84-785276b46964 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:28.249213 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ea60d-7d73-48e0-be84-785276b46964 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:28.253899 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 503/1000] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:28 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:57:28.254876 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a2fa7-8823-4ca0-b3dd-4ca9c5ec3212 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:28.273947 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 498/1001] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Mar 10 03:57:28 2022] POST /identity/v3/endpoints => generated 325 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 03:57:28.273947 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ea60d-7d73-48e0-be84-785276b46964 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:28.357116 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a2fa7-8823-4ca0-b3dd-4ca9c5ec3212 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:28.388936 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ea60d-7d73-48e0-be84-785276b46964 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:28.393703 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c036e9a-070a-46dd-9f3a-d666dd3ca0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:28.394388 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c036e9a-070a-46dd-9f3a-d666dd3ca0f6 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:28.394666 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c036e9a-070a-46dd-9f3a-d666dd3ca0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:28.394937 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c036e9a-070a-46dd-9f3a-d666dd3ca0f6 None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:28.395645 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c036e9a-070a-46dd-9f3a-d666dd3ca0f6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:28.395977 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c036e9a-070a-46dd-9f3a-d666dd3ca0f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:28.397820 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c036e9a-070a-46dd-9f3a-d666dd3ca0f6 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:28.408253 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 504/1002] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Mar 10 03:57:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:28.409405 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c036e9a-070a-46dd-9f3a-d666dd3ca0f6 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:28.431899 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182ec78-91bb-4cf0-a02e-918238d5f358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:28.432727 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182ec78-91bb-4cf0-a02e-918238d5f358 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:28.433008 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182ec78-91bb-4cf0-a02e-918238d5f358 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:28.433281 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182ec78-91bb-4cf0-a02e-918238d5f358 None admin] PATH_INFO: `/v3/services/image` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:28.433938 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182ec78-91bb-4cf0-a02e-918238d5f358 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:28.435405 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182ec78-91bb-4cf0-a02e-918238d5f358 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:28.447801 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-b182ec78-91bb-4cf0-a02e-918238d5f358 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 10 03:57:28.449051 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 499/1003] 10.222.0.15 () {56 vars in 1105 bytes} [Thu Mar 10 03:57:28 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:28.455446 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182ec78-91bb-4cf0-a02e-918238d5f358 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:28.521997 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c036e9a-070a-46dd-9f3a-d666dd3ca0f6 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:28.556802 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231ace5-a3a8-4f6c-8156-dd87bd96f29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:28.557710 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231ace5-a3a8-4f6c-8156-dd87bd96f29b None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:28.558013 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231ace5-a3a8-4f6c-8156-dd87bd96f29b None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:28.558292 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231ace5-a3a8-4f6c-8156-dd87bd96f29b None admin] PATH_INFO: `/v3/endpoints` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:28.559212 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231ace5-a3a8-4f6c-8156-dd87bd96f29b None admin] RBAC: Adding query filter params (interface=public, service_id=9877a66ef7a04f0da3c86ebe6aaa023e, region_id=RegionOne) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:28.559558 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231ace5-a3a8-4f6c-8156-dd87bd96f29b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:28.561056 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231ace5-a3a8-4f6c-8156-dd87bd96f29b None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:28.563985 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182ec78-91bb-4cf0-a02e-918238d5f358 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:28.567337 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 505/1004] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Mar 10 03:57:28 2022] GET /identity/v3/endpoints?service_id=9877a66ef7a04f0da3c86ebe6aaa023e&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:28.572696 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231ace5-a3a8-4f6c-8156-dd87bd96f29b None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:28.600671 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3e5e9-1bea-4447-9fde-68860b20b5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:28.601599 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3e5e9-1bea-4447-9fde-68860b20b5b9 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:28.601879 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3e5e9-1bea-4447-9fde-68860b20b5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:28.602314 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3e5e9-1bea-4447-9fde-68860b20b5b9 None admin] PATH_INFO: `/v3/services` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:28.603325 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3e5e9-1bea-4447-9fde-68860b20b5b9 None admin] RBAC: Adding query filter params (name=image) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:28.603820 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3e5e9-1bea-4447-9fde-68860b20b5b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:28.605210 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3e5e9-1bea-4447-9fde-68860b20b5b9 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:28.611028 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 500/1005] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:57:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:28.616452 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3e5e9-1bea-4447-9fde-68860b20b5b9 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:28.670363 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231ace5-a3a8-4f6c-8156-dd87bd96f29b None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:28.703392 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3577c3-529e-4bc1-a4ba-00ad5aa2584f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:28.704117 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3577c3-529e-4bc1-a4ba-00ad5aa2584f None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:28.704400 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3577c3-529e-4bc1-a4ba-00ad5aa2584f None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:28.704679 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3577c3-529e-4bc1-a4ba-00ad5aa2584f None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:28.705390 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3577c3-529e-4bc1-a4ba-00ad5aa2584f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:28.706756 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3577c3-529e-4bc1-a4ba-00ad5aa2584f None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:28.723716 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 506/1006] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Mar 10 03:57:28 2022] GET /identity/v3/services => generated 1727 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 03:57:28.723957 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3e5e9-1bea-4447-9fde-68860b20b5b9 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:28.749467 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2ae3b-1597-49db-a916-dcfcafea3965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:28.750156 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2ae3b-1597-49db-a916-dcfcafea3965 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:28.750443 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2ae3b-1597-49db-a916-dcfcafea3965 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:28.750726 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2ae3b-1597-49db-a916-dcfcafea3965 None admin] PATH_INFO: `/v3/services` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:28.751451 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2ae3b-1597-49db-a916-dcfcafea3965 None admin] RBAC: Adding query filter params (type=image) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:28.751794 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2ae3b-1597-49db-a916-dcfcafea3965 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:28.753211 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2ae3b-1597-49db-a916-dcfcafea3965 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:28.758358 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 501/1007] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:57:28 2022] GET /identity/v3/services?type=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:30.907305 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab8dec-5545-40e9-93c7-bd83005f062d None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:30.907867 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab8dec-5545-40e9-93c7-bd83005f062d None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:30.908317 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab8dec-5545-40e9-93c7-bd83005f062d None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:30.911587 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 507/1008] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:30.919924 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1b019-b1fb-4e1e-91de-619420deedc2 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:30.920432 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1b019-b1fb-4e1e-91de-619420deedc2 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:30.920925 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1b019-b1fb-4e1e-91de-619420deedc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:30.948708 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-dfe1b019-b1fb-4e1e-91de-619420deedc2 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:30.951332 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-dfe1b019-b1fb-4e1e-91de-619420deedc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:31.048636 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d71e4f-8175-4a74-a2c5-977baaffc76f None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:31.048911 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d71e4f-8175-4a74-a2c5-977baaffc76f None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:31.049314 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d71e4f-8175-4a74-a2c5-977baaffc76f None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:31.051101 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 508/1009] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 03:57:31.055340 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 502/1010] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:30 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:57:31.059020 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c2ec1-a088-47fd-9674-4fd46bda68f2 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:31.059511 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c2ec1-a088-47fd-9674-4fd46bda68f2 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:31.060031 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c2ec1-a088-47fd-9674-4fd46bda68f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:31.080015 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1b019-b1fb-4e1e-91de-619420deedc2 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:31.083218 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-809c2ec1-a088-47fd-9674-4fd46bda68f2 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:31.084469 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-809c2ec1-a088-47fd-9674-4fd46bda68f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:31.161070 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 509/1011] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:31 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:57:31.183521 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c2ec1-a088-47fd-9674-4fd46bda68f2 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:31.184012 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1b019-b1fb-4e1e-91de-619420deedc2 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:31.218232 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bd2f8-3bc2-4331-a0b9-cf937508a45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:31.219025 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bd2f8-3bc2-4331-a0b9-cf937508a45f None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:31.219304 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bd2f8-3bc2-4331-a0b9-cf937508a45f None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:31.219579 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bd2f8-3bc2-4331-a0b9-cf937508a45f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:31.220773 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6bd2f8-3bc2-4331-a0b9-cf937508a45f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:31.222203 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6bd2f8-3bc2-4331-a0b9-cf937508a45f None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:31.224104 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 503/1012] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:57:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:31.229342 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bd2f8-3bc2-4331-a0b9-cf937508a45f None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:31.288417 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c2ec1-a088-47fd-9674-4fd46bda68f2 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:31.320796 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2766f7e-4a80-4cc1-bfa1-b1936c3d9835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:31.321581 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2766f7e-4a80-4cc1-bfa1-b1936c3d9835 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:31.321887 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2766f7e-4a80-4cc1-bfa1-b1936c3d9835 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:31.322159 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2766f7e-4a80-4cc1-bfa1-b1936c3d9835 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:31.322798 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2766f7e-4a80-4cc1-bfa1-b1936c3d9835 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:31.324199 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2766f7e-4a80-4cc1-bfa1-b1936c3d9835 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:31.325991 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bd2f8-3bc2-4331-a0b9-cf937508a45f None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:31.336825 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-b2766f7e-4a80-4cc1-bfa1-b1936c3d9835 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 10 03:57:31.338202 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 510/1013] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:57:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:57:31.343986 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2766f7e-4a80-4cc1-bfa1-b1936c3d9835 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:31.364654 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc17431-16ef-4df4-bf5d-46a4071840af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:31.365332 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc17431-16ef-4df4-bf5d-46a4071840af None admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:31.365616 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc17431-16ef-4df4-bf5d-46a4071840af None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:31.365898 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc17431-16ef-4df4-bf5d-46a4071840af None admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:31.366654 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc17431-16ef-4df4-bf5d-46a4071840af None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:31.368093 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc17431-16ef-4df4-bf5d-46a4071840af None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:31.403721 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 504/1014] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Mar 10 03:57:31 2022] POST /identity/v3/projects => generated 311 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 03:57:31.456043 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2766f7e-4a80-4cc1-bfa1-b1936c3d9835 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:31.456422 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4c4be-f2fe-459c-a724-45a99d364cd9 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:31.456714 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4c4be-f2fe-459c-a724-45a99d364cd9 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:31.456996 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4c4be-f2fe-459c-a724-45a99d364cd9 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:31.458837 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 505/1015] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 03:57:31.464673 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6883b0a-01e3-475b-a57c-03da800af567 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:31.464961 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6883b0a-01e3-475b-a57c-03da800af567 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:31.465245 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6883b0a-01e3-475b-a57c-03da800af567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:31.483181 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-b6883b0a-01e3-475b-a57c-03da800af567 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:31.484436 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-b6883b0a-01e3-475b-a57c-03da800af567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:31.492339 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c526521-949d-44c4-81fd-6bfef7a28097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:31.493022 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c526521-949d-44c4-81fd-6bfef7a28097 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:31.493308 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c526521-949d-44c4-81fd-6bfef7a28097 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:31.493590 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c526521-949d-44c4-81fd-6bfef7a28097 None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:31.494311 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c526521-949d-44c4-81fd-6bfef7a28097 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:31.494626 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c526521-949d-44c4-81fd-6bfef7a28097 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:31.496295 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c526521-949d-44c4-81fd-6bfef7a28097 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:31.501761 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 511/1016] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Mar 10 03:57:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:31.507447 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c526521-949d-44c4-81fd-6bfef7a28097 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:31.558371 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 506/1017] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:31 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 03:57:31.582649 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6883b0a-01e3-475b-a57c-03da800af567 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:31.613044 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c526521-949d-44c4-81fd-6bfef7a28097 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:31.648423 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b461f-eacf-43a7-a275-d9c99426079c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:31.649085 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b461f-eacf-43a7-a275-d9c99426079c None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:31.649362 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b461f-eacf-43a7-a275-d9c99426079c None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:31.649633 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b461f-eacf-43a7-a275-d9c99426079c None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:31.650328 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b461f-eacf-43a7-a275-d9c99426079c None admin] RBAC: Adding query filter params (type=compute) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:31.650631 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b461f-eacf-43a7-a275-d9c99426079c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:31.652027 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b461f-eacf-43a7-a275-d9c99426079c None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:31.656957 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 512/1018] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Mar 10 03:57:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:31.662264 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b461f-eacf-43a7-a275-d9c99426079c None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:31.691077 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6883b0a-01e3-475b-a57c-03da800af567 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:31.726720 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe14705-9980-47a7-9fd2-fa710bca92cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:31.727442 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe14705-9980-47a7-9fd2-fa710bca92cb None admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:31.727754 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe14705-9980-47a7-9fd2-fa710bca92cb None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:31.728038 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe14705-9980-47a7-9fd2-fa710bca92cb None admin] PATH_INFO: `/v3/services` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:31.728760 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe14705-9980-47a7-9fd2-fa710bca92cb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:31.730165 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe14705-9980-47a7-9fd2-fa710bca92cb None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:31.744337 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 507/1019] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Mar 10 03:57:31 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 03:57:31.759840 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b461f-eacf-43a7-a275-d9c99426079c None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:31.802474 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd9b75-283b-4ebd-9568-3f3ad400e097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:31.803150 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd9b75-283b-4ebd-9568-3f3ad400e097 None admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:31.803425 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd9b75-283b-4ebd-9568-3f3ad400e097 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:31.803773 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd9b75-283b-4ebd-9568-3f3ad400e097 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:31.804530 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd9b75-283b-4ebd-9568-3f3ad400e097 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:31.805948 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd9b75-283b-4ebd-9568-3f3ad400e097 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:31.831557 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 513/1020] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Mar 10 03:57:31 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 03:57:33.765760 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179ac6c-5536-4b7b-b0c6-fb2dbdd1cc21 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:33.766313 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179ac6c-5536-4b7b-b0c6-fb2dbdd1cc21 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:33.766392 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179ac6c-5536-4b7b-b0c6-fb2dbdd1cc21 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:33.768313 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 508/1021] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:33.773558 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93080d-7c57-423a-8ece-09cd1461759e None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:33.773984 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93080d-7c57-423a-8ece-09cd1461759e None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:33.774153 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93080d-7c57-423a-8ece-09cd1461759e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:33.790828 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-1d93080d-7c57-423a-8ece-09cd1461759e None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:33.792180 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-1d93080d-7c57-423a-8ece-09cd1461759e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:33.864970 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 514/1022] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:57:33.889371 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179ac6c-5536-4b7b-b0c6-fb2dbdd1cc21 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:33.992512 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179ac6c-5536-4b7b-b0c6-fb2dbdd1cc21 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:34.025021 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452601d9-4e49-43ee-b8c3-a1b857d5a668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:34.025736 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452601d9-4e49-43ee-b8c3-a1b857d5a668 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:34.026020 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452601d9-4e49-43ee-b8c3-a1b857d5a668 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:34.026297 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452601d9-4e49-43ee-b8c3-a1b857d5a668 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:34.027463 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452601d9-4e49-43ee-b8c3-a1b857d5a668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:34.028912 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452601d9-4e49-43ee-b8c3-a1b857d5a668 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:34.035537 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 509/1023] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:57:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:34.037092 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93080d-7c57-423a-8ece-09cd1461759e None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:34.117070 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af05b0-4fce-4e13-93f2-a5ec0ad68023 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:34.117365 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af05b0-4fce-4e13-93f2-a5ec0ad68023 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:34.117653 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af05b0-4fce-4e13-93f2-a5ec0ad68023 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:34.119603 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 510/1024] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:34.124768 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3823b-97e4-4e92-b319-fc41e7b453eb None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:34.125060 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3823b-97e4-4e92-b319-fc41e7b453eb None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:34.125344 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3823b-97e4-4e92-b319-fc41e7b453eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:34.134165 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93080d-7c57-423a-8ece-09cd1461759e None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:34.144923 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-48a3823b-97e4-4e92-b319-fc41e7b453eb None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:34.146100 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-48a3823b-97e4-4e92-b319-fc41e7b453eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:34.169222 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d33e0-aeef-460c-ab86-2eb8ecfc69d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:34.169885 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d33e0-aeef-460c-ab86-2eb8ecfc69d5 None admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:34.170164 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d33e0-aeef-460c-ab86-2eb8ecfc69d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:34.170461 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d33e0-aeef-460c-ab86-2eb8ecfc69d5 None admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:34.171156 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d33e0-aeef-460c-ab86-2eb8ecfc69d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:34.173178 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d33e0-aeef-460c-ab86-2eb8ecfc69d5 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:34.195375 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 515/1025] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Mar 10 03:57:34 2022] POST /identity/v3/users => generated 285 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 03:57:34.218361 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 511/1026] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:34 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 03:57:34.241686 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d33e0-aeef-460c-ab86-2eb8ecfc69d5 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:34.280685 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd999d2-06db-497c-acf7-0f819a8fad27 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:34.281339 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd999d2-06db-497c-acf7-0f819a8fad27 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:34.282470 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd999d2-06db-497c-acf7-0f819a8fad27 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:34.284653 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 512/1027] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 03:57:34.290376 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61bbee-4bcb-4692-a82f-f1aeffb8b1e6 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:34.290663 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61bbee-4bcb-4692-a82f-f1aeffb8b1e6 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:34.290936 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61bbee-4bcb-4692-a82f-f1aeffb8b1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:34.307932 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-ab61bbee-4bcb-4692-a82f-f1aeffb8b1e6 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:34.309153 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-ab61bbee-4bcb-4692-a82f-f1aeffb8b1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:34.347439 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d33e0-aeef-460c-ab86-2eb8ecfc69d5 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:34.377693 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 513/1028] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:34 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 03:57:34.381045 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f85236-f82f-43ad-8d44-f47e4216f816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:34.381855 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f85236-f82f-43ad-8d44-f47e4216f816 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:34.382132 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f85236-f82f-43ad-8d44-f47e4216f816 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:34.382409 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f85236-f82f-43ad-8d44-f47e4216f816 None admin] PATH_INFO: `/v3/services/image` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:34.383063 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f85236-f82f-43ad-8d44-f47e4216f816 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:34.384556 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f85236-f82f-43ad-8d44-f47e4216f816 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:34.396224 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-51f85236-f82f-43ad-8d44-f47e4216f816 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 10 03:57:34.397431 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 516/1029] 10.222.0.15 () {56 vars in 1105 bytes} [Thu Mar 10 03:57:34 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:34.401421 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61bbee-4bcb-4692-a82f-f1aeffb8b1e6 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:34.403065 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f85236-f82f-43ad-8d44-f47e4216f816 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:34.503900 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f85236-f82f-43ad-8d44-f47e4216f816 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:34.506340 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61bbee-4bcb-4692-a82f-f1aeffb8b1e6 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:34.537521 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8ce50-3771-4306-9d3a-1c33b07ffccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:34.538529 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8ce50-3771-4306-9d3a-1c33b07ffccf None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:34.539000 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8ce50-3771-4306-9d3a-1c33b07ffccf None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:34.539487 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8ce50-3771-4306-9d3a-1c33b07ffccf None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:34.540529 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae63c5a-4878-49ca-9faf-1214d02059d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:34.540825 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8ce50-3771-4306-9d3a-1c33b07ffccf None admin] RBAC: Adding query filter params (name=image) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:34.541357 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae63c5a-4878-49ca-9faf-1214d02059d3 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:34.541452 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8ce50-3771-4306-9d3a-1c33b07ffccf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:34.541642 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae63c5a-4878-49ca-9faf-1214d02059d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:34.541920 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae63c5a-4878-49ca-9faf-1214d02059d3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:34.543974 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8ce50-3771-4306-9d3a-1c33b07ffccf None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:34.550121 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 517/1030] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:57:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:34.556392 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8ce50-3771-4306-9d3a-1c33b07ffccf None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:34.556574 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae63c5a-4878-49ca-9faf-1214d02059d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:57:34.564641 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-fae63c5a-4878-49ca-9faf-1214d02059d3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 10 03:57:34.570898 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 514/1031] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Mar 10 03:57:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:34.571999 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae63c5a-4878-49ca-9faf-1214d02059d3 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:34.654146 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8ce50-3771-4306-9d3a-1c33b07ffccf None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:34.668642 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae63c5a-4878-49ca-9faf-1214d02059d3 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:34.686082 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f447ac7-277c-4fff-8cb1-e24a334e5ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:34.686749 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f447ac7-277c-4fff-8cb1-e24a334e5ce1 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:34.687036 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f447ac7-277c-4fff-8cb1-e24a334e5ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:34.687314 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f447ac7-277c-4fff-8cb1-e24a334e5ce1 None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:34.688589 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f447ac7-277c-4fff-8cb1-e24a334e5ce1 None admin] RBAC: Adding query filter params (type=image) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:34.688895 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f447ac7-277c-4fff-8cb1-e24a334e5ce1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:34.690264 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f447ac7-277c-4fff-8cb1-e24a334e5ce1 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:34.699868 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 518/1032] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:57:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:34.701491 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f447ac7-277c-4fff-8cb1-e24a334e5ce1 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:34.707786 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25b43c-65e2-4d53-a7a4-9d895d310ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:34.708467 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25b43c-65e2-4d53-a7a4-9d895d310ceb None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:34.708755 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25b43c-65e2-4d53-a7a4-9d895d310ceb None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:34.709034 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25b43c-65e2-4d53-a7a4-9d895d310ceb None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:34.709787 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec25b43c-65e2-4d53-a7a4-9d895d310ceb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:34.710094 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec25b43c-65e2-4d53-a7a4-9d895d310ceb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:34.711479 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec25b43c-65e2-4d53-a7a4-9d895d310ceb None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:34.719836 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 515/1033] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Mar 10 03:57:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:34.725203 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25b43c-65e2-4d53-a7a4-9d895d310ceb None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:34.796767 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f447ac7-277c-4fff-8cb1-e24a334e5ce1 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:34.825552 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25b43c-65e2-4d53-a7a4-9d895d310ceb None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:34.831480 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18933071-d01f-41ec-a65a-e06766c81897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:34.832177 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18933071-d01f-41ec-a65a-e06766c81897 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:34.832457 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18933071-d01f-41ec-a65a-e06766c81897 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:34.832727 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18933071-d01f-41ec-a65a-e06766c81897 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:34.833543 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18933071-d01f-41ec-a65a-e06766c81897 None admin] RBAC: Adding query filter params (interface=public, service_id=bc85a90e686b4dbab2840a40b0f5c483, region_id=RegionOne) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:34.833855 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18933071-d01f-41ec-a65a-e06766c81897 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:34.835222 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18933071-d01f-41ec-a65a-e06766c81897 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:34.845068 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 519/1034] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Mar 10 03:57:34 2022] GET /identity/v3/endpoints?service_id=bc85a90e686b4dbab2840a40b0f5c483&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:34.845862 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18933071-d01f-41ec-a65a-e06766c81897 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:34.861193 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce04f2-6ae3-4e78-8077-c3b8667db9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:34.861988 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce04f2-6ae3-4e78-8077-c3b8667db9c1 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:34.862275 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce04f2-6ae3-4e78-8077-c3b8667db9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:34.862551 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce04f2-6ae3-4e78-8077-c3b8667db9c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:34.872822 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce04f2-6ae3-4e78-8077-c3b8667db9c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:34.874275 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce04f2-6ae3-4e78-8077-c3b8667db9c1 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:34.890609 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-fcce04f2-6ae3-4e78-8077-c3b8667db9c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:57:34.896932 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 516/1035] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:57:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:57:34.897966 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce04f2-6ae3-4e78-8077-c3b8667db9c1 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:34.940648 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18933071-d01f-41ec-a65a-e06766c81897 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:34.972926 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c825b-9bc0-4463-bacd-090ec9c7fc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:34.973594 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c825b-9bc0-4463-bacd-090ec9c7fc74 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:34.973880 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c825b-9bc0-4463-bacd-090ec9c7fc74 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:34.974165 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c825b-9bc0-4463-bacd-090ec9c7fc74 None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:34.974838 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c825b-9bc0-4463-bacd-090ec9c7fc74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:34.976234 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c825b-9bc0-4463-bacd-090ec9c7fc74 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:34.982659 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 520/1036] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Mar 10 03:57:34 2022] GET /identity/v3/services => generated 1957 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 03:57:35.004772 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce04f2-6ae3-4e78-8077-c3b8667db9c1 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:35.039959 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc268069-549e-4c12-b971-76a82d11ad59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:35.040645 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc268069-549e-4c12-b971-76a82d11ad59 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:35.040929 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc268069-549e-4c12-b971-76a82d11ad59 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:35.041207 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc268069-549e-4c12-b971-76a82d11ad59 None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:35.041945 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc268069-549e-4c12-b971-76a82d11ad59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:35.042250 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc268069-549e-4c12-b971-76a82d11ad59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:35.043666 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc268069-549e-4c12-b971-76a82d11ad59 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:35.058548 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 517/1037] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:35.065259 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c825b-9bc0-4463-bacd-090ec9c7fc74 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:35.170082 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c825b-9bc0-4463-bacd-090ec9c7fc74 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:35.204856 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732301d6-211e-4af1-b729-21f0be8d7840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:35.205654 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732301d6-211e-4af1-b729-21f0be8d7840 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:35.205937 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732301d6-211e-4af1-b729-21f0be8d7840 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:35.206214 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732301d6-211e-4af1-b729-21f0be8d7840 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:35.213717 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732301d6-211e-4af1-b729-21f0be8d7840 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:35.215158 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732301d6-211e-4af1-b729-21f0be8d7840 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:35.228348 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-732301d6-211e-4af1-b729-21f0be8d7840 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 10 03:57:35.229755 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 521/1038] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Mar 10 03:57:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:57:35.235784 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc268069-549e-4c12-b971-76a82d11ad59 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:35.331612 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc268069-549e-4c12-b971-76a82d11ad59 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:35.365404 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66283c94-d5c2-4662-807f-a7ac05965122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:35.366081 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66283c94-d5c2-4662-807f-a7ac05965122 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:35.366364 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66283c94-d5c2-4662-807f-a7ac05965122 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:35.366643 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66283c94-d5c2-4662-807f-a7ac05965122 None admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:35.367487 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66283c94-d5c2-4662-807f-a7ac05965122 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:35.367825 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66283c94-d5c2-4662-807f-a7ac05965122 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:35.369261 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66283c94-d5c2-4662-807f-a7ac05965122 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:35.391002 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 518/1039] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Mar 10 03:57:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:35.392737 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732301d6-211e-4af1-b729-21f0be8d7840 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:35.490008 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732301d6-211e-4af1-b729-21f0be8d7840 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:35.521152 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c318e-9b91-4131-bd15-156386957bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:35.521798 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c318e-9b91-4131-bd15-156386957bdc None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:35.522079 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c318e-9b91-4131-bd15-156386957bdc None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:35.522353 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c318e-9b91-4131-bd15-156386957bdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:35.585770 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c318e-9b91-4131-bd15-156386957bdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:35.587157 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c318e-9b91-4131-bd15-156386957bdc None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:35.683555 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 522/1040] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:57:35 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 03:57:35.688702 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66283c94-d5c2-4662-807f-a7ac05965122 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:35.783928 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66283c94-d5c2-4662-807f-a7ac05965122 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:35.816773 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784a989-2b87-4df7-96a0-07452d98d7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:35.817578 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784a989-2b87-4df7-96a0-07452d98d7d2 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:35.817862 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784a989-2b87-4df7-96a0-07452d98d7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:35.818140 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784a989-2b87-4df7-96a0-07452d98d7d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:35.828039 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784a989-2b87-4df7-96a0-07452d98d7d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:35.830013 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784a989-2b87-4df7-96a0-07452d98d7d2 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:35.847458 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-1784a989-2b87-4df7-96a0-07452d98d7d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:57:35.848837 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 519/1041] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:57:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:57:35.854182 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c318e-9b91-4131-bd15-156386957bdc None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:35.947556 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c318e-9b91-4131-bd15-156386957bdc None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:35.981362 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec606b-2cfa-4196-b29b-18dd97dfd57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:35.982032 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec606b-2cfa-4196-b29b-18dd97dfd57d None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:35.982318 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec606b-2cfa-4196-b29b-18dd97dfd57d None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:35.982598 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec606b-2cfa-4196-b29b-18dd97dfd57d None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:35.983326 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec606b-2cfa-4196-b29b-18dd97dfd57d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:35.983626 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec606b-2cfa-4196-b29b-18dd97dfd57d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:35.985114 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec606b-2cfa-4196-b29b-18dd97dfd57d None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:36.001374 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 523/1042] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:36.003042 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784a989-2b87-4df7-96a0-07452d98d7d2 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:36.105981 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784a989-2b87-4df7-96a0-07452d98d7d2 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:36.143324 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae7712-edf3-4713-9838-e03564b68819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:36.144161 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae7712-edf3-4713-9838-e03564b68819 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:36.144445 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae7712-edf3-4713-9838-e03564b68819 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:36.144723 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae7712-edf3-4713-9838-e03564b68819 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:36.151637 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cae7712-edf3-4713-9838-e03564b68819 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:36.153120 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cae7712-edf3-4713-9838-e03564b68819 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:36.167162 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-3cae7712-edf3-4713-9838-e03564b68819 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:57:36.168532 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 520/1043] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:57:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:36.174240 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec606b-2cfa-4196-b29b-18dd97dfd57d None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:36.278069 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec606b-2cfa-4196-b29b-18dd97dfd57d None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:36.310334 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242353f-0627-4030-9e87-2cde16fc0c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:36.310987 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242353f-0627-4030-9e87-2cde16fc0c7b None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:36.311270 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242353f-0627-4030-9e87-2cde16fc0c7b None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:36.311545 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242353f-0627-4030-9e87-2cde16fc0c7b None admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:36.312350 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242353f-0627-4030-9e87-2cde16fc0c7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:36.313201 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242353f-0627-4030-9e87-2cde16fc0c7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:36.314651 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242353f-0627-4030-9e87-2cde16fc0c7b None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:36.334031 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 524/1044] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:57:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:36.334215 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae7712-edf3-4713-9838-e03564b68819 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:36.430436 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae7712-edf3-4713-9838-e03564b68819 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:36.463116 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ce465-77ad-4b78-b768-c165f9084faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:36.463807 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ce465-77ad-4b78-b768-c165f9084faf None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:36.464094 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ce465-77ad-4b78-b768-c165f9084faf None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:36.464372 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ce465-77ad-4b78-b768-c165f9084faf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:36.465197 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ce465-77ad-4b78-b768-c165f9084faf None admin] RBAC: Adding query filter params (role.id=0bfe9ff936144b8987acb9d8a5188913, scope.project.id=0846fccaeb674395a87e45290eda74b7, user.id=fbd92bd14ed04621af06d68161798fe3) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:36.465515 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ce465-77ad-4b78-b768-c165f9084faf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:36.466949 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ce465-77ad-4b78-b768-c165f9084faf None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:36.479991 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 521/1045] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:57:36 2022] GET /identity/v3/role_assignments?user.id=fbd92bd14ed04621af06d68161798fe3&scope.project.id=0846fccaeb674395a87e45290eda74b7&role.id=0bfe9ff936144b8987acb9d8a5188913 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:36.580217 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c91c9f-d5d3-49f7-b4fb-2496cafc6a14 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:36.580563 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c91c9f-d5d3-49f7-b4fb-2496cafc6a14 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:36.580773 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c91c9f-d5d3-49f7-b4fb-2496cafc6a14 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:36.582803 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 525/1046] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:36.588336 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e499a3-28e6-4b44-8c7e-fa321b12f5e2 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:36.588628 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e499a3-28e6-4b44-8c7e-fa321b12f5e2 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:36.588895 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e499a3-28e6-4b44-8c7e-fa321b12f5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:36.606354 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-67e499a3-28e6-4b44-8c7e-fa321b12f5e2 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:36.607577 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-67e499a3-28e6-4b44-8c7e-fa321b12f5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:36.678636 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 522/1047] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:57:36.702536 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c91c9f-d5d3-49f7-b4fb-2496cafc6a14 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:36.800110 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c91c9f-d5d3-49f7-b4fb-2496cafc6a14 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:36.835121 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea640575-5fc4-4aa2-ab0e-4ab16a8ebfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:36.835911 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea640575-5fc4-4aa2-ab0e-4ab16a8ebfac None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:36.836192 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea640575-5fc4-4aa2-ab0e-4ab16a8ebfac None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:36.836464 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea640575-5fc4-4aa2-ab0e-4ab16a8ebfac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:36.846599 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea640575-5fc4-4aa2-ab0e-4ab16a8ebfac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:57:36.853459 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-ea640575-5fc4-4aa2-ab0e-4ab16a8ebfac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 03:57:36.859631 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 526/1048] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:57:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:36.861672 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e499a3-28e6-4b44-8c7e-fa321b12f5e2 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:36.960695 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e499a3-28e6-4b44-8c7e-fa321b12f5e2 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:36.993784 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ab558-2680-4539-ad97-a3f5e8efffab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:36.994533 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ab558-2680-4539-ad97-a3f5e8efffab None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:36.994907 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ab558-2680-4539-ad97-a3f5e8efffab None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:36.995244 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ab558-2680-4539-ad97-a3f5e8efffab None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:36.996088 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ab558-2680-4539-ad97-a3f5e8efffab None admin] RBAC: Adding query filter params (name=admin) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:36.996455 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ab558-2680-4539-ad97-a3f5e8efffab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:36.997932 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ab558-2680-4539-ad97-a3f5e8efffab None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:37.011387 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 523/1049] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:57:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:37.012920 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea640575-5fc4-4aa2-ab0e-4ab16a8ebfac None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:37.108617 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea640575-5fc4-4aa2-ab0e-4ab16a8ebfac None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:37.144360 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe2110-c3d9-4a99-8485-4db8bd58481a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:37.145319 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe2110-c3d9-4a99-8485-4db8bd58481a None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:37.145665 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe2110-c3d9-4a99-8485-4db8bd58481a None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:37.146001 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe2110-c3d9-4a99-8485-4db8bd58481a None admin] PATH_INFO: `/v3/users/46feaa7825be433080ead2a7f2780196` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:37.160308 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe2110-c3d9-4a99-8485-4db8bd58481a None admin] RBAC: Authorizing `identity:get_user(user_id=46feaa7825be433080ead2a7f2780196)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:37.161841 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe2110-c3d9-4a99-8485-4db8bd58481a None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:37.168129 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 527/1050] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:57:37 2022] GET /identity/v3/users/46feaa7825be433080ead2a7f2780196 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:37.169760 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ab558-2680-4539-ad97-a3f5e8efffab None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:37.267440 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ab558-2680-4539-ad97-a3f5e8efffab None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:37.300275 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669759fb-af97-4214-a0f3-c2186979f26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:37.300930 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669759fb-af97-4214-a0f3-c2186979f26f None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:37.301213 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669759fb-af97-4214-a0f3-c2186979f26f None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:37.301491 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669759fb-af97-4214-a0f3-c2186979f26f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:37.306101 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9017f-6082-4ca5-995d-dbc083c6fb60 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:37.306388 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9017f-6082-4ca5-995d-dbc083c6fb60 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:37.306664 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9017f-6082-4ca5-995d-dbc083c6fb60 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:37.308597 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 528/1051] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 03:57:37.313379 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a516e4-2768-42b3-a34b-f8c4d714d196 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:37.313666 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a516e4-2768-42b3-a34b-f8c4d714d196 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:37.314187 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a516e4-2768-42b3-a34b-f8c4d714d196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:37.330818 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-78a516e4-2768-42b3-a34b-f8c4d714d196 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:37.332030 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-78a516e4-2768-42b3-a34b-f8c4d714d196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:37.369977 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669759fb-af97-4214-a0f3-c2186979f26f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:37.371425 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669759fb-af97-4214-a0f3-c2186979f26f None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:37.397318 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 529/1052] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 03:57:37.420873 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a516e4-2768-42b3-a34b-f8c4d714d196 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:37.467149 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 524/1053] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:57:37 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 10 03:57:37.473256 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669759fb-af97-4214-a0f3-c2186979f26f None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:37.524683 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a516e4-2768-42b3-a34b-f8c4d714d196 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:37.559101 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd8ef7-4904-4015-853f-5a3b8a57267f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:37.560004 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd8ef7-4904-4015-853f-5a3b8a57267f None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:37.560290 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd8ef7-4904-4015-853f-5a3b8a57267f None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:37.560562 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd8ef7-4904-4015-853f-5a3b8a57267f None admin] PATH_INFO: `/v3/services/image` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:37.561212 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd8ef7-4904-4015-853f-5a3b8a57267f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:37.563111 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd8ef7-4904-4015-853f-5a3b8a57267f None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:37.570587 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669759fb-af97-4214-a0f3-c2186979f26f None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:37.574432 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-d0fd8ef7-4904-4015-853f-5a3b8a57267f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 10 03:57:37.575875 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 530/1054] 10.222.0.15 () {56 vars in 1105 bytes} [Thu Mar 10 03:57:37 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:57:37.582158 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd8ef7-4904-4015-853f-5a3b8a57267f None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:37.606592 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c7d23-92a8-4d27-95a9-fa6f9f093913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:37.607463 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c7d23-92a8-4d27-95a9-fa6f9f093913 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:37.607777 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c7d23-92a8-4d27-95a9-fa6f9f093913 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:37.608057 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c7d23-92a8-4d27-95a9-fa6f9f093913 None admin] PATH_INFO: `/v3/projects/02e045f14ad04b56990f84b5263a54b8` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:37.609249 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c7d23-92a8-4d27-95a9-fa6f9f093913 None admin] RBAC: Authorizing `identity:get_project(project_id=02e045f14ad04b56990f84b5263a54b8)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:37.610752 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c7d23-92a8-4d27-95a9-fa6f9f093913 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:37.617477 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 525/1055] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:57:37 2022] GET /identity/v3/projects/02e045f14ad04b56990f84b5263a54b8 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:37.618397 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c7d23-92a8-4d27-95a9-fa6f9f093913 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:37.684147 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd8ef7-4904-4015-853f-5a3b8a57267f None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:37.714480 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c7d23-92a8-4d27-95a9-fa6f9f093913 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:37.717248 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371cef8-370b-4fd8-a31c-41f0d8b094b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:37.718181 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371cef8-370b-4fd8-a31c-41f0d8b094b5 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:37.718659 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371cef8-370b-4fd8-a31c-41f0d8b094b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:37.719143 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371cef8-370b-4fd8-a31c-41f0d8b094b5 None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:37.720062 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371cef8-370b-4fd8-a31c-41f0d8b094b5 None admin] RBAC: Adding query filter params (name=image) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:37.720560 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371cef8-370b-4fd8-a31c-41f0d8b094b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:37.722124 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371cef8-370b-4fd8-a31c-41f0d8b094b5 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:37.727786 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 531/1056] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:57:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:37.733099 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371cef8-370b-4fd8-a31c-41f0d8b094b5 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:37.747360 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633691c-8102-47c1-91e7-a8653da1014f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:37.748053 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633691c-8102-47c1-91e7-a8653da1014f None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:37.748339 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633691c-8102-47c1-91e7-a8653da1014f None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:37.748617 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633691c-8102-47c1-91e7-a8653da1014f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:37.749442 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633691c-8102-47c1-91e7-a8653da1014f None admin] RBAC: Adding query filter params (role.id=a8b2a5887cec4a31b7304792af3dd3f1, scope.project.id=02e045f14ad04b56990f84b5263a54b8, user.id=46feaa7825be433080ead2a7f2780196) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:37.749755 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633691c-8102-47c1-91e7-a8653da1014f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:37.751728 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633691c-8102-47c1-91e7-a8653da1014f None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:37.759743 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 526/1057] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:57:37 2022] GET /identity/v3/role_assignments?user.id=46feaa7825be433080ead2a7f2780196&scope.project.id=02e045f14ad04b56990f84b5263a54b8&role.id=a8b2a5887cec4a31b7304792af3dd3f1 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:37.838736 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371cef8-370b-4fd8-a31c-41f0d8b094b5 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:37.872950 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017883c-16d6-4966-b016-a77d443742ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:37.873718 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017883c-16d6-4966-b016-a77d443742ff None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:37.873906 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017883c-16d6-4966-b016-a77d443742ff None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:37.874184 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017883c-16d6-4966-b016-a77d443742ff None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:37.874898 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017883c-16d6-4966-b016-a77d443742ff None admin] RBAC: Adding query filter params (type=image) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:37.875770 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017883c-16d6-4966-b016-a77d443742ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:37.877151 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017883c-16d6-4966-b016-a77d443742ff None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:37.887384 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 532/1058] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:57:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:37.888505 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633691c-8102-47c1-91e7-a8653da1014f None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:37.988622 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633691c-8102-47c1-91e7-a8653da1014f None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:38.021505 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b3db0-599a-4043-8cdb-801314aec455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:38.022167 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b3db0-599a-4043-8cdb-801314aec455 None admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:38.022447 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b3db0-599a-4043-8cdb-801314aec455 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:38.022722 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b3db0-599a-4043-8cdb-801314aec455 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:38.023521 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b3db0-599a-4043-8cdb-801314aec455 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:38.024876 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b3db0-599a-4043-8cdb-801314aec455 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:38.044050 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 527/1059] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Mar 10 03:57:37 2022] POST /identity/v3/endpoints => generated 327 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 03:57:38.774042 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63d622-18e7-4b23-9a72-7f9d09b0cbe3 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:38.774441 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63d622-18e7-4b23-9a72-7f9d09b0cbe3 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:38.774616 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63d622-18e7-4b23-9a72-7f9d09b0cbe3 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:38.776529 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 533/1060] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:38.781655 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec4e22-9fb8-429c-8274-2d42141020eb None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:38.781946 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec4e22-9fb8-429c-8274-2d42141020eb None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:38.782225 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec4e22-9fb8-429c-8274-2d42141020eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:38.799007 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-91ec4e22-9fb8-429c-8274-2d42141020eb None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:38.800200 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-91ec4e22-9fb8-429c-8274-2d42141020eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:38.870714 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 528/1061] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:57:38.893186 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63d622-18e7-4b23-9a72-7f9d09b0cbe3 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:38.992284 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63d622-18e7-4b23-9a72-7f9d09b0cbe3 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:39.024349 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e34248-8067-4c0a-926f-32b966daee9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:39.025077 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e34248-8067-4c0a-926f-32b966daee9a None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:39.025355 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e34248-8067-4c0a-926f-32b966daee9a None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:39.025621 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e34248-8067-4c0a-926f-32b966daee9a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:39.035791 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e34248-8067-4c0a-926f-32b966daee9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:57:39.043401 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-87e34248-8067-4c0a-926f-32b966daee9a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 10 03:57:39.045190 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 534/1062] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Mar 10 03:57:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:39.051296 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec4e22-9fb8-429c-8274-2d42141020eb None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:39.148605 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec4e22-9fb8-429c-8274-2d42141020eb None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:39.181980 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816835aa-4c38-470e-b8a1-ed8c3c7db64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:39.182645 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816835aa-4c38-470e-b8a1-ed8c3c7db64a None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:39.182927 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816835aa-4c38-470e-b8a1-ed8c3c7db64a None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:39.183202 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816835aa-4c38-470e-b8a1-ed8c3c7db64a None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:39.183973 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816835aa-4c38-470e-b8a1-ed8c3c7db64a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:39.184279 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816835aa-4c38-470e-b8a1-ed8c3c7db64a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:39.185651 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816835aa-4c38-470e-b8a1-ed8c3c7db64a None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:39.198762 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 529/1063] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Mar 10 03:57:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:39.200033 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e34248-8067-4c0a-926f-32b966daee9a None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:39.296860 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e34248-8067-4c0a-926f-32b966daee9a None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:39.329430 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa47ffc-a286-40af-8a13-b61920674ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:39.330251 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa47ffc-a286-40af-8a13-b61920674ff6 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:39.330535 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa47ffc-a286-40af-8a13-b61920674ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:39.330810 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa47ffc-a286-40af-8a13-b61920674ff6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:39.341231 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa47ffc-a286-40af-8a13-b61920674ff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:39.342676 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa47ffc-a286-40af-8a13-b61920674ff6 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:39.360009 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-7fa47ffc-a286-40af-8a13-b61920674ff6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:57:39.361380 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 535/1064] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:57:39.366868 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816835aa-4c38-470e-b8a1-ed8c3c7db64a None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:39.463302 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816835aa-4c38-470e-b8a1-ed8c3c7db64a None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:39.496552 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1e2d5-2a42-423d-b94f-0d9ee92846b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:39.497370 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1e2d5-2a42-423d-b94f-0d9ee92846b9 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:39.497756 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1e2d5-2a42-423d-b94f-0d9ee92846b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:39.498157 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed1e2d5-2a42-423d-b94f-0d9ee92846b9 None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:39.498983 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1e2d5-2a42-423d-b94f-0d9ee92846b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:39.499390 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1e2d5-2a42-423d-b94f-0d9ee92846b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:39.500936 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed1e2d5-2a42-423d-b94f-0d9ee92846b9 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:39.513832 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 530/1065] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:39.519710 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa47ffc-a286-40af-8a13-b61920674ff6 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:39.616190 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa47ffc-a286-40af-8a13-b61920674ff6 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:39.648665 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01b05a-7d4a-4537-b798-10a8c2255c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:39.649462 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01b05a-7d4a-4537-b798-10a8c2255c33 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:39.649748 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01b05a-7d4a-4537-b798-10a8c2255c33 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:39.650024 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01b05a-7d4a-4537-b798-10a8c2255c33 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:39.658218 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01b05a-7d4a-4537-b798-10a8c2255c33 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:39.659655 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01b05a-7d4a-4537-b798-10a8c2255c33 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:39.673146 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-7d01b05a-7d4a-4537-b798-10a8c2255c33 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 10 03:57:39.674505 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 536/1066] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Mar 10 03:57:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:39.680044 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1e2d5-2a42-423d-b94f-0d9ee92846b9 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:39.780762 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed1e2d5-2a42-423d-b94f-0d9ee92846b9 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:39.814005 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201fbcd-7d4e-417a-a0b8-5b3eb5ad3f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:39.814675 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201fbcd-7d4e-417a-a0b8-5b3eb5ad3f50 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:39.814955 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201fbcd-7d4e-417a-a0b8-5b3eb5ad3f50 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:39.815229 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201fbcd-7d4e-417a-a0b8-5b3eb5ad3f50 None admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:39.816079 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201fbcd-7d4e-417a-a0b8-5b3eb5ad3f50 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:39.816384 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201fbcd-7d4e-417a-a0b8-5b3eb5ad3f50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:39.818057 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201fbcd-7d4e-417a-a0b8-5b3eb5ad3f50 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:39.840167 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 531/1067] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Mar 10 03:57:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:39.841463 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01b05a-7d4a-4537-b798-10a8c2255c33 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:39.936701 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01b05a-7d4a-4537-b798-10a8c2255c33 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:39.969693 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec626d2-33c2-49c4-b9c2-408ad82b3b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:39.970492 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec626d2-33c2-49c4-b9c2-408ad82b3b57 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:39.970777 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec626d2-33c2-49c4-b9c2-408ad82b3b57 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:39.971055 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec626d2-33c2-49c4-b9c2-408ad82b3b57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:39.981462 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec626d2-33c2-49c4-b9c2-408ad82b3b57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:39.982916 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec626d2-33c2-49c4-b9c2-408ad82b3b57 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:39.999433 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-7ec626d2-33c2-49c4-b9c2-408ad82b3b57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:57:40.001376 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 537/1068] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:40.006988 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201fbcd-7d4e-417a-a0b8-5b3eb5ad3f50 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:40.096792 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bf98b-6c19-4bcb-9f5e-c3d47bb7c050 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:40.097119 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bf98b-6c19-4bcb-9f5e-c3d47bb7c050 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:40.097350 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bf98b-6c19-4bcb-9f5e-c3d47bb7c050 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:40.099207 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 538/1069] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:40.104645 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7013a-ccf9-4021-aa02-6db128996a7e None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:40.104933 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7013a-ccf9-4021-aa02-6db128996a7e None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:40.105213 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b7013a-ccf9-4021-aa02-6db128996a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:40.109089 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201fbcd-7d4e-417a-a0b8-5b3eb5ad3f50 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:40.124575 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-a6b7013a-ccf9-4021-aa02-6db128996a7e None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:40.126268 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-a6b7013a-ccf9-4021-aa02-6db128996a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:40.144378 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db38516-333e-4eef-b7ba-d8652830c00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:40.145048 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db38516-333e-4eef-b7ba-d8652830c00c None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:40.145328 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db38516-333e-4eef-b7ba-d8652830c00c None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:40.145601 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db38516-333e-4eef-b7ba-d8652830c00c None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:40.146322 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db38516-333e-4eef-b7ba-d8652830c00c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:40.146858 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db38516-333e-4eef-b7ba-d8652830c00c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:40.148052 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db38516-333e-4eef-b7ba-d8652830c00c None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:40.159276 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 532/1070] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:40.164552 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db38516-333e-4eef-b7ba-d8652830c00c None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:40.198144 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 539/1071] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 03:57:40.220816 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7013a-ccf9-4021-aa02-6db128996a7e None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:40.263225 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db38516-333e-4eef-b7ba-d8652830c00c None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:40.297418 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bbb47-ab91-43ee-a95c-1c7cd7a09fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:40.298214 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bbb47-ab91-43ee-a95c-1c7cd7a09fb8 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:40.298502 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bbb47-ab91-43ee-a95c-1c7cd7a09fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:40.298779 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bbb47-ab91-43ee-a95c-1c7cd7a09fb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:40.305594 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2bbb47-ab91-43ee-a95c-1c7cd7a09fb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:40.307030 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2bbb47-ab91-43ee-a95c-1c7cd7a09fb8 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:40.316945 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b7013a-ccf9-4021-aa02-6db128996a7e None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:40.321439 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-be2bbb47-ab91-43ee-a95c-1c7cd7a09fb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:57:40.322799 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 533/1072] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:57:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:57:40.328387 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bbb47-ab91-43ee-a95c-1c7cd7a09fb8 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:40.351312 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f47b20-a8ee-4dd8-8e11-8ffa3bc7bbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:40.352147 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f47b20-a8ee-4dd8-8e11-8ffa3bc7bbfa None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:40.352493 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f47b20-a8ee-4dd8-8e11-8ffa3bc7bbfa None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:40.352772 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f47b20-a8ee-4dd8-8e11-8ffa3bc7bbfa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:40.363585 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f47b20-a8ee-4dd8-8e11-8ffa3bc7bbfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:57:40.370686 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-e8f47b20-a8ee-4dd8-8e11-8ffa3bc7bbfa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 03:57:40.375723 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 540/1073] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:57:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:57:40.378627 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f47b20-a8ee-4dd8-8e11-8ffa3bc7bbfa None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:40.428601 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bbb47-ab91-43ee-a95c-1c7cd7a09fb8 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:40.461418 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22da63-bd43-4225-b18c-cb08d5529841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:40.462000 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22da63-bd43-4225-b18c-cb08d5529841 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:40.462280 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22da63-bd43-4225-b18c-cb08d5529841 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:40.462551 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22da63-bd43-4225-b18c-cb08d5529841 None admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:40.463324 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22da63-bd43-4225-b18c-cb08d5529841 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:40.463625 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22da63-bd43-4225-b18c-cb08d5529841 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:40.465065 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22da63-bd43-4225-b18c-cb08d5529841 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:40.471886 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f47b20-a8ee-4dd8-8e11-8ffa3bc7bbfa None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:40.476054 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 534/1074] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:57:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:40.477289 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4cc03d-2c9a-447e-83a3-96d110ece5aa None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:40.477575 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4cc03d-2c9a-447e-83a3-96d110ece5aa None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:40.477851 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4cc03d-2c9a-447e-83a3-96d110ece5aa None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:40.479621 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 535/1075] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:40.481847 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4cc03d-2c9a-447e-83a3-96d110ece5aa None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:40.507071 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819155d-d171-4674-925c-a9ce6cc22b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:40.507760 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819155d-d171-4674-925c-a9ce6cc22b54 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:40.508047 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819155d-d171-4674-925c-a9ce6cc22b54 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:40.508322 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819155d-d171-4674-925c-a9ce6cc22b54 None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:40.509068 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819155d-d171-4674-925c-a9ce6cc22b54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:40.509372 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819155d-d171-4674-925c-a9ce6cc22b54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:40.510751 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819155d-d171-4674-925c-a9ce6cc22b54 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:40.518564 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 541/1076] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:57:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:40.519772 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a206cc-2e76-4b08-9b10-08e9c48690b2 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:40.520068 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a206cc-2e76-4b08-9b10-08e9c48690b2 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:40.520350 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a206cc-2e76-4b08-9b10-08e9c48690b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:40.536034 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-37a206cc-2e76-4b08-9b10-08e9c48690b2 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:40.537231 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-37a206cc-2e76-4b08-9b10-08e9c48690b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:40.583340 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4cc03d-2c9a-447e-83a3-96d110ece5aa None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:40.601415 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 542/1077] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:57:40.608583 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a206cc-2e76-4b08-9b10-08e9c48690b2 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:40.616342 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b365dd5-92ae-42c1-95c3-1e476f7831fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:40.617239 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b365dd5-92ae-42c1-95c3-1e476f7831fd None admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:40.617522 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b365dd5-92ae-42c1-95c3-1e476f7831fd None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:40.617798 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b365dd5-92ae-42c1-95c3-1e476f7831fd None admin] PATH_INFO: `/v3/projects/0846fccaeb674395a87e45290eda74b7/users/fbd92bd14ed04621af06d68161798fe3/roles/0bfe9ff936144b8987acb9d8a5188913` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:40.620090 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b365dd5-92ae-42c1-95c3-1e476f7831fd None admin] RBAC: Authorizing `identity:create_grant(project_id=0846fccaeb674395a87e45290eda74b7, user_id=fbd92bd14ed04621af06d68161798fe3, role_id=0bfe9ff936144b8987acb9d8a5188913)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:40.621530 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b365dd5-92ae-42c1-95c3-1e476f7831fd None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:40.634247 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 536/1078] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Mar 10 03:57:40 2022] PUT /identity/v3/projects/0846fccaeb674395a87e45290eda74b7/users/fbd92bd14ed04621af06d68161798fe3/roles/0bfe9ff936144b8987acb9d8a5188913 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 03:57:40.635066 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b365dd5-92ae-42c1-95c3-1e476f7831fd None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:40.712833 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a206cc-2e76-4b08-9b10-08e9c48690b2 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:40.742340 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b365dd5-92ae-42c1-95c3-1e476f7831fd None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:40.749392 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083c5c0-25d7-4d19-bc50-498ffaaa4ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:40.750322 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083c5c0-25d7-4d19-bc50-498ffaaa4ade None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:40.750604 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083c5c0-25d7-4d19-bc50-498ffaaa4ade None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:40.750906 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083c5c0-25d7-4d19-bc50-498ffaaa4ade None admin] PATH_INFO: `/v3/users/46feaa7825be433080ead2a7f2780196` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:40.752427 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083c5c0-25d7-4d19-bc50-498ffaaa4ade None admin] RBAC: Authorizing `identity:get_user(user_id=46feaa7825be433080ead2a7f2780196)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:40.753900 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083c5c0-25d7-4d19-bc50-498ffaaa4ade None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:40.760532 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 543/1079] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:57:40 2022] GET /identity/v3/users/46feaa7825be433080ead2a7f2780196 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:40.761699 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083c5c0-25d7-4d19-bc50-498ffaaa4ade None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:40.779260 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a9b26-e41c-443f-a5e0-3e844c04b8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:40.780320 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a9b26-e41c-443f-a5e0-3e844c04b8a9 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:40.780603 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a9b26-e41c-443f-a5e0-3e844c04b8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:40.780878 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a9b26-e41c-443f-a5e0-3e844c04b8a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:40.856404 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a9b26-e41c-443f-a5e0-3e844c04b8a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:40.857859 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a9b26-e41c-443f-a5e0-3e844c04b8a9 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:40.865609 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083c5c0-25d7-4d19-bc50-498ffaaa4ade None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:40.904914 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b610e49-8755-483d-b996-9039e0dc949c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:40.905778 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b610e49-8755-483d-b996-9039e0dc949c None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:40.906056 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b610e49-8755-483d-b996-9039e0dc949c None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:40.907081 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b610e49-8755-483d-b996-9039e0dc949c None admin] PATH_INFO: `/v3/projects/02e045f14ad04b56990f84b5263a54b8` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:40.908074 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b610e49-8755-483d-b996-9039e0dc949c None admin] RBAC: Authorizing `identity:get_project(project_id=02e045f14ad04b56990f84b5263a54b8)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:40.909501 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b610e49-8755-483d-b996-9039e0dc949c None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:40.911197 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 544/1080] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:57:40 2022] GET /identity/v3/projects/02e045f14ad04b56990f84b5263a54b8 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:40.917287 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b610e49-8755-483d-b996-9039e0dc949c None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:40.962092 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 537/1081] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:57:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 03:57:40.967948 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a9b26-e41c-443f-a5e0-3e844c04b8a9 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:41.021331 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b610e49-8755-483d-b996-9039e0dc949c None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:41.055262 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f9f27-4d3f-468c-aaca-f76a07d2abfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:41.056202 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f9f27-4d3f-468c-aaca-f76a07d2abfc None admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:41.056482 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f9f27-4d3f-468c-aaca-f76a07d2abfc None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:41.056758 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f9f27-4d3f-468c-aaca-f76a07d2abfc None admin] PATH_INFO: `/v3/projects/02e045f14ad04b56990f84b5263a54b8/users/46feaa7825be433080ead2a7f2780196/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:41.059038 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f9f27-4d3f-468c-aaca-f76a07d2abfc None admin] RBAC: Authorizing `identity:create_grant(project_id=02e045f14ad04b56990f84b5263a54b8, user_id=46feaa7825be433080ead2a7f2780196, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:41.060509 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f9f27-4d3f-468c-aaca-f76a07d2abfc None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:41.063130 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a9b26-e41c-443f-a5e0-3e844c04b8a9 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:41.079627 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 545/1082] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Mar 10 03:57:40 2022] PUT /identity/v3/projects/02e045f14ad04b56990f84b5263a54b8/users/46feaa7825be433080ead2a7f2780196/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 03:57:41.100276 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10c32a-7845-4b10-a344-bd8c1059e0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:41.101122 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10c32a-7845-4b10-a344-bd8c1059e0ba None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:41.101405 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10c32a-7845-4b10-a344-bd8c1059e0ba None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:41.101679 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10c32a-7845-4b10-a344-bd8c1059e0ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:41.113500 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10c32a-7845-4b10-a344-bd8c1059e0ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:41.114994 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10c32a-7845-4b10-a344-bd8c1059e0ba None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:41.133071 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-9b10c32a-7845-4b10-a344-bd8c1059e0ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:57:41.134607 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 538/1083] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:57:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:41.141111 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f9f27-4d3f-468c-aaca-f76a07d2abfc None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:41.241567 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f9f27-4d3f-468c-aaca-f76a07d2abfc None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:41.279255 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a5301-25f0-42fa-93fe-8a7a0aeb1d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:41.280060 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a5301-25f0-42fa-93fe-8a7a0aeb1d6d None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:41.280341 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a5301-25f0-42fa-93fe-8a7a0aeb1d6d None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:41.280616 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a5301-25f0-42fa-93fe-8a7a0aeb1d6d None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:41.281894 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a5301-25f0-42fa-93fe-8a7a0aeb1d6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:41.282193 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a5301-25f0-42fa-93fe-8a7a0aeb1d6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:41.283545 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a5301-25f0-42fa-93fe-8a7a0aeb1d6d None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:41.294816 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 546/1084] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:43.015894 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e6770-c02f-4fd8-a9a3-488b28fc5bab None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:43.016564 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e6770-c02f-4fd8-a9a3-488b28fc5bab None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:43.016564 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e6770-c02f-4fd8-a9a3-488b28fc5bab None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:43.018319 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 539/1085] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:43.024481 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade66617-02e1-491f-b540-4bf775056df5 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:43.025052 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade66617-02e1-491f-b540-4bf775056df5 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:43.025052 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade66617-02e1-491f-b540-4bf775056df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:43.043433 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-ade66617-02e1-491f-b540-4bf775056df5 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:43.044650 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-ade66617-02e1-491f-b540-4bf775056df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:43.114103 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 547/1086] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:57:43.137647 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e6770-c02f-4fd8-a9a3-488b28fc5bab None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:43.237073 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e6770-c02f-4fd8-a9a3-488b28fc5bab None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:43.269799 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08b27d-e3a3-4ca6-ae16-6772e3c44843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:43.270533 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08b27d-e3a3-4ca6-ae16-6772e3c44843 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:43.270816 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08b27d-e3a3-4ca6-ae16-6772e3c44843 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:43.271093 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08b27d-e3a3-4ca6-ae16-6772e3c44843 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:43.281123 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf08b27d-e3a3-4ca6-ae16-6772e3c44843 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:57:43.288500 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-bf08b27d-e3a3-4ca6-ae16-6772e3c44843 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 10 03:57:43.289721 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 540/1087] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Mar 10 03:57:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:43.295657 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade66617-02e1-491f-b540-4bf775056df5 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:43.382646 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b393d-5626-4bc9-9cfc-8db86dac622e None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:43.382934 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b393d-5626-4bc9-9cfc-8db86dac622e None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:43.383217 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b393d-5626-4bc9-9cfc-8db86dac622e None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:43.385036 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 541/1088] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:43.390000 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677481f-7e46-4792-9d5e-273e7eeb121a None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:43.390290 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677481f-7e46-4792-9d5e-273e7eeb121a None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:43.390602 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677481f-7e46-4792-9d5e-273e7eeb121a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:43.391739 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade66617-02e1-491f-b540-4bf775056df5 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:43.406888 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-e677481f-7e46-4792-9d5e-273e7eeb121a None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:43.408109 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-e677481f-7e46-4792-9d5e-273e7eeb121a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:43.423913 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b127f6-da03-481d-a8ad-2474a23f1ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:43.424576 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b127f6-da03-481d-a8ad-2474a23f1ead None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:43.424860 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b127f6-da03-481d-a8ad-2474a23f1ead None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:43.425137 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b127f6-da03-481d-a8ad-2474a23f1ead None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:43.425874 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b127f6-da03-481d-a8ad-2474a23f1ead None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:43.426175 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b127f6-da03-481d-a8ad-2474a23f1ead None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:43.427522 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b127f6-da03-481d-a8ad-2474a23f1ead None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:43.435114 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 548/1089] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Mar 10 03:57:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:43.441179 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b127f6-da03-481d-a8ad-2474a23f1ead None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:43.474381 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 542/1090] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 03:57:43.498236 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677481f-7e46-4792-9d5e-273e7eeb121a None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:43.533805 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b127f6-da03-481d-a8ad-2474a23f1ead None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:43.567194 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca5dab-a33b-41a5-bdbb-24a0b33b1d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:43.568018 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca5dab-a33b-41a5-bdbb-24a0b33b1d5b None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:43.568307 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca5dab-a33b-41a5-bdbb-24a0b33b1d5b None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:43.568586 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca5dab-a33b-41a5-bdbb-24a0b33b1d5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:43.579085 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca5dab-a33b-41a5-bdbb-24a0b33b1d5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:43.584153 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca5dab-a33b-41a5-bdbb-24a0b33b1d5b None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:43.593360 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677481f-7e46-4792-9d5e-273e7eeb121a None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:43.601342 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-31ca5dab-a33b-41a5-bdbb-24a0b33b1d5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:57:43.602557 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 549/1091] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:57:43.608218 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca5dab-a33b-41a5-bdbb-24a0b33b1d5b None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:43.626982 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d36a0b-e85d-434d-b11b-1255005439b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:43.627804 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d36a0b-e85d-434d-b11b-1255005439b4 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:43.628087 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d36a0b-e85d-434d-b11b-1255005439b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:43.628359 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d36a0b-e85d-434d-b11b-1255005439b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:43.638342 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d36a0b-e85d-434d-b11b-1255005439b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:57:43.645302 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-41d36a0b-e85d-434d-b11b-1255005439b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 03:57:43.646658 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 543/1092] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:57:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:57:43.652433 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d36a0b-e85d-434d-b11b-1255005439b4 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:43.702483 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca5dab-a33b-41a5-bdbb-24a0b33b1d5b None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:43.734885 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453f72f-9674-485b-82d8-dd251f4c2e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:43.735545 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453f72f-9674-485b-82d8-dd251f4c2e3b None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:43.735858 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453f72f-9674-485b-82d8-dd251f4c2e3b None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:43.736145 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453f72f-9674-485b-82d8-dd251f4c2e3b None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:43.736855 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453f72f-9674-485b-82d8-dd251f4c2e3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:43.737161 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453f72f-9674-485b-82d8-dd251f4c2e3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:43.738522 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453f72f-9674-485b-82d8-dd251f4c2e3b None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:43.747258 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d36a0b-e85d-434d-b11b-1255005439b4 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:43.749891 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 550/1093] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:43.755487 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453f72f-9674-485b-82d8-dd251f4c2e3b None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:43.779405 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c18060-2a19-4455-b253-26b3bb9b6edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:43.780103 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c18060-2a19-4455-b253-26b3bb9b6edd None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:43.780386 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c18060-2a19-4455-b253-26b3bb9b6edd None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:43.780661 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c18060-2a19-4455-b253-26b3bb9b6edd None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:43.781932 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c18060-2a19-4455-b253-26b3bb9b6edd None admin] RBAC: Adding query filter params (name=admin) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:43.782235 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c18060-2a19-4455-b253-26b3bb9b6edd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:43.783623 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c18060-2a19-4455-b253-26b3bb9b6edd None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:43.791583 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 544/1094] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:57:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:43.798021 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c18060-2a19-4455-b253-26b3bb9b6edd None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:43.848547 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453f72f-9674-485b-82d8-dd251f4c2e3b None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:43.882530 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3529db-0dac-40a1-8b7a-8e79e28c8514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:43.883616 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3529db-0dac-40a1-8b7a-8e79e28c8514 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:43.883948 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3529db-0dac-40a1-8b7a-8e79e28c8514 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:43.884227 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3529db-0dac-40a1-8b7a-8e79e28c8514 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:43.891357 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3529db-0dac-40a1-8b7a-8e79e28c8514 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:43.892838 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3529db-0dac-40a1-8b7a-8e79e28c8514 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:43.896893 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c18060-2a19-4455-b253-26b3bb9b6edd None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:43.906609 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-bd3529db-0dac-40a1-8b7a-8e79e28c8514 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 10 03:57:43.912506 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 551/1095] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Mar 10 03:57:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:57:43.913515 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3529db-0dac-40a1-8b7a-8e79e28c8514 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:43.939283 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c514697-bf1a-4c41-b1fd-1f36d73b6f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:43.940187 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c514697-bf1a-4c41-b1fd-1f36d73b6f25 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:43.940472 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c514697-bf1a-4c41-b1fd-1f36d73b6f25 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:43.940749 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c514697-bf1a-4c41-b1fd-1f36d73b6f25 None admin] PATH_INFO: `/v3/users/46feaa7825be433080ead2a7f2780196` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:43.942192 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c514697-bf1a-4c41-b1fd-1f36d73b6f25 None admin] RBAC: Authorizing `identity:get_user(user_id=46feaa7825be433080ead2a7f2780196)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:43.943612 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c514697-bf1a-4c41-b1fd-1f36d73b6f25 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:43.945291 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 545/1096] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:57:43 2022] GET /identity/v3/users/46feaa7825be433080ead2a7f2780196 => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:43.950972 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c514697-bf1a-4c41-b1fd-1f36d73b6f25 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:44.007415 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3529db-0dac-40a1-8b7a-8e79e28c8514 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:44.039897 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994331c-30c8-406f-858f-a72ca10e638e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:44.040567 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994331c-30c8-406f-858f-a72ca10e638e None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:44.040822 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994331c-30c8-406f-858f-a72ca10e638e None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:44.041089 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994331c-30c8-406f-858f-a72ca10e638e None admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:44.041952 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994331c-30c8-406f-858f-a72ca10e638e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:44.042202 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994331c-30c8-406f-858f-a72ca10e638e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:44.043613 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994331c-30c8-406f-858f-a72ca10e638e None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:44.045688 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c514697-bf1a-4c41-b1fd-1f36d73b6f25 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:44.060144 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 552/1097] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Mar 10 03:57:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:44.066183 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994331c-30c8-406f-858f-a72ca10e638e None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:44.078791 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869d1d7-8bd5-42ea-a9cd-bcf8a81a6d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:44.079437 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869d1d7-8bd5-42ea-a9cd-bcf8a81a6d62 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:44.079742 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869d1d7-8bd5-42ea-a9cd-bcf8a81a6d62 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:44.080023 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869d1d7-8bd5-42ea-a9cd-bcf8a81a6d62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:44.144595 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7869d1d7-8bd5-42ea-a9cd-bcf8a81a6d62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:44.146161 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7869d1d7-8bd5-42ea-a9cd-bcf8a81a6d62 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:44.160108 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994331c-30c8-406f-858f-a72ca10e638e None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:44.191698 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5398b3a-d80a-4b64-b947-eed773f17ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:44.192359 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5398b3a-d80a-4b64-b947-eed773f17ff6 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:44.192642 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5398b3a-d80a-4b64-b947-eed773f17ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:44.192915 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5398b3a-d80a-4b64-b947-eed773f17ff6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:44.238566 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 546/1098] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:57:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 03:57:44.244431 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869d1d7-8bd5-42ea-a9cd-bcf8a81a6d62 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:44.262991 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5398b3a-d80a-4b64-b947-eed773f17ff6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:44.264666 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5398b3a-d80a-4b64-b947-eed773f17ff6 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:44.339060 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869d1d7-8bd5-42ea-a9cd-bcf8a81a6d62 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:44.358062 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 553/1099] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:57:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 10 03:57:44.363904 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5398b3a-d80a-4b64-b947-eed773f17ff6 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:44.371970 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2240c-5a6e-4243-9b5e-dc0c6ef87d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:44.372826 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2240c-5a6e-4243-9b5e-dc0c6ef87d6b None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:44.373105 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2240c-5a6e-4243-9b5e-dc0c6ef87d6b None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:44.373382 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2240c-5a6e-4243-9b5e-dc0c6ef87d6b None admin] PATH_INFO: `/v3/projects/02e045f14ad04b56990f84b5263a54b8` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:44.374542 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2240c-5a6e-4243-9b5e-dc0c6ef87d6b None admin] RBAC: Authorizing `identity:get_project(project_id=02e045f14ad04b56990f84b5263a54b8)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:44.376528 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2240c-5a6e-4243-9b5e-dc0c6ef87d6b None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:44.383087 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 547/1100] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:57:44 2022] GET /identity/v3/projects/02e045f14ad04b56990f84b5263a54b8 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:44.384017 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2240c-5a6e-4243-9b5e-dc0c6ef87d6b None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:44.455948 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5398b3a-d80a-4b64-b947-eed773f17ff6 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:44.476935 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2240c-5a6e-4243-9b5e-dc0c6ef87d6b None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:44.486951 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ba5cb-b14d-43d4-a7b4-f6038fb618f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:44.487768 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ba5cb-b14d-43d4-a7b4-f6038fb618f6 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:44.488058 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ba5cb-b14d-43d4-a7b4-f6038fb618f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:44.488334 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ba5cb-b14d-43d4-a7b4-f6038fb618f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:44.498069 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ba5cb-b14d-43d4-a7b4-f6038fb618f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:44.499535 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ba5cb-b14d-43d4-a7b4-f6038fb618f6 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:44.509230 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c16eb0-a523-4005-84ed-89432e1567ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:44.509920 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c16eb0-a523-4005-84ed-89432e1567ba None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:44.510201 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c16eb0-a523-4005-84ed-89432e1567ba None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:44.510478 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c16eb0-a523-4005-84ed-89432e1567ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:44.511309 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c16eb0-a523-4005-84ed-89432e1567ba None admin] RBAC: Adding query filter params (role.id=a8b2a5887cec4a31b7304792af3dd3f1, scope.project.id=02e045f14ad04b56990f84b5263a54b8, user.id=46feaa7825be433080ead2a7f2780196) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:44.511621 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c16eb0-a523-4005-84ed-89432e1567ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:44.513059 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c16eb0-a523-4005-84ed-89432e1567ba None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:44.518034 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-661ba5cb-b14d-43d4-a7b4-f6038fb618f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:57:44.519398 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 554/1101] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:57:44.519526 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 548/1102] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:57:44 2022] GET /identity/v3/role_assignments?user.id=46feaa7825be433080ead2a7f2780196&scope.project.id=02e045f14ad04b56990f84b5263a54b8&role.id=a8b2a5887cec4a31b7304792af3dd3f1 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:44.525176 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ba5cb-b14d-43d4-a7b4-f6038fb618f6 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:44.628473 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ba5cb-b14d-43d4-a7b4-f6038fb618f6 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:44.663283 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeef30d-37cc-42e9-96c2-4ae91efb0f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:44.663999 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeef30d-37cc-42e9-96c2-4ae91efb0f5d None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:44.664285 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeef30d-37cc-42e9-96c2-4ae91efb0f5d None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:44.664563 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeef30d-37cc-42e9-96c2-4ae91efb0f5d None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:44.665295 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeef30d-37cc-42e9-96c2-4ae91efb0f5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:44.665599 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeef30d-37cc-42e9-96c2-4ae91efb0f5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:44.667012 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeef30d-37cc-42e9-96c2-4ae91efb0f5d None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:44.679912 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 555/1103] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:57:44.685582 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c16eb0-a523-4005-84ed-89432e1567ba None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:44.782901 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c16eb0-a523-4005-84ed-89432e1567ba None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:44.815756 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4fd40-15f2-4b53-b1e9-0144e9b363fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:44.816796 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4fd40-15f2-4b53-b1e9-0144e9b363fd None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:44.817074 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4fd40-15f2-4b53-b1e9-0144e9b363fd None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:44.817348 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4fd40-15f2-4b53-b1e9-0144e9b363fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:44.823844 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4fd40-15f2-4b53-b1e9-0144e9b363fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:44.825275 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4fd40-15f2-4b53-b1e9-0144e9b363fd None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:44.837835 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-c0c4fd40-15f2-4b53-b1e9-0144e9b363fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:57:44.839011 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 549/1104] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:57:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:57:44.844819 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeef30d-37cc-42e9-96c2-4ae91efb0f5d None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:44.941917 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeef30d-37cc-42e9-96c2-4ae91efb0f5d None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:44.972490 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c2d58-ad0f-4615-8400-eb8029c6b14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:44.973141 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c2d58-ad0f-4615-8400-eb8029c6b14c None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:44.973419 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c2d58-ad0f-4615-8400-eb8029c6b14c None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:44.973693 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c2d58-ad0f-4615-8400-eb8029c6b14c None admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:44.974460 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c2d58-ad0f-4615-8400-eb8029c6b14c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:44.974763 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c2d58-ad0f-4615-8400-eb8029c6b14c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:44.976214 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c2d58-ad0f-4615-8400-eb8029c6b14c None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:44.988282 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 556/1105] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:57:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:44.994464 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4fd40-15f2-4b53-b1e9-0144e9b363fd None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:45.089330 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4fd40-15f2-4b53-b1e9-0144e9b363fd None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:45.121413 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a95aa-05b6-4864-a209-c5e2411b0ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:45.122066 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a95aa-05b6-4864-a209-c5e2411b0ce1 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:45.122345 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a95aa-05b6-4864-a209-c5e2411b0ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:45.122620 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a95aa-05b6-4864-a209-c5e2411b0ce1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:45.123444 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a95aa-05b6-4864-a209-c5e2411b0ce1 None admin] RBAC: Adding query filter params (role.id=0bfe9ff936144b8987acb9d8a5188913, scope.project.id=0846fccaeb674395a87e45290eda74b7, user.id=fbd92bd14ed04621af06d68161798fe3) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:45.123779 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a95aa-05b6-4864-a209-c5e2411b0ce1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:45.125275 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412a95aa-05b6-4864-a209-c5e2411b0ce1 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:45.130962 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 550/1106] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:57:44 2022] GET /identity/v3/role_assignments?user.id=fbd92bd14ed04621af06d68161798fe3&scope.project.id=0846fccaeb674395a87e45290eda74b7&role.id=0bfe9ff936144b8987acb9d8a5188913 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:46.867722 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af473a0-e07c-4ee4-aeff-f527e19e1843 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:46.872208 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af473a0-e07c-4ee4-aeff-f527e19e1843 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:46.872504 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af473a0-e07c-4ee4-aeff-f527e19e1843 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:46.874398 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 557/1107] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:46.880231 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179152a-9b16-4a8d-ad27-3e5dd12f4457 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:46.880693 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179152a-9b16-4a8d-ad27-3e5dd12f4457 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:46.880799 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179152a-9b16-4a8d-ad27-3e5dd12f4457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:46.897358 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-7179152a-9b16-4a8d-ad27-3e5dd12f4457 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:46.898553 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-7179152a-9b16-4a8d-ad27-3e5dd12f4457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:46.960904 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 551/1108] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:57:46.985739 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af473a0-e07c-4ee4-aeff-f527e19e1843 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:47.079730 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af473a0-e07c-4ee4-aeff-f527e19e1843 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:47.111507 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643a103-e5f5-4bad-9985-06127a339889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:47.112325 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643a103-e5f5-4bad-9985-06127a339889 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:47.112604 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643a103-e5f5-4bad-9985-06127a339889 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:47.112876 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643a103-e5f5-4bad-9985-06127a339889 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:47.114047 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643a103-e5f5-4bad-9985-06127a339889 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:47.115466 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643a103-e5f5-4bad-9985-06127a339889 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:47.117092 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 558/1109] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:57:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:47.122962 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179152a-9b16-4a8d-ad27-3e5dd12f4457 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:47.214606 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179152a-9b16-4a8d-ad27-3e5dd12f4457 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:47.246180 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0215a8-262d-4a99-8292-2b295c73cee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:47.246834 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0215a8-262d-4a99-8292-2b295c73cee3 None admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:47.247114 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0215a8-262d-4a99-8292-2b295c73cee3 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:47.247385 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0215a8-262d-4a99-8292-2b295c73cee3 None admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:47.248119 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0215a8-262d-4a99-8292-2b295c73cee3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:47.249566 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0215a8-262d-4a99-8292-2b295c73cee3 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:47.269079 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 552/1110] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Mar 10 03:57:47 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 03:57:49.589838 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691db33-16d9-4eec-8848-d336d1f45626 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:49.590368 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691db33-16d9-4eec-8848-d336d1f45626 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:49.590368 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691db33-16d9-4eec-8848-d336d1f45626 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:49.592175 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 559/1111] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:49.597769 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad9734-2747-46bc-8709-704b9117d700 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:49.598206 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad9734-2747-46bc-8709-704b9117d700 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:49.598327 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad9734-2747-46bc-8709-704b9117d700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:49.616055 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-4aad9734-2747-46bc-8709-704b9117d700 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:49.617262 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-4aad9734-2747-46bc-8709-704b9117d700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:49.680073 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 553/1112] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:57:49.703376 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691db33-16d9-4eec-8848-d336d1f45626 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:49.795599 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691db33-16d9-4eec-8848-d336d1f45626 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:49.827084 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6aa00-7f27-4cb8-83fb-2130a86ba08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:49.827985 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6aa00-7f27-4cb8-83fb-2130a86ba08a None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:49.828264 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6aa00-7f27-4cb8-83fb-2130a86ba08a None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:49.828535 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6aa00-7f27-4cb8-83fb-2130a86ba08a None admin] PATH_INFO: `/v3/roles/c38b04db9cd34eeaaaa8d2a6425c05ad` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:49.829968 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6aa00-7f27-4cb8-83fb-2130a86ba08a None admin] RBAC: Authorizing `identity:get_role(role_id=c38b04db9cd34eeaaaa8d2a6425c05ad)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:49.831318 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6aa00-7f27-4cb8-83fb-2130a86ba08a None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:49.832696 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 560/1113] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:57:49 2022] GET /identity/v3/roles/c38b04db9cd34eeaaaa8d2a6425c05ad => generated 223 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:49.838481 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad9734-2747-46bc-8709-704b9117d700 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:49.930430 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad9734-2747-46bc-8709-704b9117d700 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:49.962257 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f951ccd-0e15-4f5e-8256-e7d23689853b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:49.963104 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f951ccd-0e15-4f5e-8256-e7d23689853b None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:49.963384 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f951ccd-0e15-4f5e-8256-e7d23689853b None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:49.963656 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f951ccd-0e15-4f5e-8256-e7d23689853b None admin] PATH_INFO: `/v3/users/130a885427974bc08006caeb3031f96e` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:49.976765 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f951ccd-0e15-4f5e-8256-e7d23689853b None admin] RBAC: Authorizing `identity:get_user(user_id=130a885427974bc08006caeb3031f96e)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:49.978215 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f951ccd-0e15-4f5e-8256-e7d23689853b None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:49.979889 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 554/1114] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:57:49 2022] GET /identity/v3/users/130a885427974bc08006caeb3031f96e => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:49.985614 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6aa00-7f27-4cb8-83fb-2130a86ba08a None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:50.078214 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6aa00-7f27-4cb8-83fb-2130a86ba08a None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:50.109481 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f4856-0211-46c6-ad1a-39ed84956827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:50.110120 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f4856-0211-46c6-ad1a-39ed84956827 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:50.110398 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f4856-0211-46c6-ad1a-39ed84956827 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:50.110671 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f4856-0211-46c6-ad1a-39ed84956827 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:50.174074 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f4856-0211-46c6-ad1a-39ed84956827 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:50.175520 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f4856-0211-46c6-ad1a-39ed84956827 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:50.264150 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 561/1115] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:57:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 03:57:50.270776 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f951ccd-0e15-4f5e-8256-e7d23689853b None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:50.363624 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f951ccd-0e15-4f5e-8256-e7d23689853b None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:50.396115 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edab3b0-08bb-4e3c-b3c8-710279df79d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:50.396961 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edab3b0-08bb-4e3c-b3c8-710279df79d4 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:50.397241 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edab3b0-08bb-4e3c-b3c8-710279df79d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:50.397514 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edab3b0-08bb-4e3c-b3c8-710279df79d4 None admin] PATH_INFO: `/v3/projects/02e045f14ad04b56990f84b5263a54b8` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:50.398677 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edab3b0-08bb-4e3c-b3c8-710279df79d4 None admin] RBAC: Authorizing `identity:get_project(project_id=02e045f14ad04b56990f84b5263a54b8)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:50.400138 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edab3b0-08bb-4e3c-b3c8-710279df79d4 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:50.401833 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 555/1116] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:57:50 2022] GET /identity/v3/projects/02e045f14ad04b56990f84b5263a54b8 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:50.407952 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f4856-0211-46c6-ad1a-39ed84956827 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:50.498170 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f4856-0211-46c6-ad1a-39ed84956827 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:50.529970 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9573df-8218-4be3-8171-33d68cc3ed59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:50.530559 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9573df-8218-4be3-8171-33d68cc3ed59 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:50.530887 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9573df-8218-4be3-8171-33d68cc3ed59 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:50.531163 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9573df-8218-4be3-8171-33d68cc3ed59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:50.532015 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9573df-8218-4be3-8171-33d68cc3ed59 None admin] RBAC: Adding query filter params (role.id=c38b04db9cd34eeaaaa8d2a6425c05ad, scope.project.id=02e045f14ad04b56990f84b5263a54b8, user.id=130a885427974bc08006caeb3031f96e) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:50.532321 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9573df-8218-4be3-8171-33d68cc3ed59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:50.533735 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9573df-8218-4be3-8171-33d68cc3ed59 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:50.538975 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 562/1117] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:57:50 2022] GET /identity/v3/role_assignments?user.id=130a885427974bc08006caeb3031f96e&scope.project.id=02e045f14ad04b56990f84b5263a54b8&role.id=c38b04db9cd34eeaaaa8d2a6425c05ad => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:52.790621 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687ed50-4cca-4554-ba81-9675166864ff None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:52.791143 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687ed50-4cca-4554-ba81-9675166864ff None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:52.791252 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687ed50-4cca-4554-ba81-9675166864ff None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:52.792987 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 556/1118] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:52.799001 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0037c-a7c0-4f0b-8669-543dc6d39569 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:52.799448 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0037c-a7c0-4f0b-8669-543dc6d39569 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:52.799539 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0037c-a7c0-4f0b-8669-543dc6d39569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:52.815674 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-e2a0037c-a7c0-4f0b-8669-543dc6d39569 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:52.817137 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-e2a0037c-a7c0-4f0b-8669-543dc6d39569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:52.878979 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 563/1119] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:57:52.901355 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687ed50-4cca-4554-ba81-9675166864ff None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:52.997238 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687ed50-4cca-4554-ba81-9675166864ff None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:53.028860 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed7a5d-1704-4c20-b9ee-7d5991750c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:53.029705 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed7a5d-1704-4c20-b9ee-7d5991750c72 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:53.029985 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed7a5d-1704-4c20-b9ee-7d5991750c72 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:53.030261 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed7a5d-1704-4c20-b9ee-7d5991750c72 None admin] PATH_INFO: `/v3/roles/c38b04db9cd34eeaaaa8d2a6425c05ad` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:53.032355 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed7a5d-1704-4c20-b9ee-7d5991750c72 None admin] RBAC: Authorizing `identity:get_role(role_id=c38b04db9cd34eeaaaa8d2a6425c05ad)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:53.033712 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed7a5d-1704-4c20-b9ee-7d5991750c72 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:53.035069 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 557/1120] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:57:52 2022] GET /identity/v3/roles/c38b04db9cd34eeaaaa8d2a6425c05ad => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:53.040945 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0037c-a7c0-4f0b-8669-543dc6d39569 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:53.132618 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0037c-a7c0-4f0b-8669-543dc6d39569 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:53.164633 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48984f66-01e5-4332-8b43-a10d4df3d948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:53.165478 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48984f66-01e5-4332-8b43-a10d4df3d948 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:53.165755 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48984f66-01e5-4332-8b43-a10d4df3d948 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:53.166023 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48984f66-01e5-4332-8b43-a10d4df3d948 None admin] PATH_INFO: `/v3/users/130a885427974bc08006caeb3031f96e` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:53.167166 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48984f66-01e5-4332-8b43-a10d4df3d948 None admin] RBAC: Authorizing `identity:get_user(user_id=130a885427974bc08006caeb3031f96e)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:53.168593 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48984f66-01e5-4332-8b43-a10d4df3d948 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:53.170180 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 564/1121] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:57:53 2022] GET /identity/v3/users/130a885427974bc08006caeb3031f96e => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:53.175957 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed7a5d-1704-4c20-b9ee-7d5991750c72 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:53.268907 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed7a5d-1704-4c20-b9ee-7d5991750c72 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:53.301319 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519cd69-2119-4a10-b95f-9dd0f83d7058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:53.302102 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519cd69-2119-4a10-b95f-9dd0f83d7058 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:53.302379 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519cd69-2119-4a10-b95f-9dd0f83d7058 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:53.302651 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519cd69-2119-4a10-b95f-9dd0f83d7058 None admin] PATH_INFO: `/v3/projects/02e045f14ad04b56990f84b5263a54b8` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:53.303829 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519cd69-2119-4a10-b95f-9dd0f83d7058 None admin] RBAC: Authorizing `identity:get_project(project_id=02e045f14ad04b56990f84b5263a54b8)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:53.305252 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519cd69-2119-4a10-b95f-9dd0f83d7058 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:53.306933 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 558/1122] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:57:53 2022] GET /identity/v3/projects/02e045f14ad04b56990f84b5263a54b8 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:53.313488 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48984f66-01e5-4332-8b43-a10d4df3d948 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:53.406286 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48984f66-01e5-4332-8b43-a10d4df3d948 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:53.438353 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dca78f-4189-4632-b687-0581d311609f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:53.439232 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dca78f-4189-4632-b687-0581d311609f None admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:53.439512 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dca78f-4189-4632-b687-0581d311609f None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:53.439819 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dca78f-4189-4632-b687-0581d311609f None admin] PATH_INFO: `/v3/projects/02e045f14ad04b56990f84b5263a54b8/users/130a885427974bc08006caeb3031f96e/roles/c38b04db9cd34eeaaaa8d2a6425c05ad` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:53.442252 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dca78f-4189-4632-b687-0581d311609f None admin] RBAC: Authorizing `identity:create_grant(project_id=02e045f14ad04b56990f84b5263a54b8, user_id=130a885427974bc08006caeb3031f96e, role_id=c38b04db9cd34eeaaaa8d2a6425c05ad)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:53.443705 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dca78f-4189-4632-b687-0581d311609f None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:53.456571 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 565/1123] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Mar 10 03:57:53 2022] PUT /identity/v3/projects/02e045f14ad04b56990f84b5263a54b8/users/130a885427974bc08006caeb3031f96e/roles/c38b04db9cd34eeaaaa8d2a6425c05ad => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 03:57:55.723548 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981c834-b960-4cbf-936d-3093d451bddf None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:55.724100 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981c834-b960-4cbf-936d-3093d451bddf None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:55.724191 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981c834-b960-4cbf-936d-3093d451bddf None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:55.725897 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 559/1124] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:55.731140 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe53a57-a30b-4bf0-9501-c079d64a1314 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:55.731595 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe53a57-a30b-4bf0-9501-c079d64a1314 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:55.731735 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe53a57-a30b-4bf0-9501-c079d64a1314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:55.748366 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-5fe53a57-a30b-4bf0-9501-c079d64a1314 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:55.749522 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-5fe53a57-a30b-4bf0-9501-c079d64a1314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:55.812172 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 566/1125] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:57:55.835559 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981c834-b960-4cbf-936d-3093d451bddf None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:55.929627 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981c834-b960-4cbf-936d-3093d451bddf None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:55.962266 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207eec3b-34e5-41c7-99d5-b31e38675441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:55.963098 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207eec3b-34e5-41c7-99d5-b31e38675441 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:55.963373 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207eec3b-34e5-41c7-99d5-b31e38675441 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:55.963639 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207eec3b-34e5-41c7-99d5-b31e38675441 None admin] PATH_INFO: `/v3/roles/c38b04db9cd34eeaaaa8d2a6425c05ad` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:55.965110 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207eec3b-34e5-41c7-99d5-b31e38675441 None admin] RBAC: Authorizing `identity:get_role(role_id=c38b04db9cd34eeaaaa8d2a6425c05ad)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:55.966474 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207eec3b-34e5-41c7-99d5-b31e38675441 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:55.967904 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 560/1126] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:57:55 2022] GET /identity/v3/roles/c38b04db9cd34eeaaaa8d2a6425c05ad => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:55.974263 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe53a57-a30b-4bf0-9501-c079d64a1314 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:56.064644 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe53a57-a30b-4bf0-9501-c079d64a1314 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:56.097180 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942925b0-c8dd-4826-96fa-5b8717bae535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:56.098042 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942925b0-c8dd-4826-96fa-5b8717bae535 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:56.098325 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942925b0-c8dd-4826-96fa-5b8717bae535 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:56.098599 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942925b0-c8dd-4826-96fa-5b8717bae535 None admin] PATH_INFO: `/v3/users/130a885427974bc08006caeb3031f96e` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:56.099797 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942925b0-c8dd-4826-96fa-5b8717bae535 None admin] RBAC: Authorizing `identity:get_user(user_id=130a885427974bc08006caeb3031f96e)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:56.101223 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942925b0-c8dd-4826-96fa-5b8717bae535 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:56.102830 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 567/1127] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:57:55 2022] GET /identity/v3/users/130a885427974bc08006caeb3031f96e => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:56.108555 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207eec3b-34e5-41c7-99d5-b31e38675441 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:56.200385 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207eec3b-34e5-41c7-99d5-b31e38675441 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:56.232427 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68255120-994a-4247-986a-84441dc4f33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:56.232990 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68255120-994a-4247-986a-84441dc4f33b None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:56.233270 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68255120-994a-4247-986a-84441dc4f33b None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:56.233576 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68255120-994a-4247-986a-84441dc4f33b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:56.295350 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68255120-994a-4247-986a-84441dc4f33b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:56.296908 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68255120-994a-4247-986a-84441dc4f33b None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:56.391305 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 561/1128] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:57:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 03:57:56.397191 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942925b0-c8dd-4826-96fa-5b8717bae535 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:56.488819 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942925b0-c8dd-4826-96fa-5b8717bae535 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:56.520614 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67afc0-de62-4aa5-b64d-15310687f4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:56.521460 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67afc0-de62-4aa5-b64d-15310687f4ca None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:56.521742 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67afc0-de62-4aa5-b64d-15310687f4ca None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:56.522018 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67afc0-de62-4aa5-b64d-15310687f4ca None admin] PATH_INFO: `/v3/projects/02e045f14ad04b56990f84b5263a54b8` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:56.523180 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67afc0-de62-4aa5-b64d-15310687f4ca None admin] RBAC: Authorizing `identity:get_project(project_id=02e045f14ad04b56990f84b5263a54b8)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:56.524619 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67afc0-de62-4aa5-b64d-15310687f4ca None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:56.526291 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 568/1129] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:57:56 2022] GET /identity/v3/projects/02e045f14ad04b56990f84b5263a54b8 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:56.532421 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68255120-994a-4247-986a-84441dc4f33b None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:56.624827 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68255120-994a-4247-986a-84441dc4f33b None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:56.660504 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd68c2-7f9d-43b6-9c47-272591ea9473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:56.661156 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd68c2-7f9d-43b6-9c47-272591ea9473 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:56.661439 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd68c2-7f9d-43b6-9c47-272591ea9473 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:56.661713 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd68c2-7f9d-43b6-9c47-272591ea9473 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:56.662535 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd68c2-7f9d-43b6-9c47-272591ea9473 None admin] RBAC: Adding query filter params (role.id=c38b04db9cd34eeaaaa8d2a6425c05ad, scope.project.id=02e045f14ad04b56990f84b5263a54b8, user.id=130a885427974bc08006caeb3031f96e) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:57:56.662843 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd68c2-7f9d-43b6-9c47-272591ea9473 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:56.664314 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd68c2-7f9d-43b6-9c47-272591ea9473 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:56.670656 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 562/1130] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:57:56 2022] GET /identity/v3/role_assignments?user.id=130a885427974bc08006caeb3031f96e&scope.project.id=02e045f14ad04b56990f84b5263a54b8&role.id=c38b04db9cd34eeaaaa8d2a6425c05ad => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:58.984315 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b625cfb-941d-4512-9e75-8d4fbb61a134 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:58.984862 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b625cfb-941d-4512-9e75-8d4fbb61a134 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:58.984862 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b625cfb-941d-4512-9e75-8d4fbb61a134 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:58.986599 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 569/1131] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:57:58.991733 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac18a65-10fb-4896-a3f2-e560a2fb8104 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:58.992129 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac18a65-10fb-4896-a3f2-e560a2fb8104 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:58.992299 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac18a65-10fb-4896-a3f2-e560a2fb8104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:59.008582 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-2ac18a65-10fb-4896-a3f2-e560a2fb8104 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:57:59.009764 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-2ac18a65-10fb-4896-a3f2-e560a2fb8104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:57:59.074084 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 563/1132] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:57:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:57:59.098779 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b625cfb-941d-4512-9e75-8d4fbb61a134 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:59.192483 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b625cfb-941d-4512-9e75-8d4fbb61a134 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:59.226042 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a81c4-098f-4a18-bfbc-16594a96d678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:59.226828 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a81c4-098f-4a18-bfbc-16594a96d678 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:59.227105 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a81c4-098f-4a18-bfbc-16594a96d678 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:59.227375 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a81c4-098f-4a18-bfbc-16594a96d678 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:59.228560 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a81c4-098f-4a18-bfbc-16594a96d678 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:59.229976 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a81c4-098f-4a18-bfbc-16594a96d678 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:59.231564 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 570/1133] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:57:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:57:59.237482 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac18a65-10fb-4896-a3f2-e560a2fb8104 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:57:59.330772 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac18a65-10fb-4896-a3f2-e560a2fb8104 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:57:59.362350 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e84c66-b69d-4e1a-a6f0-cccf060a8b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:57:59.362997 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e84c66-b69d-4e1a-a6f0-cccf060a8b67 None admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:57:59.363280 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e84c66-b69d-4e1a-a6f0-cccf060a8b67 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:57:59.363560 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e84c66-b69d-4e1a-a6f0-cccf060a8b67 None admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:57:59.364300 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e84c66-b69d-4e1a-a6f0-cccf060a8b67 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:57:59.365744 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e84c66-b69d-4e1a-a6f0-cccf060a8b67 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:57:59.391441 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 564/1134] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Mar 10 03:57:59 2022] POST /identity/v3/projects => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 03:58:01.721022 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9ef05-525c-44a7-937f-7470933b9a73 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:01.721569 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9ef05-525c-44a7-937f-7470933b9a73 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:01.721569 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9ef05-525c-44a7-937f-7470933b9a73 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:01.723323 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 571/1135] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:58:01.728485 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a28162-aee6-4bb9-906b-29b3b48ab792 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:01.728895 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a28162-aee6-4bb9-906b-29b3b48ab792 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:01.729048 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a28162-aee6-4bb9-906b-29b3b48ab792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:01.746073 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-a1a28162-aee6-4bb9-906b-29b3b48ab792 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:58:01.747251 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-a1a28162-aee6-4bb9-906b-29b3b48ab792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:58:01.937864 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 565/1136] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:58:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:58:01.962150 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9ef05-525c-44a7-937f-7470933b9a73 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:02.056682 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9ef05-525c-44a7-937f-7470933b9a73 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:02.089368 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40fe98-99af-4970-947f-ae9510a7040f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:02.090150 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40fe98-99af-4970-947f-ae9510a7040f None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:02.090428 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40fe98-99af-4970-947f-ae9510a7040f None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:02.090699 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40fe98-99af-4970-947f-ae9510a7040f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:02.091878 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40fe98-99af-4970-947f-ae9510a7040f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:02.093285 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40fe98-99af-4970-947f-ae9510a7040f None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:02.094879 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 572/1137] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:58:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:58:02.100782 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a28162-aee6-4bb9-906b-29b3b48ab792 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:02.194831 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a28162-aee6-4bb9-906b-29b3b48ab792 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:02.226028 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273887c3-529f-4d41-827c-f3339eaca7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:02.226687 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273887c3-529f-4d41-827c-f3339eaca7f9 None admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:02.226969 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273887c3-529f-4d41-827c-f3339eaca7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:02.227245 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273887c3-529f-4d41-827c-f3339eaca7f9 None admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:02.227994 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273887c3-529f-4d41-827c-f3339eaca7f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:02.229420 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273887c3-529f-4d41-827c-f3339eaca7f9 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:02.250229 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 566/1138] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Mar 10 03:58:02 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 03:58:04.609808 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19c573-e935-4e61-89f9-66d3a00fcc7b None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:04.610375 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19c573-e935-4e61-89f9-66d3a00fcc7b None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:04.610375 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19c573-e935-4e61-89f9-66d3a00fcc7b None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:04.612143 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 573/1139] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:58:04.617259 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9161d-f135-466e-aebc-181d6b66c827 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:04.617697 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9161d-f135-466e-aebc-181d6b66c827 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:04.617802 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9161d-f135-466e-aebc-181d6b66c827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:04.634499 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-39f9161d-f135-466e-aebc-181d6b66c827 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:58:04.635672 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-39f9161d-f135-466e-aebc-181d6b66c827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:58:04.698550 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 567/1140] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:58:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 03:58:04.722601 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19c573-e935-4e61-89f9-66d3a00fcc7b None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:04.817719 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19c573-e935-4e61-89f9-66d3a00fcc7b None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:04.849572 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527362e3-90d7-4639-9fa5-849f4449c619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:04.850355 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527362e3-90d7-4639-9fa5-849f4449c619 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:04.850638 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527362e3-90d7-4639-9fa5-849f4449c619 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:04.850910 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527362e3-90d7-4639-9fa5-849f4449c619 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:04.860526 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527362e3-90d7-4639-9fa5-849f4449c619 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:58:04.867373 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-527362e3-90d7-4639-9fa5-849f4449c619 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 03:58:04.868575 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 574/1141] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:58:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:58:04.875065 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9161d-f135-466e-aebc-181d6b66c827 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:04.966580 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9161d-f135-466e-aebc-181d6b66c827 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:04.997958 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c76268-53fa-421b-bd6f-907c62038a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:04.998723 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c76268-53fa-421b-bd6f-907c62038a46 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:04.999501 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c76268-53fa-421b-bd6f-907c62038a46 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:04.999803 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c76268-53fa-421b-bd6f-907c62038a46 None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:05.000549 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c76268-53fa-421b-bd6f-907c62038a46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:58:05.000851 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c76268-53fa-421b-bd6f-907c62038a46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:05.002216 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c76268-53fa-421b-bd6f-907c62038a46 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:05.009882 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 568/1142] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:58:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:58:05.015708 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527362e3-90d7-4639-9fa5-849f4449c619 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:05.108885 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527362e3-90d7-4639-9fa5-849f4449c619 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:05.140779 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976828a8-6774-4df8-882b-322640efde7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:05.141641 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976828a8-6774-4df8-882b-322640efde7a None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:05.141919 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976828a8-6774-4df8-882b-322640efde7a None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:05.142188 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976828a8-6774-4df8-882b-322640efde7a None admin] PATH_INFO: `/v3/users/0065df5d2f8942d39c3434fcd8a3ab04` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:05.154778 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976828a8-6774-4df8-882b-322640efde7a None admin] RBAC: Authorizing `identity:get_user(user_id=0065df5d2f8942d39c3434fcd8a3ab04)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:05.156255 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976828a8-6774-4df8-882b-322640efde7a None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:05.157912 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 575/1143] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:58:05 2022] GET /identity/v3/users/0065df5d2f8942d39c3434fcd8a3ab04 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:58:05.163732 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c76268-53fa-421b-bd6f-907c62038a46 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:05.257928 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c76268-53fa-421b-bd6f-907c62038a46 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:05.288808 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071f9be-b6be-46e9-bf5b-0480258bb60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:05.289447 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071f9be-b6be-46e9-bf5b-0480258bb60e None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:05.289731 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071f9be-b6be-46e9-bf5b-0480258bb60e None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:05.290008 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071f9be-b6be-46e9-bf5b-0480258bb60e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:05.353894 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071f9be-b6be-46e9-bf5b-0480258bb60e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:05.355327 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071f9be-b6be-46e9-bf5b-0480258bb60e None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:05.446497 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 569/1144] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:58:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 03:58:05.452234 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976828a8-6774-4df8-882b-322640efde7a None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:05.543132 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976828a8-6774-4df8-882b-322640efde7a None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:05.574843 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2245a93-c4ab-4bc5-9720-bcbc5d926801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:05.575707 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2245a93-c4ab-4bc5-9720-bcbc5d926801 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:05.575993 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2245a93-c4ab-4bc5-9720-bcbc5d926801 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:05.576265 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2245a93-c4ab-4bc5-9720-bcbc5d926801 None admin] PATH_INFO: `/v3/projects/8d92200bb13f48d199fcfdd615d23794` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:05.577444 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2245a93-c4ab-4bc5-9720-bcbc5d926801 None admin] RBAC: Authorizing `identity:get_project(project_id=8d92200bb13f48d199fcfdd615d23794)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:05.578855 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2245a93-c4ab-4bc5-9720-bcbc5d926801 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:05.580560 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 576/1145] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:58:05 2022] GET /identity/v3/projects/8d92200bb13f48d199fcfdd615d23794 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:58:05.586661 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071f9be-b6be-46e9-bf5b-0480258bb60e None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:05.680583 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071f9be-b6be-46e9-bf5b-0480258bb60e None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:05.711773 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec6e4f-5de2-4980-a066-f49faaf6bc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:05.712367 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec6e4f-5de2-4980-a066-f49faaf6bc45 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:05.712648 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec6e4f-5de2-4980-a066-f49faaf6bc45 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:05.712922 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec6e4f-5de2-4980-a066-f49faaf6bc45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:05.713733 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec6e4f-5de2-4980-a066-f49faaf6bc45 None admin] RBAC: Adding query filter params (role.id=a8b2a5887cec4a31b7304792af3dd3f1, scope.project.id=8d92200bb13f48d199fcfdd615d23794, user.id=0065df5d2f8942d39c3434fcd8a3ab04) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:58:05.714038 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec6e4f-5de2-4980-a066-f49faaf6bc45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:05.715446 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec6e4f-5de2-4980-a066-f49faaf6bc45 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:05.721238 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 570/1146] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:58:05 2022] GET /identity/v3/role_assignments?user.id=0065df5d2f8942d39c3434fcd8a3ab04&scope.project.id=8d92200bb13f48d199fcfdd615d23794&role.id=a8b2a5887cec4a31b7304792af3dd3f1 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:58:07.975027 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a8000-89ba-427f-8ba4-fc56eb0076f4 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:07.975552 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a8000-89ba-427f-8ba4-fc56eb0076f4 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:07.975552 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a8000-89ba-427f-8ba4-fc56eb0076f4 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:07.977358 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 577/1147] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:58:07.982711 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660c10e-ce90-4251-a958-0ba2884f291e None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:07.983635 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660c10e-ce90-4251-a958-0ba2884f291e None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:07.983792 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660c10e-ce90-4251-a958-0ba2884f291e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:08.000705 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-c660c10e-ce90-4251-a958-0ba2884f291e None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:58:08.001884 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-c660c10e-ce90-4251-a958-0ba2884f291e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:58:08.064425 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 571/1148] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:58:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:58:08.087170 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a8000-89ba-427f-8ba4-fc56eb0076f4 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:08.181297 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a8000-89ba-427f-8ba4-fc56eb0076f4 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:08.212499 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ace055-b4cf-47c1-b2fa-2cd8b799f186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:08.213270 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ace055-b4cf-47c1-b2fa-2cd8b799f186 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:08.213547 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ace055-b4cf-47c1-b2fa-2cd8b799f186 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:08.213817 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ace055-b4cf-47c1-b2fa-2cd8b799f186 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:08.223190 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ace055-b4cf-47c1-b2fa-2cd8b799f186 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:58:08.230131 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-72ace055-b4cf-47c1-b2fa-2cd8b799f186 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 03:58:08.231226 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 578/1149] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:58:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:58:08.237720 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660c10e-ce90-4251-a958-0ba2884f291e None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:08.329343 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660c10e-ce90-4251-a958-0ba2884f291e None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:08.361104 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65a303-ee0a-49dd-ae11-67c73f1c9841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:08.361746 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65a303-ee0a-49dd-ae11-67c73f1c9841 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:08.362026 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65a303-ee0a-49dd-ae11-67c73f1c9841 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:08.362301 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65a303-ee0a-49dd-ae11-67c73f1c9841 None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:08.363036 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65a303-ee0a-49dd-ae11-67c73f1c9841 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:58:08.363341 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65a303-ee0a-49dd-ae11-67c73f1c9841 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:08.364721 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65a303-ee0a-49dd-ae11-67c73f1c9841 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:08.372279 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 572/1150] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:58:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:58:08.377743 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ace055-b4cf-47c1-b2fa-2cd8b799f186 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:08.468515 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ace055-b4cf-47c1-b2fa-2cd8b799f186 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:08.498968 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769c560-5c8b-4f7d-91e4-2727cda342e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:08.499779 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769c560-5c8b-4f7d-91e4-2727cda342e0 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:08.500060 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769c560-5c8b-4f7d-91e4-2727cda342e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:08.500329 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769c560-5c8b-4f7d-91e4-2727cda342e0 None admin] PATH_INFO: `/v3/users/0065df5d2f8942d39c3434fcd8a3ab04` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:08.501480 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769c560-5c8b-4f7d-91e4-2727cda342e0 None admin] RBAC: Authorizing `identity:get_user(user_id=0065df5d2f8942d39c3434fcd8a3ab04)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:08.502876 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769c560-5c8b-4f7d-91e4-2727cda342e0 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:08.504465 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 579/1151] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:58:08 2022] GET /identity/v3/users/0065df5d2f8942d39c3434fcd8a3ab04 => generated 286 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:58:08.510093 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65a303-ee0a-49dd-ae11-67c73f1c9841 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:08.602815 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65a303-ee0a-49dd-ae11-67c73f1c9841 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:08.633999 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f813c1-505f-4b97-95ea-55998be3efa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:08.634839 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f813c1-505f-4b97-95ea-55998be3efa8 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:08.635118 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f813c1-505f-4b97-95ea-55998be3efa8 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:08.635392 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f813c1-505f-4b97-95ea-55998be3efa8 None admin] PATH_INFO: `/v3/projects/8d92200bb13f48d199fcfdd615d23794` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:08.636574 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f813c1-505f-4b97-95ea-55998be3efa8 None admin] RBAC: Authorizing `identity:get_project(project_id=8d92200bb13f48d199fcfdd615d23794)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:08.637990 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f813c1-505f-4b97-95ea-55998be3efa8 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:08.639667 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 573/1152] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:58:08 2022] GET /identity/v3/projects/8d92200bb13f48d199fcfdd615d23794 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:58:08.645502 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769c560-5c8b-4f7d-91e4-2727cda342e0 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:08.741292 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769c560-5c8b-4f7d-91e4-2727cda342e0 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:08.771798 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2504e2a-bc91-45eb-83c1-82eec8987497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:08.772615 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2504e2a-bc91-45eb-83c1-82eec8987497 None admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:08.772894 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2504e2a-bc91-45eb-83c1-82eec8987497 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:08.773166 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2504e2a-bc91-45eb-83c1-82eec8987497 None admin] PATH_INFO: `/v3/projects/8d92200bb13f48d199fcfdd615d23794/users/0065df5d2f8942d39c3434fcd8a3ab04/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:08.775053 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2504e2a-bc91-45eb-83c1-82eec8987497 None admin] RBAC: Authorizing `identity:create_grant(project_id=8d92200bb13f48d199fcfdd615d23794, user_id=0065df5d2f8942d39c3434fcd8a3ab04, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:08.776483 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2504e2a-bc91-45eb-83c1-82eec8987497 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:08.789261 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 580/1153] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Mar 10 03:58:08 2022] PUT /identity/v3/projects/8d92200bb13f48d199fcfdd615d23794/users/0065df5d2f8942d39c3434fcd8a3ab04/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 03:58:11.042604 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0b298-3f45-460a-96b2-e25db03086e9 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:11.043131 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0b298-3f45-460a-96b2-e25db03086e9 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:11.043212 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0b298-3f45-460a-96b2-e25db03086e9 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:11.044952 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 574/1154] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:58:11.050573 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf1c74-4899-4ab2-b645-ee6033436469 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:11.050985 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf1c74-4899-4ab2-b645-ee6033436469 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:11.051124 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf1c74-4899-4ab2-b645-ee6033436469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:11.068513 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-b1bf1c74-4899-4ab2-b645-ee6033436469 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:58:11.069675 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-b1bf1c74-4899-4ab2-b645-ee6033436469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:58:11.131046 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 581/1155] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:58:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:58:11.154072 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0b298-3f45-460a-96b2-e25db03086e9 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:11.248097 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0b298-3f45-460a-96b2-e25db03086e9 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:11.279902 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc0346-d0f4-4a82-a361-dc92634da1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:11.280664 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc0346-d0f4-4a82-a361-dc92634da1d6 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:11.280946 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc0346-d0f4-4a82-a361-dc92634da1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:11.281220 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc0346-d0f4-4a82-a361-dc92634da1d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:11.290615 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc0346-d0f4-4a82-a361-dc92634da1d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:58:11.297916 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-a0fc0346-d0f4-4a82-a361-dc92634da1d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 03:58:11.298975 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 575/1156] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:58:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:58:11.304674 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf1c74-4899-4ab2-b645-ee6033436469 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:11.396420 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf1c74-4899-4ab2-b645-ee6033436469 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:11.428101 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a992e1a-25d0-4309-9580-c50492114a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:11.428753 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a992e1a-25d0-4309-9580-c50492114a54 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:11.429036 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a992e1a-25d0-4309-9580-c50492114a54 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:11.429313 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a992e1a-25d0-4309-9580-c50492114a54 None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:11.430047 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a992e1a-25d0-4309-9580-c50492114a54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:58:11.430352 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a992e1a-25d0-4309-9580-c50492114a54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:11.431736 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a992e1a-25d0-4309-9580-c50492114a54 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:11.439251 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 582/1157] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:58:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:58:11.444897 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc0346-d0f4-4a82-a361-dc92634da1d6 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:11.536987 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc0346-d0f4-4a82-a361-dc92634da1d6 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:11.568185 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2a163-2392-4068-a5d5-e133c065ff7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:11.568965 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2a163-2392-4068-a5d5-e133c065ff7d None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:11.569243 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2a163-2392-4068-a5d5-e133c065ff7d None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:11.569515 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2a163-2392-4068-a5d5-e133c065ff7d None admin] PATH_INFO: `/v3/users/0065df5d2f8942d39c3434fcd8a3ab04` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:11.570660 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2a163-2392-4068-a5d5-e133c065ff7d None admin] RBAC: Authorizing `identity:get_user(user_id=0065df5d2f8942d39c3434fcd8a3ab04)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:11.572100 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2a163-2392-4068-a5d5-e133c065ff7d None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:11.573662 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 576/1158] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:58:11 2022] GET /identity/v3/users/0065df5d2f8942d39c3434fcd8a3ab04 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:58:11.579242 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a992e1a-25d0-4309-9580-c50492114a54 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:11.669815 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a992e1a-25d0-4309-9580-c50492114a54 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:11.700705 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9537a6-90ed-479e-b8e7-aa8156bec75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:11.701330 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9537a6-90ed-479e-b8e7-aa8156bec75e None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:11.702092 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9537a6-90ed-479e-b8e7-aa8156bec75e None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:11.702361 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9537a6-90ed-479e-b8e7-aa8156bec75e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:11.762804 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9537a6-90ed-479e-b8e7-aa8156bec75e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:11.764739 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9537a6-90ed-479e-b8e7-aa8156bec75e None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:11.857865 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 583/1159] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:58:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 03:58:11.863690 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2a163-2392-4068-a5d5-e133c065ff7d None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:11.955607 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2a163-2392-4068-a5d5-e133c065ff7d None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:11.986533 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a5b66-0f90-4702-adf4-313b96064add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:11.987371 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a5b66-0f90-4702-adf4-313b96064add None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:11.987648 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a5b66-0f90-4702-adf4-313b96064add None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:11.987950 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a5b66-0f90-4702-adf4-313b96064add None admin] PATH_INFO: `/v3/projects/8d92200bb13f48d199fcfdd615d23794` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:11.989098 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127a5b66-0f90-4702-adf4-313b96064add None admin] RBAC: Authorizing `identity:get_project(project_id=8d92200bb13f48d199fcfdd615d23794)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:11.990523 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127a5b66-0f90-4702-adf4-313b96064add None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:11.992262 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 577/1160] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:58:11 2022] GET /identity/v3/projects/8d92200bb13f48d199fcfdd615d23794 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:58:11.998695 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9537a6-90ed-479e-b8e7-aa8156bec75e None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:12.091086 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9537a6-90ed-479e-b8e7-aa8156bec75e None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:12.122024 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83694abd-6046-4958-9bdf-4c8e908f21b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:12.122669 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83694abd-6046-4958-9bdf-4c8e908f21b8 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:12.122952 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83694abd-6046-4958-9bdf-4c8e908f21b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:12.123733 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83694abd-6046-4958-9bdf-4c8e908f21b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:12.124556 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83694abd-6046-4958-9bdf-4c8e908f21b8 None admin] RBAC: Adding query filter params (role.id=a8b2a5887cec4a31b7304792af3dd3f1, scope.project.id=8d92200bb13f48d199fcfdd615d23794, user.id=0065df5d2f8942d39c3434fcd8a3ab04) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:58:12.124867 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83694abd-6046-4958-9bdf-4c8e908f21b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:12.126276 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83694abd-6046-4958-9bdf-4c8e908f21b8 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:12.131730 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 584/1161] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:58:11 2022] GET /identity/v3/role_assignments?user.id=0065df5d2f8942d39c3434fcd8a3ab04&scope.project.id=8d92200bb13f48d199fcfdd615d23794&role.id=a8b2a5887cec4a31b7304792af3dd3f1 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:58:14.422607 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c996b-cb24-4c85-a97f-89df0baf8261 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:14.423143 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c996b-cb24-4c85-a97f-89df0baf8261 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:14.423143 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c996b-cb24-4c85-a97f-89df0baf8261 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:14.424879 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 578/1162] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:58:14.429984 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07dc27-d3dd-4fcf-845a-6e66bc841e08 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:14.430361 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07dc27-d3dd-4fcf-845a-6e66bc841e08 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:14.430544 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07dc27-d3dd-4fcf-845a-6e66bc841e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:14.447044 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-7c07dc27-d3dd-4fcf-845a-6e66bc841e08 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:58:14.448244 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-7c07dc27-d3dd-4fcf-845a-6e66bc841e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:58:14.510196 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 585/1163] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:58:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:58:14.532192 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c996b-cb24-4c85-a97f-89df0baf8261 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:14.627906 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c996b-cb24-4c85-a97f-89df0baf8261 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:14.658586 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff9fdf-f15f-4b2f-9e17-6c96abcced90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:14.659217 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff9fdf-f15f-4b2f-9e17-6c96abcced90 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:14.659499 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff9fdf-f15f-4b2f-9e17-6c96abcced90 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:14.659803 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff9fdf-f15f-4b2f-9e17-6c96abcced90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:14.721975 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff9fdf-f15f-4b2f-9e17-6c96abcced90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:14.723353 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff9fdf-f15f-4b2f-9e17-6c96abcced90 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:14.813162 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 579/1164] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:58:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 03:58:14.819382 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07dc27-d3dd-4fcf-845a-6e66bc841e08 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:14.911713 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07dc27-d3dd-4fcf-845a-6e66bc841e08 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:14.943662 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65027d1-6bd5-41d0-bafb-145d14be6cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:14.944472 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65027d1-6bd5-41d0-bafb-145d14be6cc2 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:14.944755 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65027d1-6bd5-41d0-bafb-145d14be6cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:14.945030 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65027d1-6bd5-41d0-bafb-145d14be6cc2 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:14.951841 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65027d1-6bd5-41d0-bafb-145d14be6cc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:14.953279 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65027d1-6bd5-41d0-bafb-145d14be6cc2 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:14.967506 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-e65027d1-6bd5-41d0-bafb-145d14be6cc2 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Mar 10 03:58:14.968674 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 586/1165] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Mar 10 03:58:14 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:58:14.974712 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff9fdf-f15f-4b2f-9e17-6c96abcced90 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:15.065038 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff9fdf-f15f-4b2f-9e17-6c96abcced90 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:15.096616 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6bae6-9487-4aee-abb5-8078af42de9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:15.097257 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6bae6-9487-4aee-abb5-8078af42de9f None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:15.097535 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6bae6-9487-4aee-abb5-8078af42de9f None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:15.097806 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6bae6-9487-4aee-abb5-8078af42de9f None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:15.098511 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6bae6-9487-4aee-abb5-8078af42de9f None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:58:15.098813 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6bae6-9487-4aee-abb5-8078af42de9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:15.100275 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6bae6-9487-4aee-abb5-8078af42de9f None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:15.107020 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 580/1166] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Mar 10 03:58:14 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:58:17.363226 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e5dac-3c5e-40a4-88d1-9029e0ede0e3 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:17.363768 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e5dac-3c5e-40a4-88d1-9029e0ede0e3 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:17.363886 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e5dac-3c5e-40a4-88d1-9029e0ede0e3 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:17.365583 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 587/1167] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:58:17.370603 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1dc58-181f-4786-a84b-160b8c4e525c None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:17.370975 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1dc58-181f-4786-a84b-160b8c4e525c None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:17.371156 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1dc58-181f-4786-a84b-160b8c4e525c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:17.387941 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-b4d1dc58-181f-4786-a84b-160b8c4e525c None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:58:17.389107 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-b4d1dc58-181f-4786-a84b-160b8c4e525c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:58:17.450919 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 581/1168] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:58:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:58:17.473658 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e5dac-3c5e-40a4-88d1-9029e0ede0e3 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:17.686988 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e5dac-3c5e-40a4-88d1-9029e0ede0e3 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:17.718117 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79be4e6-64c3-4e7d-afbb-fc90fb91decb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:17.718745 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79be4e6-64c3-4e7d-afbb-fc90fb91decb None admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:17.719022 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79be4e6-64c3-4e7d-afbb-fc90fb91decb None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:17.719289 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79be4e6-64c3-4e7d-afbb-fc90fb91decb None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:17.720031 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79be4e6-64c3-4e7d-afbb-fc90fb91decb None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:17.721353 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79be4e6-64c3-4e7d-afbb-fc90fb91decb None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:17.734916 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 588/1169] 10.222.0.15 () {60 vars in 1138 bytes} [Thu Mar 10 03:58:17 2022] POST /identity/v3/domains => generated 267 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 03:58:20.014762 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f7376-54b6-4c6b-9515-1b25dbcf13f2 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:20.015313 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f7376-54b6-4c6b-9515-1b25dbcf13f2 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:20.015313 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f7376-54b6-4c6b-9515-1b25dbcf13f2 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:20.017136 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 582/1170] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:58:20.022211 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd2271-213e-4582-a777-a42848877837 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:20.022584 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd2271-213e-4582-a777-a42848877837 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:20.022762 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd2271-213e-4582-a777-a42848877837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:20.038796 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-93cd2271-213e-4582-a777-a42848877837 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:58:20.039997 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-93cd2271-213e-4582-a777-a42848877837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:58:20.101217 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 589/1171] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:58:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:58:20.125251 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f7376-54b6-4c6b-9515-1b25dbcf13f2 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:20.217808 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f7376-54b6-4c6b-9515-1b25dbcf13f2 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:20.249459 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5476e-856c-4b2f-87d4-5291cd3d66f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:20.250280 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5476e-856c-4b2f-87d4-5291cd3d66f0 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:20.250562 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5476e-856c-4b2f-87d4-5291cd3d66f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:20.250839 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5476e-856c-4b2f-87d4-5291cd3d66f0 None admin] PATH_INFO: `/v3/domains/b81bef77486f49e680683840535e3039` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:20.260627 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5476e-856c-4b2f-87d4-5291cd3d66f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b81bef77486f49e680683840535e3039)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:20.262052 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5476e-856c-4b2f-87d4-5291cd3d66f0 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:20.263665 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 583/1172] 10.222.0.15 () {56 vars in 1183 bytes} [Thu Mar 10 03:58:20 2022] GET /identity/v3/domains/b81bef77486f49e680683840535e3039 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:58:20.269237 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd2271-213e-4582-a777-a42848877837 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:20.358211 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd2271-213e-4582-a777-a42848877837 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:20.388464 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35beae9-2bd5-4a66-b969-9d63937f8b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:20.389100 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35beae9-2bd5-4a66-b969-9d63937f8b08 None admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:20.389379 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35beae9-2bd5-4a66-b969-9d63937f8b08 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:20.389646 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35beae9-2bd5-4a66-b969-9d63937f8b08 None admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:20.390339 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35beae9-2bd5-4a66-b969-9d63937f8b08 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:20.391763 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35beae9-2bd5-4a66-b969-9d63937f8b08 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:20.415227 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 590/1173] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Mar 10 03:58:20 2022] POST /identity/v3/projects => generated 361 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 03:58:22.709214 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac6b70-2769-4e35-a898-9521ce0ecaed None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:22.709772 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac6b70-2769-4e35-a898-9521ce0ecaed None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:22.709772 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac6b70-2769-4e35-a898-9521ce0ecaed None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:22.711565 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 584/1174] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:58:22.716688 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e612e7f-29b9-4c02-a28c-3b14e8eed219 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:22.717119 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e612e7f-29b9-4c02-a28c-3b14e8eed219 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:22.717247 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e612e7f-29b9-4c02-a28c-3b14e8eed219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:22.733326 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-6e612e7f-29b9-4c02-a28c-3b14e8eed219 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:58:22.734496 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-6e612e7f-29b9-4c02-a28c-3b14e8eed219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:58:22.795836 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 591/1175] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:58:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:58:22.820561 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac6b70-2769-4e35-a898-9521ce0ecaed None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:22.914311 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac6b70-2769-4e35-a898-9521ce0ecaed None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:22.946084 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef195ce-15d0-48f0-b170-b0afcd2e57e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:22.946907 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef195ce-15d0-48f0-b170-b0afcd2e57e1 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:22.947188 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef195ce-15d0-48f0-b170-b0afcd2e57e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:22.947463 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef195ce-15d0-48f0-b170-b0afcd2e57e1 None admin] PATH_INFO: `/v3/domains/b81bef77486f49e680683840535e3039` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:22.948641 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef195ce-15d0-48f0-b170-b0afcd2e57e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b81bef77486f49e680683840535e3039)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:22.950049 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef195ce-15d0-48f0-b170-b0afcd2e57e1 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:22.951630 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 585/1176] 10.222.0.15 () {56 vars in 1183 bytes} [Thu Mar 10 03:58:22 2022] GET /identity/v3/domains/b81bef77486f49e680683840535e3039 => generated 267 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:58:22.957043 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e612e7f-29b9-4c02-a28c-3b14e8eed219 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:23.046409 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e612e7f-29b9-4c02-a28c-3b14e8eed219 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:23.078309 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16102e-d1bc-4d2a-975a-0a230b9596cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:23.078951 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16102e-d1bc-4d2a-975a-0a230b9596cd None admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:23.079231 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16102e-d1bc-4d2a-975a-0a230b9596cd None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:23.079501 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16102e-d1bc-4d2a-975a-0a230b9596cd None admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:23.080228 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16102e-d1bc-4d2a-975a-0a230b9596cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:23.081630 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16102e-d1bc-4d2a-975a-0a230b9596cd None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:23.099860 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 592/1177] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Mar 10 03:58:22 2022] POST /identity/v3/users => generated 311 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 03:58:25.394529 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e8fd4-58ae-4e59-9154-a8aa88a6fd64 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:25.395040 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e8fd4-58ae-4e59-9154-a8aa88a6fd64 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:25.395040 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e8fd4-58ae-4e59-9154-a8aa88a6fd64 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:25.396824 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 586/1178] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:58:25.401817 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665fad0-0a0e-471a-8ccf-fff3100b9385 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:25.402247 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665fad0-0a0e-471a-8ccf-fff3100b9385 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:25.402349 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665fad0-0a0e-471a-8ccf-fff3100b9385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:25.418421 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-5665fad0-0a0e-471a-8ccf-fff3100b9385 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:58:25.420110 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-5665fad0-0a0e-471a-8ccf-fff3100b9385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:58:25.481144 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 593/1179] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:58:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:58:25.505008 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e8fd4-58ae-4e59-9154-a8aa88a6fd64 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:25.598843 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e8fd4-58ae-4e59-9154-a8aa88a6fd64 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:25.629826 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4f247-0bd6-4393-a3e1-547ceee7cbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:25.630593 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4f247-0bd6-4393-a3e1-547ceee7cbc5 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:25.630875 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4f247-0bd6-4393-a3e1-547ceee7cbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:25.631151 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4f247-0bd6-4393-a3e1-547ceee7cbc5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:25.641028 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4f247-0bd6-4393-a3e1-547ceee7cbc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:58:25.647819 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-56a4f247-0bd6-4393-a3e1-547ceee7cbc5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 03:58:25.648898 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 587/1180] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:58:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:58:25.655278 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665fad0-0a0e-471a-8ccf-fff3100b9385 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:25.744624 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665fad0-0a0e-471a-8ccf-fff3100b9385 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:25.774981 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190ee10-5363-4d47-8974-35ed1a18ad83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:25.775621 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190ee10-5363-4d47-8974-35ed1a18ad83 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:25.775931 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190ee10-5363-4d47-8974-35ed1a18ad83 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:25.776202 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190ee10-5363-4d47-8974-35ed1a18ad83 None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:25.776930 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190ee10-5363-4d47-8974-35ed1a18ad83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:58:25.777231 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190ee10-5363-4d47-8974-35ed1a18ad83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:25.778574 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190ee10-5363-4d47-8974-35ed1a18ad83 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:25.786495 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 594/1181] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:58:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:58:25.791920 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4f247-0bd6-4393-a3e1-547ceee7cbc5 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:25.884345 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4f247-0bd6-4393-a3e1-547ceee7cbc5 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:25.915553 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53102906-701a-45c8-bfc4-a050190faec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:25.916365 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53102906-701a-45c8-bfc4-a050190faec8 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:25.916650 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53102906-701a-45c8-bfc4-a050190faec8 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:25.916925 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53102906-701a-45c8-bfc4-a050190faec8 None admin] PATH_INFO: `/v3/users/01e08bb9061e4d7f9cd6f01e7eb9b554` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:25.929590 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53102906-701a-45c8-bfc4-a050190faec8 None admin] RBAC: Authorizing `identity:get_user(user_id=01e08bb9061e4d7f9cd6f01e7eb9b554)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:25.931010 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53102906-701a-45c8-bfc4-a050190faec8 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:25.932627 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 588/1182] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:58:25 2022] GET /identity/v3/users/01e08bb9061e4d7f9cd6f01e7eb9b554 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:58:25.937969 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190ee10-5363-4d47-8974-35ed1a18ad83 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:26.029998 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190ee10-5363-4d47-8974-35ed1a18ad83 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:26.060098 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e045c-3652-44ea-8ae8-239193e2d754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:26.060714 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e045c-3652-44ea-8ae8-239193e2d754 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:26.060991 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e045c-3652-44ea-8ae8-239193e2d754 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:26.061261 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e045c-3652-44ea-8ae8-239193e2d754 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:26.122163 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e045c-3652-44ea-8ae8-239193e2d754 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:26.123614 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e045c-3652-44ea-8ae8-239193e2d754 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:26.212567 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 595/1183] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:58:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 03:58:26.218829 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53102906-701a-45c8-bfc4-a050190faec8 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:26.310487 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53102906-701a-45c8-bfc4-a050190faec8 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:26.341727 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10278f22-010b-4bc1-9711-f434c33f1da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:26.342547 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10278f22-010b-4bc1-9711-f434c33f1da5 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:26.342831 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10278f22-010b-4bc1-9711-f434c33f1da5 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:26.343101 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10278f22-010b-4bc1-9711-f434c33f1da5 None admin] PATH_INFO: `/v3/projects/1a45b9508a6d4524ad9eef2199a03948` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:26.344260 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10278f22-010b-4bc1-9711-f434c33f1da5 None admin] RBAC: Authorizing `identity:get_project(project_id=1a45b9508a6d4524ad9eef2199a03948)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:26.345663 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10278f22-010b-4bc1-9711-f434c33f1da5 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:26.347276 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 589/1184] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:58:26 2022] GET /identity/v3/projects/1a45b9508a6d4524ad9eef2199a03948 => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:58:26.353082 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e045c-3652-44ea-8ae8-239193e2d754 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:26.443184 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e045c-3652-44ea-8ae8-239193e2d754 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:26.474719 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52cd5fb-c0e8-4b19-a6b2-33ebacaaf0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:26.475304 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cd5fb-c0e8-4b19-a6b2-33ebacaaf0e5 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:26.475586 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cd5fb-c0e8-4b19-a6b2-33ebacaaf0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:26.475894 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cd5fb-c0e8-4b19-a6b2-33ebacaaf0e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:26.476707 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52cd5fb-c0e8-4b19-a6b2-33ebacaaf0e5 None admin] RBAC: Adding query filter params (role.id=a8b2a5887cec4a31b7304792af3dd3f1, scope.project.id=1a45b9508a6d4524ad9eef2199a03948, user.id=01e08bb9061e4d7f9cd6f01e7eb9b554) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:58:26.477042 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52cd5fb-c0e8-4b19-a6b2-33ebacaaf0e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:26.478449 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52cd5fb-c0e8-4b19-a6b2-33ebacaaf0e5 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:26.483492 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 596/1185] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:58:26 2022] GET /identity/v3/role_assignments?user.id=01e08bb9061e4d7f9cd6f01e7eb9b554&scope.project.id=1a45b9508a6d4524ad9eef2199a03948&role.id=a8b2a5887cec4a31b7304792af3dd3f1 => generated 259 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:58:28.747275 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d4f42-a6f2-43bf-bbd7-9f21c330be8c None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:28.747966 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d4f42-a6f2-43bf-bbd7-9f21c330be8c None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:28.747966 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d4f42-a6f2-43bf-bbd7-9f21c330be8c None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:28.749602 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 590/1186] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:58:28.754727 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2d176-5dbd-4360-aa7e-4e106e1f27af None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:28.755092 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2d176-5dbd-4360-aa7e-4e106e1f27af None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:28.755285 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2d176-5dbd-4360-aa7e-4e106e1f27af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:28.772151 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-45a2d176-5dbd-4360-aa7e-4e106e1f27af None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:58:28.773307 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-45a2d176-5dbd-4360-aa7e-4e106e1f27af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:58:28.835045 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 597/1187] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:58:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:58:28.858514 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d4f42-a6f2-43bf-bbd7-9f21c330be8c None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:28.951409 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d4f42-a6f2-43bf-bbd7-9f21c330be8c None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:28.982761 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e550d-303c-4d8c-9274-a0cd164c3550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:28.983537 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e550d-303c-4d8c-9274-a0cd164c3550 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:28.983844 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e550d-303c-4d8c-9274-a0cd164c3550 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:28.984118 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e550d-303c-4d8c-9274-a0cd164c3550 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:28.993626 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e550d-303c-4d8c-9274-a0cd164c3550 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:58:29.000427 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-853e550d-303c-4d8c-9274-a0cd164c3550 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 03:58:29.001526 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 591/1188] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:58:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:58:29.007810 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2d176-5dbd-4360-aa7e-4e106e1f27af None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:29.098171 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2d176-5dbd-4360-aa7e-4e106e1f27af None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:29.128727 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830456b7-a8a8-4434-bab3-5a2b54b7d679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:29.129380 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830456b7-a8a8-4434-bab3-5a2b54b7d679 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:29.129661 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830456b7-a8a8-4434-bab3-5a2b54b7d679 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:29.129935 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830456b7-a8a8-4434-bab3-5a2b54b7d679 None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:29.130662 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830456b7-a8a8-4434-bab3-5a2b54b7d679 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:58:29.130959 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830456b7-a8a8-4434-bab3-5a2b54b7d679 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:29.132327 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830456b7-a8a8-4434-bab3-5a2b54b7d679 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:29.140327 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 598/1189] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:58:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:58:29.146214 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e550d-303c-4d8c-9274-a0cd164c3550 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:29.239263 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e550d-303c-4d8c-9274-a0cd164c3550 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:29.270503 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2d7d6-41a1-4a7d-a53f-f1cc7a4e1b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:29.271297 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2d7d6-41a1-4a7d-a53f-f1cc7a4e1b2d None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:29.271577 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2d7d6-41a1-4a7d-a53f-f1cc7a4e1b2d None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:29.271884 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2d7d6-41a1-4a7d-a53f-f1cc7a4e1b2d None admin] PATH_INFO: `/v3/users/01e08bb9061e4d7f9cd6f01e7eb9b554` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:29.273039 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2d7d6-41a1-4a7d-a53f-f1cc7a4e1b2d None admin] RBAC: Authorizing `identity:get_user(user_id=01e08bb9061e4d7f9cd6f01e7eb9b554)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:29.274449 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2d7d6-41a1-4a7d-a53f-f1cc7a4e1b2d None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:29.276083 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 592/1190] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:58:29 2022] GET /identity/v3/users/01e08bb9061e4d7f9cd6f01e7eb9b554 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:58:29.282574 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830456b7-a8a8-4434-bab3-5a2b54b7d679 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:29.373203 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830456b7-a8a8-4434-bab3-5a2b54b7d679 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:29.403865 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8d184-ae7d-49b0-a1bf-306ffe745018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:29.404694 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8d184-ae7d-49b0-a1bf-306ffe745018 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:29.404974 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8d184-ae7d-49b0-a1bf-306ffe745018 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:29.405248 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8d184-ae7d-49b0-a1bf-306ffe745018 None admin] PATH_INFO: `/v3/projects/1a45b9508a6d4524ad9eef2199a03948` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:29.406388 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8d184-ae7d-49b0-a1bf-306ffe745018 None admin] RBAC: Authorizing `identity:get_project(project_id=1a45b9508a6d4524ad9eef2199a03948)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:29.407819 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8d184-ae7d-49b0-a1bf-306ffe745018 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:29.409432 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 599/1191] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:58:29 2022] GET /identity/v3/projects/1a45b9508a6d4524ad9eef2199a03948 => generated 361 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:58:29.415168 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2d7d6-41a1-4a7d-a53f-f1cc7a4e1b2d None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:29.507956 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2d7d6-41a1-4a7d-a53f-f1cc7a4e1b2d None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:29.539288 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb27e12-88bf-4dd1-9121-02e248f5afd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:29.540187 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb27e12-88bf-4dd1-9121-02e248f5afd2 None admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:29.540468 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb27e12-88bf-4dd1-9121-02e248f5afd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:29.540743 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb27e12-88bf-4dd1-9121-02e248f5afd2 None admin] PATH_INFO: `/v3/projects/1a45b9508a6d4524ad9eef2199a03948/users/01e08bb9061e4d7f9cd6f01e7eb9b554/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:29.542651 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb27e12-88bf-4dd1-9121-02e248f5afd2 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a45b9508a6d4524ad9eef2199a03948, user_id=01e08bb9061e4d7f9cd6f01e7eb9b554, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:29.544105 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb27e12-88bf-4dd1-9121-02e248f5afd2 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:29.557314 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 593/1192] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Mar 10 03:58:29 2022] PUT /identity/v3/projects/1a45b9508a6d4524ad9eef2199a03948/users/01e08bb9061e4d7f9cd6f01e7eb9b554/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 03:58:31.814115 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb993d5-bf13-47f4-bd44-447f3733a0ec None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:31.814663 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb993d5-bf13-47f4-bd44-447f3733a0ec None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:31.814663 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb993d5-bf13-47f4-bd44-447f3733a0ec None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:31.816722 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 600/1193] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:58:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:58:31.821817 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953d0c3-1200-4bd8-bfa4-13119a76ce5b None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:31.822196 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953d0c3-1200-4bd8-bfa4-13119a76ce5b None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:31.822367 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953d0c3-1200-4bd8-bfa4-13119a76ce5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:31.838485 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-e953d0c3-1200-4bd8-bfa4-13119a76ce5b None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:58:31.839640 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-e953d0c3-1200-4bd8-bfa4-13119a76ce5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:58:31.900480 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 594/1194] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:58:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:58:31.924492 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb993d5-bf13-47f4-bd44-447f3733a0ec None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:32.018207 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb993d5-bf13-47f4-bd44-447f3733a0ec None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:32.049134 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d3d38-0b8b-4b97-ad82-1aa20949645e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:32.049899 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d3d38-0b8b-4b97-ad82-1aa20949645e None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:32.050181 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d3d38-0b8b-4b97-ad82-1aa20949645e None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:32.050457 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d3d38-0b8b-4b97-ad82-1aa20949645e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:32.060470 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d3d38-0b8b-4b97-ad82-1aa20949645e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:58:32.067636 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-fe3d3d38-0b8b-4b97-ad82-1aa20949645e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 03:58:32.068788 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 601/1195] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:58:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:58:32.074643 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953d0c3-1200-4bd8-bfa4-13119a76ce5b None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:32.166214 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953d0c3-1200-4bd8-bfa4-13119a76ce5b None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:32.197411 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883490a6-7c94-4d47-a3b2-aad4558de0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:32.198060 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883490a6-7c94-4d47-a3b2-aad4558de0c9 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:32.198342 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883490a6-7c94-4d47-a3b2-aad4558de0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:32.198618 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883490a6-7c94-4d47-a3b2-aad4558de0c9 None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:32.199355 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883490a6-7c94-4d47-a3b2-aad4558de0c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:58:32.199711 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883490a6-7c94-4d47-a3b2-aad4558de0c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:32.201577 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883490a6-7c94-4d47-a3b2-aad4558de0c9 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:32.209249 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 595/1196] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:58:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:58:32.214884 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d3d38-0b8b-4b97-ad82-1aa20949645e None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:32.305985 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d3d38-0b8b-4b97-ad82-1aa20949645e None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:32.337535 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b325cf-ac76-4d4d-bad1-f90601696ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:32.338319 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b325cf-ac76-4d4d-bad1-f90601696ccf None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:32.338602 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b325cf-ac76-4d4d-bad1-f90601696ccf None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:32.338880 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b325cf-ac76-4d4d-bad1-f90601696ccf None admin] PATH_INFO: `/v3/users/01e08bb9061e4d7f9cd6f01e7eb9b554` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:32.340063 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b325cf-ac76-4d4d-bad1-f90601696ccf None admin] RBAC: Authorizing `identity:get_user(user_id=01e08bb9061e4d7f9cd6f01e7eb9b554)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:32.341502 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b325cf-ac76-4d4d-bad1-f90601696ccf None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:32.343063 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 602/1197] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Mar 10 03:58:32 2022] GET /identity/v3/users/01e08bb9061e4d7f9cd6f01e7eb9b554 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:58:32.348636 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883490a6-7c94-4d47-a3b2-aad4558de0c9 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:32.439985 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883490a6-7c94-4d47-a3b2-aad4558de0c9 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:32.471509 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7d603-7db1-4e7b-b133-75f0b6d384ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:32.472158 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7d603-7db1-4e7b-b133-75f0b6d384ef None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:32.472439 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7d603-7db1-4e7b-b133-75f0b6d384ef None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:32.472712 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7d603-7db1-4e7b-b133-75f0b6d384ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:32.535893 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7d603-7db1-4e7b-b133-75f0b6d384ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:32.537319 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7d603-7db1-4e7b-b133-75f0b6d384ef None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:32.627610 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 596/1198] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:58:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 03:58:32.633483 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b325cf-ac76-4d4d-bad1-f90601696ccf None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:32.726519 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b325cf-ac76-4d4d-bad1-f90601696ccf None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:32.757662 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40aff91-5c31-4079-a998-d69efa186ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:32.758500 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40aff91-5c31-4079-a998-d69efa186ae6 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:32.758783 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40aff91-5c31-4079-a998-d69efa186ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:32.759058 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40aff91-5c31-4079-a998-d69efa186ae6 None admin] PATH_INFO: `/v3/projects/1a45b9508a6d4524ad9eef2199a03948` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:32.760233 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40aff91-5c31-4079-a998-d69efa186ae6 None admin] RBAC: Authorizing `identity:get_project(project_id=1a45b9508a6d4524ad9eef2199a03948)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:32.761640 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40aff91-5c31-4079-a998-d69efa186ae6 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:32.763299 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 603/1199] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Mar 10 03:58:32 2022] GET /identity/v3/projects/1a45b9508a6d4524ad9eef2199a03948 => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:58:32.769380 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7d603-7db1-4e7b-b133-75f0b6d384ef None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:58:32.860130 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7d603-7db1-4e7b-b133-75f0b6d384ef None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:58:32.891454 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d293e-53f4-47bb-8a0b-15fe20a7c09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:58:32.892057 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d293e-53f4-47bb-8a0b-15fe20a7c09e None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:58:32.892336 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d293e-53f4-47bb-8a0b-15fe20a7c09e None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:58:32.892608 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d293e-53f4-47bb-8a0b-15fe20a7c09e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:58:32.893412 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d293e-53f4-47bb-8a0b-15fe20a7c09e None admin] RBAC: Adding query filter params (role.id=a8b2a5887cec4a31b7304792af3dd3f1, scope.project.id=1a45b9508a6d4524ad9eef2199a03948, user.id=01e08bb9061e4d7f9cd6f01e7eb9b554) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:58:32.893715 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d293e-53f4-47bb-8a0b-15fe20a7c09e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:58:32.895109 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d293e-53f4-47bb-8a0b-15fe20a7c09e None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:58:32.900579 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 597/1200] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:58:32 2022] GET /identity/v3/role_assignments?user.id=01e08bb9061e4d7f9cd6f01e7eb9b554&scope.project.id=1a45b9508a6d4524ad9eef2199a03948&role.id=a8b2a5887cec4a31b7304792af3dd3f1 => generated 608 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:59:33.930395 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd6131-201c-48c2-9771-9fe58fe76997 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:33.930984 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd6131-201c-48c2-9771-9fe58fe76997 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:33.930984 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd6131-201c-48c2-9771-9fe58fe76997 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:33.933549 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 604/1201] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:59:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 03:59:33.939726 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dca0e0-a041-461d-9c6b-96263df54011 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:33.939726 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dca0e0-a041-461d-9c6b-96263df54011 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:33.940287 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dca0e0-a041-461d-9c6b-96263df54011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:33.960451 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-36dca0e0-a041-461d-9c6b-96263df54011 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:59:33.961657 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-36dca0e0-a041-461d-9c6b-96263df54011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:59:34.033078 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 598/1202] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:59:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 03:59:34.057428 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd6131-201c-48c2-9771-9fe58fe76997 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:34.184411 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd6131-201c-48c2-9771-9fe58fe76997 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:34.233423 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095672ba-9f3b-49db-a6ea-858a33c4dd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:34.235146 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095672ba-9f3b-49db-a6ea-858a33c4dd80 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:34.235502 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095672ba-9f3b-49db-a6ea-858a33c4dd80 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:34.235888 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095672ba-9f3b-49db-a6ea-858a33c4dd80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:34.248036 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095672ba-9f3b-49db-a6ea-858a33c4dd80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:34.249496 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095672ba-9f3b-49db-a6ea-858a33c4dd80 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:34.267296 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-095672ba-9f3b-49db-a6ea-858a33c4dd80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:59:34.269484 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 605/1203] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:59:34.274971 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dca0e0-a041-461d-9c6b-96263df54011 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:34.393787 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dca0e0-a041-461d-9c6b-96263df54011 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:34.446054 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae74a5-2ecb-4a75-bf07-039337e2827f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:34.446671 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae74a5-2ecb-4a75-bf07-039337e2827f None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:34.446950 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae74a5-2ecb-4a75-bf07-039337e2827f None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:34.447225 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae74a5-2ecb-4a75-bf07-039337e2827f None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:34.447983 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae74a5-2ecb-4a75-bf07-039337e2827f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:59:34.448356 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae74a5-2ecb-4a75-bf07-039337e2827f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:34.449879 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae74a5-2ecb-4a75-bf07-039337e2827f None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:34.462853 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 599/1204] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:59:34.468458 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095672ba-9f3b-49db-a6ea-858a33c4dd80 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:34.611913 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095672ba-9f3b-49db-a6ea-858a33c4dd80 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:34.655973 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded33ca-8551-49a4-b089-13d6789b7f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:34.656714 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded33ca-8551-49a4-b089-13d6789b7f5c None admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:34.656996 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded33ca-8551-49a4-b089-13d6789b7f5c None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:34.657336 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded33ca-8551-49a4-b089-13d6789b7f5c None admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:34.658125 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded33ca-8551-49a4-b089-13d6789b7f5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:34.660415 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded33ca-8551-49a4-b089-13d6789b7f5c None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:34.690647 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 606/1205] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Mar 10 03:59:34 2022] POST /identity/v3/users => generated 251 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 03:59:37.282226 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79ea69-d559-488f-afb1-05d398f911bf None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:37.282766 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79ea69-d559-488f-afb1-05d398f911bf None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:37.282766 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79ea69-d559-488f-afb1-05d398f911bf None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:37.284645 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 600/1206] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:59:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:59:37.290061 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6d80f-cbc5-43a8-a0e3-67880baa1089 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:37.292540 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6d80f-cbc5-43a8-a0e3-67880baa1089 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:37.292540 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6d80f-cbc5-43a8-a0e3-67880baa1089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:37.309288 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-1fb6d80f-cbc5-43a8-a0e3-67880baa1089 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:59:37.310908 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-1fb6d80f-cbc5-43a8-a0e3-67880baa1089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:59:37.386540 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 607/1207] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:59:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:59:37.409840 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79ea69-d559-488f-afb1-05d398f911bf None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:37.520296 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79ea69-d559-488f-afb1-05d398f911bf None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:37.556441 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfbf2e-a1ad-4ec1-8743-a1a081a9bea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:37.557235 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfbf2e-a1ad-4ec1-8743-a1a081a9bea0 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:37.557571 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfbf2e-a1ad-4ec1-8743-a1a081a9bea0 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:37.557830 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfbf2e-a1ad-4ec1-8743-a1a081a9bea0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:37.569428 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfbf2e-a1ad-4ec1-8743-a1a081a9bea0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:59:37.577425 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-fbbfbf2e-a1ad-4ec1-8743-a1a081a9bea0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 03:59:37.578371 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 601/1208] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Mar 10 03:59:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:59:37.584698 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6d80f-cbc5-43a8-a0e3-67880baa1089 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:37.690268 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6d80f-cbc5-43a8-a0e3-67880baa1089 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:37.724660 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efb442-8df9-4a22-ad62-7930438d41b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:37.725345 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efb442-8df9-4a22-ad62-7930438d41b2 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:37.725650 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efb442-8df9-4a22-ad62-7930438d41b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:37.725961 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69efb442-8df9-4a22-ad62-7930438d41b2 None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:37.726806 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69efb442-8df9-4a22-ad62-7930438d41b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:59:37.728150 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69efb442-8df9-4a22-ad62-7930438d41b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:37.728487 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69efb442-8df9-4a22-ad62-7930438d41b2 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:37.737709 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 608/1209] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Mar 10 03:59:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:59:37.743772 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfbf2e-a1ad-4ec1-8743-a1a081a9bea0 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:37.856400 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfbf2e-a1ad-4ec1-8743-a1a081a9bea0 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:37.892013 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a601b48-5a30-4320-9fe5-ef6beace20cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:37.892870 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a601b48-5a30-4320-9fe5-ef6beace20cf None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:37.893148 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a601b48-5a30-4320-9fe5-ef6beace20cf None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:37.893396 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a601b48-5a30-4320-9fe5-ef6beace20cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:37.905907 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a601b48-5a30-4320-9fe5-ef6beace20cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:37.907453 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a601b48-5a30-4320-9fe5-ef6beace20cf None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:37.926315 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-6a601b48-5a30-4320-9fe5-ef6beace20cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:59:37.927908 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 602/1210] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:59:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:59:37.933577 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efb442-8df9-4a22-ad62-7930438d41b2 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:38.045735 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69efb442-8df9-4a22-ad62-7930438d41b2 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:38.079409 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651fb6d-e68d-4551-abc7-256421b8699d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:38.080122 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651fb6d-e68d-4551-abc7-256421b8699d None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:38.080451 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651fb6d-e68d-4551-abc7-256421b8699d None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:38.080672 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651fb6d-e68d-4551-abc7-256421b8699d None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:38.081412 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651fb6d-e68d-4551-abc7-256421b8699d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:59:38.081806 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651fb6d-e68d-4551-abc7-256421b8699d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:38.083290 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651fb6d-e68d-4551-abc7-256421b8699d None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:38.102043 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 609/1211] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:59:38.103721 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a601b48-5a30-4320-9fe5-ef6beace20cf None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:38.211313 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a601b48-5a30-4320-9fe5-ef6beace20cf None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:38.246960 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a6b78-d4b1-40eb-a913-eec69a7fd335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:38.247791 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a6b78-d4b1-40eb-a913-eec69a7fd335 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:38.248123 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a6b78-d4b1-40eb-a913-eec69a7fd335 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:38.248399 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a6b78-d4b1-40eb-a913-eec69a7fd335 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:38.256742 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a6b78-d4b1-40eb-a913-eec69a7fd335 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:38.258308 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a6b78-d4b1-40eb-a913-eec69a7fd335 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:38.273046 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-229a6b78-d4b1-40eb-a913-eec69a7fd335 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 10 03:59:38.275452 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 603/1212] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:59:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:59:38.281541 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651fb6d-e68d-4551-abc7-256421b8699d None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:38.391893 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651fb6d-e68d-4551-abc7-256421b8699d None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:38.426224 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568bb47-1d56-4f88-87d1-f434644a3d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:38.426885 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568bb47-1d56-4f88-87d1-f434644a3d82 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:38.427169 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568bb47-1d56-4f88-87d1-f434644a3d82 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:38.427438 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568bb47-1d56-4f88-87d1-f434644a3d82 None admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:38.428442 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568bb47-1d56-4f88-87d1-f434644a3d82 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:59:38.429761 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568bb47-1d56-4f88-87d1-f434644a3d82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:38.431262 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568bb47-1d56-4f88-87d1-f434644a3d82 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:38.449610 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 610/1213] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Mar 10 03:59:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:59:38.455369 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a6b78-d4b1-40eb-a913-eec69a7fd335 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:38.559245 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a6b78-d4b1-40eb-a913-eec69a7fd335 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:38.600495 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4550070-4362-4e69-8d96-c7e58aec685c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:38.601173 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4550070-4362-4e69-8d96-c7e58aec685c None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:38.601457 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4550070-4362-4e69-8d96-c7e58aec685c None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:38.601733 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4550070-4362-4e69-8d96-c7e58aec685c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:38.679405 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4550070-4362-4e69-8d96-c7e58aec685c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:38.680931 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4550070-4362-4e69-8d96-c7e58aec685c None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:38.790430 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 604/1214] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:59:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 03:59:38.796789 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568bb47-1d56-4f88-87d1-f434644a3d82 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:38.897335 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568bb47-1d56-4f88-87d1-f434644a3d82 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:38.931141 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a11b4-7994-4501-9810-bb02ac2cf556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:38.931968 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a11b4-7994-4501-9810-bb02ac2cf556 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:38.932183 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a11b4-7994-4501-9810-bb02ac2cf556 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:38.932445 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a11b4-7994-4501-9810-bb02ac2cf556 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:38.943251 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a11b4-7994-4501-9810-bb02ac2cf556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:38.944770 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a11b4-7994-4501-9810-bb02ac2cf556 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:38.962243 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-530a11b4-7994-4501-9810-bb02ac2cf556 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:59:38.963747 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 611/1215] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:59:38.969070 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4550070-4362-4e69-8d96-c7e58aec685c None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:39.091844 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4550070-4362-4e69-8d96-c7e58aec685c None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:39.130374 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d167e5-3d4d-4373-ab01-1460980288d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:39.131111 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d167e5-3d4d-4373-ab01-1460980288d2 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:39.131487 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d167e5-3d4d-4373-ab01-1460980288d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:39.131725 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d167e5-3d4d-4373-ab01-1460980288d2 None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:39.132570 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d167e5-3d4d-4373-ab01-1460980288d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:59:39.132909 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d167e5-3d4d-4373-ab01-1460980288d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:39.134418 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d167e5-3d4d-4373-ab01-1460980288d2 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:39.153541 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 605/1216] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:59:39.154785 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a11b4-7994-4501-9810-bb02ac2cf556 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:39.266728 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a11b4-7994-4501-9810-bb02ac2cf556 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:39.305521 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2efde6-66fe-4872-9ec4-7c0f64e1515e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:39.306293 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2efde6-66fe-4872-9ec4-7c0f64e1515e None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:39.306636 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2efde6-66fe-4872-9ec4-7c0f64e1515e None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:39.306982 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2efde6-66fe-4872-9ec4-7c0f64e1515e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:39.316179 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2efde6-66fe-4872-9ec4-7c0f64e1515e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:39.317951 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2efde6-66fe-4872-9ec4-7c0f64e1515e None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:39.334944 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-7d2efde6-66fe-4872-9ec4-7c0f64e1515e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:59:39.341736 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 612/1217] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:59:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:59:39.343512 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d167e5-3d4d-4373-ab01-1460980288d2 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:39.456766 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d167e5-3d4d-4373-ab01-1460980288d2 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:39.496469 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680ca4e-1066-4130-9894-d52c07add305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:39.497125 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680ca4e-1066-4130-9894-d52c07add305 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:39.497406 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680ca4e-1066-4130-9894-d52c07add305 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:39.497679 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680ca4e-1066-4130-9894-d52c07add305 None admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:39.498451 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680ca4e-1066-4130-9894-d52c07add305 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:59:39.498753 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680ca4e-1066-4130-9894-d52c07add305 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:39.500198 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680ca4e-1066-4130-9894-d52c07add305 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:39.515188 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 606/1218] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:59:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:59:39.521432 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2efde6-66fe-4872-9ec4-7c0f64e1515e None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:39.635141 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2efde6-66fe-4872-9ec4-7c0f64e1515e None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:39.681914 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e67294-5d37-446b-b377-e2da2d5bb8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:39.682720 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e67294-5d37-446b-b377-e2da2d5bb8ec None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:39.683001 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e67294-5d37-446b-b377-e2da2d5bb8ec None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:39.683276 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e67294-5d37-446b-b377-e2da2d5bb8ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:39.684172 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e67294-5d37-446b-b377-e2da2d5bb8ec None admin] RBAC: Adding query filter params (role.id=3fb134668432434eb45c3bb21cb5882e, scope.project.id=0846fccaeb674395a87e45290eda74b7, user.id=319da006b10c41f8aa8a9d5aa2225b60) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:59:39.684492 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e67294-5d37-446b-b377-e2da2d5bb8ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:39.685954 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e67294-5d37-446b-b377-e2da2d5bb8ec None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:39.693485 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 613/1219] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:59:39 2022] GET /identity/v3/role_assignments?user.id=319da006b10c41f8aa8a9d5aa2225b60&scope.project.id=0846fccaeb674395a87e45290eda74b7&role.id=3fb134668432434eb45c3bb21cb5882e => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:59:42.172191 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13927fb5-1ab4-4cbf-9452-5dd1f9703963 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:42.172880 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13927fb5-1ab4-4cbf-9452-5dd1f9703963 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:42.172880 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13927fb5-1ab4-4cbf-9452-5dd1f9703963 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:42.175182 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 607/1220] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:59:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:59:42.180623 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d531f61-64b0-4a4c-8688-0ddac1e498ba None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:42.181049 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d531f61-64b0-4a4c-8688-0ddac1e498ba None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:42.181174 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d531f61-64b0-4a4c-8688-0ddac1e498ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:42.200060 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-1d531f61-64b0-4a4c-8688-0ddac1e498ba None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:59:42.201247 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-1d531f61-64b0-4a4c-8688-0ddac1e498ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:59:42.277251 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 614/1221] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:59:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:59:42.300028 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13927fb5-1ab4-4cbf-9452-5dd1f9703963 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:42.418888 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13927fb5-1ab4-4cbf-9452-5dd1f9703963 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:42.455187 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebd7a7-a1b0-49c8-8f78-e0e345952fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:42.456022 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebd7a7-a1b0-49c8-8f78-e0e345952fc7 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:42.456395 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebd7a7-a1b0-49c8-8f78-e0e345952fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:42.456739 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebd7a7-a1b0-49c8-8f78-e0e345952fc7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:42.469055 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebd7a7-a1b0-49c8-8f78-e0e345952fc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:59:42.477114 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-d2ebd7a7-a1b0-49c8-8f78-e0e345952fc7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 03:59:42.478473 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 608/1222] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Mar 10 03:59:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:59:42.485672 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d531f61-64b0-4a4c-8688-0ddac1e498ba None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:42.595893 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d531f61-64b0-4a4c-8688-0ddac1e498ba None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:42.636674 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff032d-3aea-47c7-ab06-72c4f90e51a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:42.637543 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff032d-3aea-47c7-ab06-72c4f90e51a7 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:42.637890 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff032d-3aea-47c7-ab06-72c4f90e51a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:42.638190 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff032d-3aea-47c7-ab06-72c4f90e51a7 None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:42.638994 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff032d-3aea-47c7-ab06-72c4f90e51a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:59:42.639297 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff032d-3aea-47c7-ab06-72c4f90e51a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:42.640775 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff032d-3aea-47c7-ab06-72c4f90e51a7 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:42.649477 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 615/1223] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Mar 10 03:59:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:59:42.655712 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebd7a7-a1b0-49c8-8f78-e0e345952fc7 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:42.762907 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebd7a7-a1b0-49c8-8f78-e0e345952fc7 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:42.798517 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c56b6a-06db-41ec-8d68-b2e25b4dadee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:42.799670 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c56b6a-06db-41ec-8d68-b2e25b4dadee None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:42.800109 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c56b6a-06db-41ec-8d68-b2e25b4dadee None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:42.800391 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c56b6a-06db-41ec-8d68-b2e25b4dadee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:42.813931 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c56b6a-06db-41ec-8d68-b2e25b4dadee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:42.815442 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c56b6a-06db-41ec-8d68-b2e25b4dadee None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:42.831239 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-f0c56b6a-06db-41ec-8d68-b2e25b4dadee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:59:42.832434 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 609/1224] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:59:42.838402 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff032d-3aea-47c7-ab06-72c4f90e51a7 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:42.935433 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff032d-3aea-47c7-ab06-72c4f90e51a7 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:42.967505 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7d06d-16f6-4ede-b6d8-ce0e1f1fa69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:42.968184 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7d06d-16f6-4ede-b6d8-ce0e1f1fa69c None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:42.968468 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7d06d-16f6-4ede-b6d8-ce0e1f1fa69c None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:42.968748 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7d06d-16f6-4ede-b6d8-ce0e1f1fa69c None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:42.969434 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7d06d-16f6-4ede-b6d8-ce0e1f1fa69c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:59:42.969733 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7d06d-16f6-4ede-b6d8-ce0e1f1fa69c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:42.971081 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7d06d-16f6-4ede-b6d8-ce0e1f1fa69c None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:42.983426 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 616/1225] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:59:42.989138 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c56b6a-06db-41ec-8d68-b2e25b4dadee None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:43.103522 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c56b6a-06db-41ec-8d68-b2e25b4dadee None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:43.142550 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dff221-2bda-4ecb-aa09-1d52049c56b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:43.143481 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dff221-2bda-4ecb-aa09-1d52049c56b8 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:43.143834 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dff221-2bda-4ecb-aa09-1d52049c56b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:43.144263 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dff221-2bda-4ecb-aa09-1d52049c56b8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:43.155793 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dff221-2bda-4ecb-aa09-1d52049c56b8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:43.157258 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dff221-2bda-4ecb-aa09-1d52049c56b8 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:43.171542 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-18dff221-2bda-4ecb-aa09-1d52049c56b8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 10 03:59:43.172793 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 610/1226] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:59:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:59:43.179196 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7d06d-16f6-4ede-b6d8-ce0e1f1fa69c None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:43.281028 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7d06d-16f6-4ede-b6d8-ce0e1f1fa69c None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:43.314241 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ae878-1eb0-404c-8946-722395fad073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:43.314898 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ae878-1eb0-404c-8946-722395fad073 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:43.315179 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ae878-1eb0-404c-8946-722395fad073 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:43.315478 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ae878-1eb0-404c-8946-722395fad073 None admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:43.316329 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ae878-1eb0-404c-8946-722395fad073 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:59:43.316620 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ae878-1eb0-404c-8946-722395fad073 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:43.318147 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ae878-1eb0-404c-8946-722395fad073 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:43.335715 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 617/1227] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Mar 10 03:59:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:59:43.341987 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dff221-2bda-4ecb-aa09-1d52049c56b8 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:43.454112 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dff221-2bda-4ecb-aa09-1d52049c56b8 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:43.490540 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735655f-07c5-4be0-b692-c31d6a724b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:43.491467 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735655f-07c5-4be0-b692-c31d6a724b45 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:43.491776 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735655f-07c5-4be0-b692-c31d6a724b45 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:43.492055 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735655f-07c5-4be0-b692-c31d6a724b45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:43.502451 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735655f-07c5-4be0-b692-c31d6a724b45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:43.503935 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735655f-07c5-4be0-b692-c31d6a724b45 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:43.520061 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-a735655f-07c5-4be0-b692-c31d6a724b45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:59:43.521229 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 611/1228] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:59:43.527381 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ae878-1eb0-404c-8946-722395fad073 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:43.644064 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ae878-1eb0-404c-8946-722395fad073 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:43.679269 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7164c-5b9d-4e6e-8282-b5ff8387f222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:43.679952 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7164c-5b9d-4e6e-8282-b5ff8387f222 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:43.680232 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7164c-5b9d-4e6e-8282-b5ff8387f222 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:43.680551 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7164c-5b9d-4e6e-8282-b5ff8387f222 None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:43.681213 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd7164c-5b9d-4e6e-8282-b5ff8387f222 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:59:43.681510 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd7164c-5b9d-4e6e-8282-b5ff8387f222 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:43.683384 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd7164c-5b9d-4e6e-8282-b5ff8387f222 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:43.697043 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 618/1229] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:59:43.704660 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735655f-07c5-4be0-b692-c31d6a724b45 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:43.815880 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735655f-07c5-4be0-b692-c31d6a724b45 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:43.855635 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322fc9b-9df6-42c2-9a6e-fb60355a95df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:43.856458 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322fc9b-9df6-42c2-9a6e-fb60355a95df None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:43.856741 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322fc9b-9df6-42c2-9a6e-fb60355a95df None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:43.857019 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322fc9b-9df6-42c2-9a6e-fb60355a95df None admin] PATH_INFO: `/v3/projects/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:43.863896 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f322fc9b-9df6-42c2-9a6e-fb60355a95df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:43.865331 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f322fc9b-9df6-42c2-9a6e-fb60355a95df None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:43.880952 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-f322fc9b-9df6-42c2-9a6e-fb60355a95df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:59:43.882152 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 612/1230] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:59:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:59:43.890396 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7164c-5b9d-4e6e-8282-b5ff8387f222 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:43.991852 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7164c-5b9d-4e6e-8282-b5ff8387f222 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:44.026254 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30adde-b75a-4436-9a03-b34d858028c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:44.027031 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30adde-b75a-4436-9a03-b34d858028c1 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:44.027322 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30adde-b75a-4436-9a03-b34d858028c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:44.027595 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30adde-b75a-4436-9a03-b34d858028c1 None admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:44.028440 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e30adde-b75a-4436-9a03-b34d858028c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:59:44.028871 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e30adde-b75a-4436-9a03-b34d858028c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:44.030851 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e30adde-b75a-4436-9a03-b34d858028c1 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:44.046727 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 619/1231] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:59:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:59:44.053411 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322fc9b-9df6-42c2-9a6e-fb60355a95df None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:44.165576 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322fc9b-9df6-42c2-9a6e-fb60355a95df None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:44.202471 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8dabf5-c7cf-45de-83e7-7b26b07dd30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:44.203512 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8dabf5-c7cf-45de-83e7-7b26b07dd30d None admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:44.203820 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8dabf5-c7cf-45de-83e7-7b26b07dd30d None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:44.204103 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8dabf5-c7cf-45de-83e7-7b26b07dd30d None admin] PATH_INFO: `/v3/projects/0846fccaeb674395a87e45290eda74b7/users/319da006b10c41f8aa8a9d5aa2225b60/roles/3fb134668432434eb45c3bb21cb5882e` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:44.219736 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8dabf5-c7cf-45de-83e7-7b26b07dd30d None admin] RBAC: Authorizing `identity:create_grant(project_id=0846fccaeb674395a87e45290eda74b7, user_id=319da006b10c41f8aa8a9d5aa2225b60, role_id=3fb134668432434eb45c3bb21cb5882e)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:44.221281 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8dabf5-c7cf-45de-83e7-7b26b07dd30d None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:44.234523 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 613/1232] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Mar 10 03:59:44 2022] PUT /identity/v3/projects/0846fccaeb674395a87e45290eda74b7/users/319da006b10c41f8aa8a9d5aa2225b60/roles/3fb134668432434eb45c3bb21cb5882e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 03:59:46.747113 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2b548-cfac-47a5-a8ac-62c2dd15088d None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:46.747787 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2b548-cfac-47a5-a8ac-62c2dd15088d None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:46.747787 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2b548-cfac-47a5-a8ac-62c2dd15088d None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:46.749791 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 620/1233] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:59:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:59:46.755125 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028eef5-df46-442c-a92c-c3cc8b81c3fa None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:46.755768 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028eef5-df46-442c-a92c-c3cc8b81c3fa None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:46.755768 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028eef5-df46-442c-a92c-c3cc8b81c3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:46.773178 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-6028eef5-df46-442c-a92c-c3cc8b81c3fa None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:59:46.774380 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-6028eef5-df46-442c-a92c-c3cc8b81c3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:59:46.845568 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 614/1234] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:59:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 03:59:46.869676 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2b548-cfac-47a5-a8ac-62c2dd15088d None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:46.975249 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2b548-cfac-47a5-a8ac-62c2dd15088d None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:47.009672 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a917b-2f6d-4b8e-87a3-aaeb7f685e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:47.010911 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a917b-2f6d-4b8e-87a3-aaeb7f685e54 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:47.011189 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a917b-2f6d-4b8e-87a3-aaeb7f685e54 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:47.011457 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a917b-2f6d-4b8e-87a3-aaeb7f685e54 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:47.021615 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a917b-2f6d-4b8e-87a3-aaeb7f685e54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:59:47.029270 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-d62a917b-2f6d-4b8e-87a3-aaeb7f685e54 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 10 03:59:47.030511 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 621/1235] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Mar 10 03:59:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:59:47.036555 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028eef5-df46-442c-a92c-c3cc8b81c3fa None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:47.140683 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028eef5-df46-442c-a92c-c3cc8b81c3fa None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:47.177859 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d183be-4fd8-49c8-8fe1-4c37f792b534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:47.178532 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d183be-4fd8-49c8-8fe1-4c37f792b534 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:47.178819 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d183be-4fd8-49c8-8fe1-4c37f792b534 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:47.179099 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d183be-4fd8-49c8-8fe1-4c37f792b534 None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:47.179880 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d183be-4fd8-49c8-8fe1-4c37f792b534 None admin] RBAC: Adding query filter params (name=service) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:59:47.180189 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d183be-4fd8-49c8-8fe1-4c37f792b534 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:47.181564 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d183be-4fd8-49c8-8fe1-4c37f792b534 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:47.191766 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 615/1236] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Mar 10 03:59:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:59:47.197496 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a917b-2f6d-4b8e-87a3-aaeb7f685e54 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:47.299421 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a917b-2f6d-4b8e-87a3-aaeb7f685e54 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:47.333433 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7b37b-51a4-419a-8f6c-d2153d7d8a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:47.334219 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7b37b-51a4-419a-8f6c-d2153d7d8a8c None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:47.334498 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7b37b-51a4-419a-8f6c-d2153d7d8a8c None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:47.334768 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7b37b-51a4-419a-8f6c-d2153d7d8a8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:47.345146 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7b37b-51a4-419a-8f6c-d2153d7d8a8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:47.346585 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae7b37b-51a4-419a-8f6c-d2153d7d8a8c None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:47.362551 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-bae7b37b-51a4-419a-8f6c-d2153d7d8a8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:59:47.364218 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 622/1237] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 10 03:59:47.370578 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d183be-4fd8-49c8-8fe1-4c37f792b534 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:47.478995 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d183be-4fd8-49c8-8fe1-4c37f792b534 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:47.517699 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b347ce-be68-444c-b9a7-18d4ffa5dd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:47.518375 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b347ce-be68-444c-b9a7-18d4ffa5dd88 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:47.518750 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b347ce-be68-444c-b9a7-18d4ffa5dd88 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:47.518963 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b347ce-be68-444c-b9a7-18d4ffa5dd88 None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:47.519845 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b347ce-be68-444c-b9a7-18d4ffa5dd88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:59:47.520150 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b347ce-be68-444c-b9a7-18d4ffa5dd88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:47.521507 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b347ce-be68-444c-b9a7-18d4ffa5dd88 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:47.533946 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 616/1238] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:59:47.539509 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7b37b-51a4-419a-8f6c-d2153d7d8a8c None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:47.659900 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7b37b-51a4-419a-8f6c-d2153d7d8a8c None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:47.698549 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8ace0-7347-4b7c-95b3-02169e5afaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:47.699385 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8ace0-7347-4b7c-95b3-02169e5afaf4 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:47.699821 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8ace0-7347-4b7c-95b3-02169e5afaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:47.700099 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8ace0-7347-4b7c-95b3-02169e5afaf4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:47.709141 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a8ace0-7347-4b7c-95b3-02169e5afaf4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:47.710562 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a8ace0-7347-4b7c-95b3-02169e5afaf4 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:47.726362 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-d7a8ace0-7347-4b7c-95b3-02169e5afaf4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 10 03:59:47.727523 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 623/1239] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:59:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:59:47.734514 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b347ce-be68-444c-b9a7-18d4ffa5dd88 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:47.845710 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b347ce-be68-444c-b9a7-18d4ffa5dd88 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:47.879532 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b455bc-c761-48ea-9909-5ded8e56f33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:47.880322 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b455bc-c761-48ea-9909-5ded8e56f33c None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:47.880818 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b455bc-c761-48ea-9909-5ded8e56f33c None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:47.881112 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b455bc-c761-48ea-9909-5ded8e56f33c None admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:47.882167 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b455bc-c761-48ea-9909-5ded8e56f33c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:59:47.882571 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b455bc-c761-48ea-9909-5ded8e56f33c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:47.884495 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b455bc-c761-48ea-9909-5ded8e56f33c None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:47.905803 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 617/1240] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Mar 10 03:59:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:59:47.911844 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8ace0-7347-4b7c-95b3-02169e5afaf4 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:48.014671 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8ace0-7347-4b7c-95b3-02169e5afaf4 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:48.050813 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bc489-e3a1-4557-9b8d-8c326c298d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:48.051489 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bc489-e3a1-4557-9b8d-8c326c298d89 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:48.051799 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bc489-e3a1-4557-9b8d-8c326c298d89 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:48.052119 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bc489-e3a1-4557-9b8d-8c326c298d89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:48.121816 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bc489-e3a1-4557-9b8d-8c326c298d89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:48.123631 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bc489-e3a1-4557-9b8d-8c326c298d89 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:48.231390 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 624/1241] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:59:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 03:59:48.237263 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b455bc-c761-48ea-9909-5ded8e56f33c None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:48.347475 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b455bc-c761-48ea-9909-5ded8e56f33c None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:48.387573 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66507514-f783-4bd7-a52d-b4150d04eef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:48.388419 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66507514-f783-4bd7-a52d-b4150d04eef1 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:48.388707 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66507514-f783-4bd7-a52d-b4150d04eef1 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:48.389061 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66507514-f783-4bd7-a52d-b4150d04eef1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:48.400619 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66507514-f783-4bd7-a52d-b4150d04eef1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:48.402886 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66507514-f783-4bd7-a52d-b4150d04eef1 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:48.421096 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-66507514-f783-4bd7-a52d-b4150d04eef1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:59:48.422454 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 618/1242] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:59:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:59:48.428652 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bc489-e3a1-4557-9b8d-8c326c298d89 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:48.541437 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bc489-e3a1-4557-9b8d-8c326c298d89 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:48.580188 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f65a05-0a25-4dca-8944-63507343143e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:48.580933 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f65a05-0a25-4dca-8944-63507343143e None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:48.581293 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f65a05-0a25-4dca-8944-63507343143e None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:48.581607 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f65a05-0a25-4dca-8944-63507343143e None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:48.582320 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f65a05-0a25-4dca-8944-63507343143e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:59:48.582667 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f65a05-0a25-4dca-8944-63507343143e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:48.584246 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f65a05-0a25-4dca-8944-63507343143e None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:48.602207 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 625/1243] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:59:48.603745 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66507514-f783-4bd7-a52d-b4150d04eef1 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:48.720098 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66507514-f783-4bd7-a52d-b4150d04eef1 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:48.756207 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa5f5e-9c0f-49f3-8d2d-469b07866d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:48.757067 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa5f5e-9c0f-49f3-8d2d-469b07866d19 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:48.757334 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa5f5e-9c0f-49f3-8d2d-469b07866d19 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:48.757641 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa5f5e-9c0f-49f3-8d2d-469b07866d19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:48.765977 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa5f5e-9c0f-49f3-8d2d-469b07866d19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:48.767677 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa5f5e-9c0f-49f3-8d2d-469b07866d19 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:48.783720 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-afaa5f5e-9c0f-49f3-8d2d-469b07866d19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:59:48.785332 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 619/1244] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:59:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:59:48.791225 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f65a05-0a25-4dca-8944-63507343143e None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:48.899257 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f65a05-0a25-4dca-8944-63507343143e None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:48.935315 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb5c71-5049-40ac-8099-4858245609f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:48.936063 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb5c71-5049-40ac-8099-4858245609f9 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:48.936319 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb5c71-5049-40ac-8099-4858245609f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:48.936590 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb5c71-5049-40ac-8099-4858245609f9 None admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:48.937463 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb5c71-5049-40ac-8099-4858245609f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:59:48.937779 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb5c71-5049-40ac-8099-4858245609f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:48.939616 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb5c71-5049-40ac-8099-4858245609f9 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:48.952705 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 626/1245] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:59:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:59:48.958880 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa5f5e-9c0f-49f3-8d2d-469b07866d19 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:49.063699 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa5f5e-9c0f-49f3-8d2d-469b07866d19 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:49.104036 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2d6e7-44ea-49f6-af52-f7684d203739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:49.104723 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2d6e7-44ea-49f6-af52-f7684d203739 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:49.105004 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2d6e7-44ea-49f6-af52-f7684d203739 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:49.105280 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2d6e7-44ea-49f6-af52-f7684d203739 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:49.106178 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2d6e7-44ea-49f6-af52-f7684d203739 None admin] RBAC: Adding query filter params (role.id=3fb134668432434eb45c3bb21cb5882e, scope.project.id=0846fccaeb674395a87e45290eda74b7, user.id=319da006b10c41f8aa8a9d5aa2225b60) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:59:49.106484 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2d6e7-44ea-49f6-af52-f7684d203739 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:49.108137 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2d6e7-44ea-49f6-af52-f7684d203739 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:49.114998 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 620/1246] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:59:48 2022] GET /identity/v3/role_assignments?user.id=319da006b10c41f8aa8a9d5aa2225b60&scope.project.id=0846fccaeb674395a87e45290eda74b7&role.id=3fb134668432434eb45c3bb21cb5882e => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:59:51.650614 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dea29-edde-49bb-9666-8873ea250bb0 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:51.651179 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dea29-edde-49bb-9666-8873ea250bb0 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:51.651287 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dea29-edde-49bb-9666-8873ea250bb0 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:51.653963 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 627/1247] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:59:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:59:51.659993 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cf4a6-110e-4218-a557-d1f6850ae5eb None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:51.660519 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cf4a6-110e-4218-a557-d1f6850ae5eb None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:51.660638 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cf4a6-110e-4218-a557-d1f6850ae5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:51.680140 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-6b0cf4a6-110e-4218-a557-d1f6850ae5eb None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:59:51.681345 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-6b0cf4a6-110e-4218-a557-d1f6850ae5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:59:51.752332 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 621/1248] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:59:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 03:59:51.777053 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016dea29-edde-49bb-9666-8873ea250bb0 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:51.877472 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016dea29-edde-49bb-9666-8873ea250bb0 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:51.909371 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8e20c-5fe2-422a-8a1d-4e3937b07c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:51.910083 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8e20c-5fe2-422a-8a1d-4e3937b07c97 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:51.910363 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8e20c-5fe2-422a-8a1d-4e3937b07c97 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:51.910632 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8e20c-5fe2-422a-8a1d-4e3937b07c97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:51.920495 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8e20c-5fe2-422a-8a1d-4e3937b07c97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:59:51.927515 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-1ed8e20c-5fe2-422a-8a1d-4e3937b07c97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 03:59:51.928760 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 628/1249] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:59:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:59:51.935465 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cf4a6-110e-4218-a557-d1f6850ae5eb None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:52.032014 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cf4a6-110e-4218-a557-d1f6850ae5eb None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:52.066667 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65791a-e28c-4d62-a34e-d56fee5f3da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:52.066667 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65791a-e28c-4d62-a34e-d56fee5f3da2 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:52.066667 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65791a-e28c-4d62-a34e-d56fee5f3da2 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:52.066667 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65791a-e28c-4d62-a34e-d56fee5f3da2 None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:52.067083 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65791a-e28c-4d62-a34e-d56fee5f3da2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:59:52.067154 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65791a-e28c-4d62-a34e-d56fee5f3da2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:52.068932 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65791a-e28c-4d62-a34e-d56fee5f3da2 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:52.077468 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 622/1250] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:59:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:59:52.083296 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8e20c-5fe2-422a-8a1d-4e3937b07c97 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:52.176848 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8e20c-5fe2-422a-8a1d-4e3937b07c97 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:52.207618 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086d9d8-0760-41d5-9829-c8eb0fda1ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:52.208519 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086d9d8-0760-41d5-9829-c8eb0fda1ccc None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:52.208801 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086d9d8-0760-41d5-9829-c8eb0fda1ccc None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:52.209069 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086d9d8-0760-41d5-9829-c8eb0fda1ccc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:52.219524 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086d9d8-0760-41d5-9829-c8eb0fda1ccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:52.220974 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086d9d8-0760-41d5-9829-c8eb0fda1ccc None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:52.236885 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-1086d9d8-0760-41d5-9829-c8eb0fda1ccc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:59:52.238001 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 629/1251] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:59:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:59:52.243807 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65791a-e28c-4d62-a34e-d56fee5f3da2 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:52.336752 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65791a-e28c-4d62-a34e-d56fee5f3da2 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:52.367935 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62920235-4119-4f27-b649-a4e5bb7e4ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:52.368579 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62920235-4119-4f27-b649-a4e5bb7e4ff1 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:52.368862 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62920235-4119-4f27-b649-a4e5bb7e4ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:52.369140 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62920235-4119-4f27-b649-a4e5bb7e4ff1 None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:52.370390 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62920235-4119-4f27-b649-a4e5bb7e4ff1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:59:52.370694 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62920235-4119-4f27-b649-a4e5bb7e4ff1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:52.372062 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62920235-4119-4f27-b649-a4e5bb7e4ff1 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:52.383061 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 623/1252] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:59:52.388345 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086d9d8-0760-41d5-9829-c8eb0fda1ccc None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:52.479839 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086d9d8-0760-41d5-9829-c8eb0fda1ccc None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:52.510029 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c39c9a-bdeb-442c-90fe-a4549087443e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:52.510794 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c39c9a-bdeb-442c-90fe-a4549087443e None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:52.511069 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c39c9a-bdeb-442c-90fe-a4549087443e None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:52.511412 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c39c9a-bdeb-442c-90fe-a4549087443e None admin] PATH_INFO: `/v3/users/placement` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:52.518297 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c39c9a-bdeb-442c-90fe-a4549087443e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:52.519711 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c39c9a-bdeb-442c-90fe-a4549087443e None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:52.533133 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-01c39c9a-bdeb-442c-90fe-a4549087443e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 10 03:59:52.534231 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 630/1253] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:59:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:59:52.539737 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62920235-4119-4f27-b649-a4e5bb7e4ff1 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:52.640270 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62920235-4119-4f27-b649-a4e5bb7e4ff1 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:52.672982 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd2718-5e42-4f97-b0a8-6db70c9630ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:52.673642 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd2718-5e42-4f97-b0a8-6db70c9630ee None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:52.673926 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd2718-5e42-4f97-b0a8-6db70c9630ee None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:52.674201 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd2718-5e42-4f97-b0a8-6db70c9630ee None admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:52.675015 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd2718-5e42-4f97-b0a8-6db70c9630ee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:59:52.675322 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd2718-5e42-4f97-b0a8-6db70c9630ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:52.676763 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd2718-5e42-4f97-b0a8-6db70c9630ee None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:52.692853 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 624/1254] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Mar 10 03:59:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:59:52.698657 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c39c9a-bdeb-442c-90fe-a4549087443e None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:52.788789 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c39c9a-bdeb-442c-90fe-a4549087443e None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:52.819555 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e05a79-7bd5-43c3-ae84-09146d33dcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:52.820200 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e05a79-7bd5-43c3-ae84-09146d33dcf1 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:52.820482 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e05a79-7bd5-43c3-ae84-09146d33dcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:52.820754 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e05a79-7bd5-43c3-ae84-09146d33dcf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:52.881086 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e05a79-7bd5-43c3-ae84-09146d33dcf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:52.882502 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e05a79-7bd5-43c3-ae84-09146d33dcf1 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:52.977607 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 631/1255] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 03:59:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 03:59:52.983334 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd2718-5e42-4f97-b0a8-6db70c9630ee None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:53.074003 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd2718-5e42-4f97-b0a8-6db70c9630ee None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:53.105354 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbf339-8863-4e2e-b9c9-32f8cf4e55a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:53.106120 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbf339-8863-4e2e-b9c9-32f8cf4e55a4 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:53.106397 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbf339-8863-4e2e-b9c9-32f8cf4e55a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:53.106667 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbf339-8863-4e2e-b9c9-32f8cf4e55a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:53.116446 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cbf339-8863-4e2e-b9c9-32f8cf4e55a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:53.118014 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cbf339-8863-4e2e-b9c9-32f8cf4e55a4 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:53.134276 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-f8cbf339-8863-4e2e-b9c9-32f8cf4e55a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:59:53.135978 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 625/1256] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:59:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:59:53.141582 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e05a79-7bd5-43c3-ae84-09146d33dcf1 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:53.232986 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e05a79-7bd5-43c3-ae84-09146d33dcf1 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:53.263945 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca82afa-708b-4f86-9178-ad4025f44b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:53.264581 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca82afa-708b-4f86-9178-ad4025f44b64 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:53.264862 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca82afa-708b-4f86-9178-ad4025f44b64 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:53.265157 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca82afa-708b-4f86-9178-ad4025f44b64 None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:53.265866 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca82afa-708b-4f86-9178-ad4025f44b64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:59:53.266166 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca82afa-708b-4f86-9178-ad4025f44b64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:53.267505 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca82afa-708b-4f86-9178-ad4025f44b64 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:53.278485 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 632/1257] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:59:53.283829 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbf339-8863-4e2e-b9c9-32f8cf4e55a4 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:53.374827 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbf339-8863-4e2e-b9c9-32f8cf4e55a4 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:53.405944 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734aa38-cddd-46ac-982d-2ee69a8d3176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:53.406702 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734aa38-cddd-46ac-982d-2ee69a8d3176 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:53.406978 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734aa38-cddd-46ac-982d-2ee69a8d3176 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:53.407247 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734aa38-cddd-46ac-982d-2ee69a8d3176 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:53.413471 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3734aa38-cddd-46ac-982d-2ee69a8d3176 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:53.414883 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3734aa38-cddd-46ac-982d-2ee69a8d3176 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:53.427243 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-3734aa38-cddd-46ac-982d-2ee69a8d3176 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:59:53.428382 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 626/1258] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:59:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:59:53.434390 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca82afa-708b-4f86-9178-ad4025f44b64 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:53.526787 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca82afa-708b-4f86-9178-ad4025f44b64 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:53.557718 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea797829-bc8d-4de3-b87a-93b3878d7c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:53.558297 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea797829-bc8d-4de3-b87a-93b3878d7c6f None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:53.558672 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea797829-bc8d-4de3-b87a-93b3878d7c6f None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:53.558849 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea797829-bc8d-4de3-b87a-93b3878d7c6f None admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:53.559620 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea797829-bc8d-4de3-b87a-93b3878d7c6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:59:53.560004 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea797829-bc8d-4de3-b87a-93b3878d7c6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:53.561341 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea797829-bc8d-4de3-b87a-93b3878d7c6f None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:53.576802 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 633/1259] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:59:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:59:53.583996 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734aa38-cddd-46ac-982d-2ee69a8d3176 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:53.683219 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734aa38-cddd-46ac-982d-2ee69a8d3176 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:53.713957 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271f950-e09d-47d5-abfa-357cd8c7ee16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:53.714597 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271f950-e09d-47d5-abfa-357cd8c7ee16 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:53.714879 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271f950-e09d-47d5-abfa-357cd8c7ee16 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:53.715154 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271f950-e09d-47d5-abfa-357cd8c7ee16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:53.716010 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271f950-e09d-47d5-abfa-357cd8c7ee16 None admin] RBAC: Adding query filter params (role.id=a8b2a5887cec4a31b7304792af3dd3f1, scope.project.id=0846fccaeb674395a87e45290eda74b7, user.id=319da006b10c41f8aa8a9d5aa2225b60) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:59:53.716322 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271f950-e09d-47d5-abfa-357cd8c7ee16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:53.717738 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271f950-e09d-47d5-abfa-357cd8c7ee16 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:53.722826 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 627/1260] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 03:59:53 2022] GET /identity/v3/role_assignments?user.id=319da006b10c41f8aa8a9d5aa2225b60&scope.project.id=0846fccaeb674395a87e45290eda74b7&role.id=a8b2a5887cec4a31b7304792af3dd3f1 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:59:55.958360 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e95092-b8bb-4ae8-b835-a424ed20204d None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:55.958887 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e95092-b8bb-4ae8-b835-a424ed20204d None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:55.958887 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e95092-b8bb-4ae8-b835-a424ed20204d None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:55.960691 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 634/1261] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:59:55.965877 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff3f93-d6f4-48f7-a60e-de1c91fddac7 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:55.966302 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff3f93-d6f4-48f7-a60e-de1c91fddac7 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:55.966443 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff3f93-d6f4-48f7-a60e-de1c91fddac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:55.983198 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-93ff3f93-d6f4-48f7-a60e-de1c91fddac7 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 03:59:55.984400 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-93ff3f93-d6f4-48f7-a60e-de1c91fddac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 03:59:56.046505 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 628/1262] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:59:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 10 03:59:56.069376 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e95092-b8bb-4ae8-b835-a424ed20204d None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:56.161670 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e95092-b8bb-4ae8-b835-a424ed20204d None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:56.193425 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece71b0-3508-4483-97a4-4c61f7f25860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:56.194199 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece71b0-3508-4483-97a4-4c61f7f25860 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:56.194481 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece71b0-3508-4483-97a4-4c61f7f25860 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:56.194753 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece71b0-3508-4483-97a4-4c61f7f25860 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:56.204239 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece71b0-3508-4483-97a4-4c61f7f25860 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 03:59:56.211133 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-1ece71b0-3508-4483-97a4-4c61f7f25860 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 03:59:56.212248 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 635/1263] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 03:59:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:59:56.218030 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff3f93-d6f4-48f7-a60e-de1c91fddac7 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:56.309524 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff3f93-d6f4-48f7-a60e-de1c91fddac7 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:56.341746 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad93bb-b8c8-467f-b40b-da2d15bb2e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:56.342386 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad93bb-b8c8-467f-b40b-da2d15bb2e19 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:56.342669 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad93bb-b8c8-467f-b40b-da2d15bb2e19 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:56.342944 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad93bb-b8c8-467f-b40b-da2d15bb2e19 None admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:56.343675 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad93bb-b8c8-467f-b40b-da2d15bb2e19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:59:56.344004 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad93bb-b8c8-467f-b40b-da2d15bb2e19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:56.345352 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad93bb-b8c8-467f-b40b-da2d15bb2e19 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:56.352858 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 629/1264] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 03:59:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:59:56.358861 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece71b0-3508-4483-97a4-4c61f7f25860 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:56.450121 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece71b0-3508-4483-97a4-4c61f7f25860 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:56.481404 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9329dd-16cf-4165-b2a2-30b69ee043fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:56.482115 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9329dd-16cf-4165-b2a2-30b69ee043fd None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:56.482394 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9329dd-16cf-4165-b2a2-30b69ee043fd None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:56.482667 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9329dd-16cf-4165-b2a2-30b69ee043fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:56.492380 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9329dd-16cf-4165-b2a2-30b69ee043fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:56.493789 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9329dd-16cf-4165-b2a2-30b69ee043fd None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:56.509196 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-0d9329dd-16cf-4165-b2a2-30b69ee043fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:59:56.510328 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 636/1265] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:59:56.515775 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad93bb-b8c8-467f-b40b-da2d15bb2e19 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:56.620550 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad93bb-b8c8-467f-b40b-da2d15bb2e19 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:56.658572 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ed0fd-8830-43ca-9cfd-b8254398cd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:56.659232 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ed0fd-8830-43ca-9cfd-b8254398cd6a None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:56.659513 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ed0fd-8830-43ca-9cfd-b8254398cd6a None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:56.659819 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ed0fd-8830-43ca-9cfd-b8254398cd6a None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:56.660534 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ed0fd-8830-43ca-9cfd-b8254398cd6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:59:56.660838 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ed0fd-8830-43ca-9cfd-b8254398cd6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:56.662203 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ed0fd-8830-43ca-9cfd-b8254398cd6a None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:56.673342 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 630/1266] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 03:59:56.678923 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9329dd-16cf-4165-b2a2-30b69ee043fd None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:56.770130 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9329dd-16cf-4165-b2a2-30b69ee043fd None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:56.800518 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20aca1-8bae-4f16-864d-d8a01cb09c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:56.801288 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20aca1-8bae-4f16-864d-d8a01cb09c91 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:56.801567 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20aca1-8bae-4f16-864d-d8a01cb09c91 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:56.801840 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20aca1-8bae-4f16-864d-d8a01cb09c91 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:56.808760 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20aca1-8bae-4f16-864d-d8a01cb09c91 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:56.810168 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20aca1-8bae-4f16-864d-d8a01cb09c91 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:56.823918 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-1d20aca1-8bae-4f16-864d-d8a01cb09c91 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 10 03:59:56.825023 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 637/1267] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:59:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:59:56.830469 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ed0fd-8830-43ca-9cfd-b8254398cd6a None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:56.921894 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ed0fd-8830-43ca-9cfd-b8254398cd6a None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:56.953403 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ad084-46c4-4cfc-bd98-79c91fea68c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:56.954044 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ad084-46c4-4cfc-bd98-79c91fea68c4 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:56.954324 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ad084-46c4-4cfc-bd98-79c91fea68c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:56.954600 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ad084-46c4-4cfc-bd98-79c91fea68c4 None admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:56.955415 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ad084-46c4-4cfc-bd98-79c91fea68c4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:59:56.955751 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ad084-46c4-4cfc-bd98-79c91fea68c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:56.957152 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ad084-46c4-4cfc-bd98-79c91fea68c4 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:56.973432 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 631/1268] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Mar 10 03:59:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:59:56.978743 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20aca1-8bae-4f16-864d-d8a01cb09c91 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:57.070179 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20aca1-8bae-4f16-864d-d8a01cb09c91 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:57.101215 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31729c5-7911-4ff3-80b9-402fb266b215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:57.101987 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31729c5-7911-4ff3-80b9-402fb266b215 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:57.102265 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31729c5-7911-4ff3-80b9-402fb266b215 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:57.102535 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31729c5-7911-4ff3-80b9-402fb266b215 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:57.113544 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31729c5-7911-4ff3-80b9-402fb266b215 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:57.115011 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31729c5-7911-4ff3-80b9-402fb266b215 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:57.131457 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-e31729c5-7911-4ff3-80b9-402fb266b215 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 03:59:57.132636 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 638/1269] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 03:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:59:57.138811 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ad084-46c4-4cfc-bd98-79c91fea68c4 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:57.231984 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ad084-46c4-4cfc-bd98-79c91fea68c4 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:57.265251 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdcfb80-5f24-468d-bf6b-aa77745ba13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:57.265896 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdcfb80-5f24-468d-bf6b-aa77745ba13b None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:57.266179 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdcfb80-5f24-468d-bf6b-aa77745ba13b None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:57.266460 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdcfb80-5f24-468d-bf6b-aa77745ba13b None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:57.267165 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdcfb80-5f24-468d-bf6b-aa77745ba13b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:59:57.267470 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdcfb80-5f24-468d-bf6b-aa77745ba13b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:57.268863 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdcfb80-5f24-468d-bf6b-aa77745ba13b None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:57.280431 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 632/1270] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 03:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:59:57.285999 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31729c5-7911-4ff3-80b9-402fb266b215 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:57.377166 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31729c5-7911-4ff3-80b9-402fb266b215 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:57.407613 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b45a6a-9bb6-4c9e-a8f3-a28104a37a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:57.408405 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b45a6a-9bb6-4c9e-a8f3-a28104a37a1c None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:57.408688 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b45a6a-9bb6-4c9e-a8f3-a28104a37a1c None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:57.408961 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b45a6a-9bb6-4c9e-a8f3-a28104a37a1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:57.415174 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b45a6a-9bb6-4c9e-a8f3-a28104a37a1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:57.417119 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b45a6a-9bb6-4c9e-a8f3-a28104a37a1c None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:57.430093 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-f5b45a6a-9bb6-4c9e-a8f3-a28104a37a1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 03:59:57.431189 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 639/1271] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 03:59:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 03:59:57.437309 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdcfb80-5f24-468d-bf6b-aa77745ba13b None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:57.529451 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdcfb80-5f24-468d-bf6b-aa77745ba13b None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:57.561080 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3435f5-ea44-4a63-aac4-6a98c3681c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:57.561784 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3435f5-ea44-4a63-aac4-6a98c3681c30 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:57.562081 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3435f5-ea44-4a63-aac4-6a98c3681c30 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:57.562431 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3435f5-ea44-4a63-aac4-6a98c3681c30 None admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:57.563508 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3435f5-ea44-4a63-aac4-6a98c3681c30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 03:59:57.563971 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3435f5-ea44-4a63-aac4-6a98c3681c30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:57.565461 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3435f5-ea44-4a63-aac4-6a98c3681c30 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:57.579250 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 633/1272] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 03:59:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 03:59:57.585233 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b45a6a-9bb6-4c9e-a8f3-a28104a37a1c None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 03:59:57.679212 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b45a6a-9bb6-4c9e-a8f3-a28104a37a1c None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 03:59:57.710930 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c93a47-7abc-49bb-a828-674cf8c55f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 03:59:57.711836 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c93a47-7abc-49bb-a828-674cf8c55f2e None admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:57.712123 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c93a47-7abc-49bb-a828-674cf8c55f2e None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:57.712398 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c93a47-7abc-49bb-a828-674cf8c55f2e None admin] PATH_INFO: `/v3/projects/0846fccaeb674395a87e45290eda74b7/users/319da006b10c41f8aa8a9d5aa2225b60/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:57.714344 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c93a47-7abc-49bb-a828-674cf8c55f2e None admin] RBAC: Authorizing `identity:create_grant(project_id=0846fccaeb674395a87e45290eda74b7, user_id=319da006b10c41f8aa8a9d5aa2225b60, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 03:59:57.715788 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c93a47-7abc-49bb-a828-674cf8c55f2e None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 03:59:57.727825 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 640/1273] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Mar 10 03:59:57 2022] PUT /identity/v3/projects/0846fccaeb674395a87e45290eda74b7/users/319da006b10c41f8aa8a9d5aa2225b60/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 03:59:59.977793 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96745c-5ea9-4c53-ac7f-d92a60e0903f None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:59.978820 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96745c-5ea9-4c53-ac7f-d92a60e0903f None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:59.978820 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96745c-5ea9-4c53-ac7f-d92a60e0903f None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 03:59:59.980639 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 634/1274] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 03:59:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 03:59:59.985713 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd64b50-47c8-4a1e-b302-3a89db8010a6 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 03:59:59.986130 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd64b50-47c8-4a1e-b302-3a89db8010a6 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 03:59:59.986275 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd64b50-47c8-4a1e-b302-3a89db8010a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:00:00.003022 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-5bd64b50-47c8-4a1e-b302-3a89db8010a6 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:00:00.004218 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-5bd64b50-47c8-4a1e-b302-3a89db8010a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:00:00.064504 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 641/1275] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 03:59:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 04:00:00.088354 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96745c-5ea9-4c53-ac7f-d92a60e0903f None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:00:00.183082 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96745c-5ea9-4c53-ac7f-d92a60e0903f None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:00:00.214883 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4b198-ab0e-4f36-b072-1a474705db51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:00:00.215651 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4b198-ab0e-4f36-b072-1a474705db51 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:00:00.215962 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4b198-ab0e-4f36-b072-1a474705db51 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:00:00.216234 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4b198-ab0e-4f36-b072-1a474705db51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:00:00.225741 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa4b198-ab0e-4f36-b072-1a474705db51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 10 04:00:00.232614 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-6aa4b198-ab0e-4f36-b072-1a474705db51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 10 04:00:00.233712 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 635/1276] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Mar 10 04:00:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 04:00:00.239641 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd64b50-47c8-4a1e-b302-3a89db8010a6 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:00:00.329968 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd64b50-47c8-4a1e-b302-3a89db8010a6 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:00:00.360152 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74191995-10d8-4991-ad50-9310971ff5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:00:00.360797 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74191995-10d8-4991-ad50-9310971ff5b0 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:00:00.361078 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74191995-10d8-4991-ad50-9310971ff5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:00:00.361350 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74191995-10d8-4991-ad50-9310971ff5b0 None admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:00:00.362077 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74191995-10d8-4991-ad50-9310971ff5b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:00:00.362378 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74191995-10d8-4991-ad50-9310971ff5b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:00:00.363802 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74191995-10d8-4991-ad50-9310971ff5b0 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:00:00.371734 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 642/1277] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Mar 10 04:00:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:00:00.377269 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4b198-ab0e-4f36-b072-1a474705db51 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:00:00.470394 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4b198-ab0e-4f36-b072-1a474705db51 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:00:00.502021 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f23a3-4304-44f2-881f-fa4347652815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:00:00.502739 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f23a3-4304-44f2-881f-fa4347652815 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:00:00.503021 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f23a3-4304-44f2-881f-fa4347652815 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:00:00.503296 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f23a3-4304-44f2-881f-fa4347652815 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:00:00.513213 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f23a3-4304-44f2-881f-fa4347652815 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:00:00.514642 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f23a3-4304-44f2-881f-fa4347652815 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:00:00.530134 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-c14f23a3-4304-44f2-881f-fa4347652815 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 04:00:00.531259 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 636/1278] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 04:00:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 04:00:00.537020 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74191995-10d8-4991-ad50-9310971ff5b0 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:00:00.643972 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74191995-10d8-4991-ad50-9310971ff5b0 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:00:00.674830 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe530aba-80a2-43c8-b6e3-c5060c09f210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:00:00.675482 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe530aba-80a2-43c8-b6e3-c5060c09f210 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:00:00.675793 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe530aba-80a2-43c8-b6e3-c5060c09f210 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:00:00.676072 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe530aba-80a2-43c8-b6e3-c5060c09f210 None admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:00:00.676782 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe530aba-80a2-43c8-b6e3-c5060c09f210 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:00:00.677086 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe530aba-80a2-43c8-b6e3-c5060c09f210 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:00:00.678442 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe530aba-80a2-43c8-b6e3-c5060c09f210 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:00:00.690896 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 643/1279] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 04:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:00:00.696570 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f23a3-4304-44f2-881f-fa4347652815 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:00:00.788841 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f23a3-4304-44f2-881f-fa4347652815 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:00:00.820363 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd442e-dde5-4510-824a-3ad0acee46ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:00:00.821137 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd442e-dde5-4510-824a-3ad0acee46ad None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:00:00.821416 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd442e-dde5-4510-824a-3ad0acee46ad None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:00:00.821688 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd442e-dde5-4510-824a-3ad0acee46ad None admin] PATH_INFO: `/v3/users/placement` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:00:00.828661 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd442e-dde5-4510-824a-3ad0acee46ad None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:00:00.830077 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dd442e-dde5-4510-824a-3ad0acee46ad None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:00:00.843786 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-c2dd442e-dde5-4510-824a-3ad0acee46ad None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 10 04:00:00.844952 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 637/1280] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 04:00:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 04:00:00.850677 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe530aba-80a2-43c8-b6e3-c5060c09f210 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:00:00.941835 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe530aba-80a2-43c8-b6e3-c5060c09f210 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:00:00.972484 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e412d-38ca-4b12-9b68-8e29940bf548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:00:00.973127 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e412d-38ca-4b12-9b68-8e29940bf548 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:00:00.973402 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e412d-38ca-4b12-9b68-8e29940bf548 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:00:00.973671 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e412d-38ca-4b12-9b68-8e29940bf548 None admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:00:00.974479 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e412d-38ca-4b12-9b68-8e29940bf548 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:00:00.974781 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e412d-38ca-4b12-9b68-8e29940bf548 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:00:00.976221 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e412d-38ca-4b12-9b68-8e29940bf548 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:00:00.992346 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 644/1281] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Mar 10 04:00:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:00:00.997897 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd442e-dde5-4510-824a-3ad0acee46ad None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:00:01.090451 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd442e-dde5-4510-824a-3ad0acee46ad None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:00:01.121726 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebba71e-aa21-4398-a6c8-418ad9c1037e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:00:01.122365 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebba71e-aa21-4398-a6c8-418ad9c1037e None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:00:01.122649 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebba71e-aa21-4398-a6c8-418ad9c1037e None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:00:01.122930 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebba71e-aa21-4398-a6c8-418ad9c1037e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:00:01.185958 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebba71e-aa21-4398-a6c8-418ad9c1037e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:00:01.187394 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebba71e-aa21-4398-a6c8-418ad9c1037e None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:00:01.278843 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 638/1282] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Mar 10 04:00:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 10 04:00:01.284613 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e412d-38ca-4b12-9b68-8e29940bf548 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:00:01.375235 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e412d-38ca-4b12-9b68-8e29940bf548 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:00:01.406331 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6d1cd-dd3e-48e0-ba96-c3957546aff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:00:01.407094 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6d1cd-dd3e-48e0-ba96-c3957546aff6 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:00:01.407371 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6d1cd-dd3e-48e0-ba96-c3957546aff6 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:00:01.407643 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6d1cd-dd3e-48e0-ba96-c3957546aff6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:00:01.416909 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6d1cd-dd3e-48e0-ba96-c3957546aff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:00:01.418319 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6d1cd-dd3e-48e0-ba96-c3957546aff6 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:00:01.434201 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-63b6d1cd-dd3e-48e0-ba96-c3957546aff6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 10 04:00:01.435312 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 645/1283] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 04:00:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 04:00:01.441147 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebba71e-aa21-4398-a6c8-418ad9c1037e None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:00:01.536727 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebba71e-aa21-4398-a6c8-418ad9c1037e None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:00:01.572723 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64feed2f-492d-479c-b70e-2975616979c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:00:01.573370 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64feed2f-492d-479c-b70e-2975616979c9 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:00:01.573648 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64feed2f-492d-479c-b70e-2975616979c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:00:01.573919 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64feed2f-492d-479c-b70e-2975616979c9 None admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:00:01.574624 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64feed2f-492d-479c-b70e-2975616979c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:00:01.574924 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64feed2f-492d-479c-b70e-2975616979c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:00:01.576299 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64feed2f-492d-479c-b70e-2975616979c9 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:00:01.586866 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 639/1284] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Mar 10 04:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:00:01.592487 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6d1cd-dd3e-48e0-ba96-c3957546aff6 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:00:01.683146 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6d1cd-dd3e-48e0-ba96-c3957546aff6 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:00:01.714096 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870b239-0c21-402e-91a5-0ebbba862970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:00:01.714854 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870b239-0c21-402e-91a5-0ebbba862970 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:00:01.715134 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870b239-0c21-402e-91a5-0ebbba862970 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:00:01.715407 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870b239-0c21-402e-91a5-0ebbba862970 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:00:01.721608 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870b239-0c21-402e-91a5-0ebbba862970 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:00:01.723016 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870b239-0c21-402e-91a5-0ebbba862970 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:00:01.735385 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING keystone.server.flask.application [None req-9870b239-0c21-402e-91a5-0ebbba862970 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 10 04:00:01.736511 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 646/1285] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Mar 10 04:00:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 04:00:01.742043 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64feed2f-492d-479c-b70e-2975616979c9 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:00:01.836364 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64feed2f-492d-479c-b70e-2975616979c9 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:00:01.866786 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2a933-9a09-429a-bf86-42070f6e2c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:00:01.867440 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2a933-9a09-429a-bf86-42070f6e2c1d None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:00:01.867754 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2a933-9a09-429a-bf86-42070f6e2c1d None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:00:01.868033 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2a933-9a09-429a-bf86-42070f6e2c1d None admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:00:01.869328 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2a933-9a09-429a-bf86-42070f6e2c1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:00:01.869635 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2a933-9a09-429a-bf86-42070f6e2c1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:00:01.871053 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2a933-9a09-429a-bf86-42070f6e2c1d None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:00:01.882288 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 640/1286] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Mar 10 04:00:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:00:01.888869 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870b239-0c21-402e-91a5-0ebbba862970 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:00:01.981144 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870b239-0c21-402e-91a5-0ebbba862970 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:00:02.012072 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b00b37-8f21-4928-ac58-9e32d5ceca50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:00:02.012703 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b00b37-8f21-4928-ac58-9e32d5ceca50 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:00:02.012985 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b00b37-8f21-4928-ac58-9e32d5ceca50 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:00:02.013265 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b00b37-8f21-4928-ac58-9e32d5ceca50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:00:02.014076 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b00b37-8f21-4928-ac58-9e32d5ceca50 None admin] RBAC: Adding query filter params (role.id=a8b2a5887cec4a31b7304792af3dd3f1, scope.project.id=0846fccaeb674395a87e45290eda74b7, user.id=319da006b10c41f8aa8a9d5aa2225b60) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:00:02.014383 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b00b37-8f21-4928-ac58-9e32d5ceca50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:00:02.015829 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b00b37-8f21-4928-ac58-9e32d5ceca50 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:00:02.021244 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 647/1287] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Mar 10 04:00:01 2022] GET /identity/v3/role_assignments?user.id=319da006b10c41f8aa8a9d5aa2225b60&scope.project.id=0846fccaeb674395a87e45290eda74b7&role.id=a8b2a5887cec4a31b7304792af3dd3f1 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:00:04.296490 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52ce03-00f5-443d-9ffa-94c3b673d3b0 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:00:04.297033 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52ce03-00f5-443d-9ffa-94c3b673d3b0 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:00:04.297033 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52ce03-00f5-443d-9ffa-94c3b673d3b0 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:00:04.298796 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 641/1288] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:00:04.304041 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96acf2-7c2b-43c4-948c-525eb5a7e948 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:00:04.304428 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96acf2-7c2b-43c4-948c-525eb5a7e948 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:00:04.304591 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96acf2-7c2b-43c4-948c-525eb5a7e948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:00:04.320981 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-af96acf2-7c2b-43c4-948c-525eb5a7e948 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:00:04.322647 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-af96acf2-7c2b-43c4-948c-525eb5a7e948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:00:04.383481 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 648/1289] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:00:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 04:00:04.406599 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52ce03-00f5-443d-9ffa-94c3b673d3b0 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:00:04.500951 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52ce03-00f5-443d-9ffa-94c3b673d3b0 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:00:04.532595 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70d84d-9480-4a51-b6f1-438e112f343c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:00:04.533372 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70d84d-9480-4a51-b6f1-438e112f343c None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:00:04.533654 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70d84d-9480-4a51-b6f1-438e112f343c None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:00:04.533928 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70d84d-9480-4a51-b6f1-438e112f343c None admin] PATH_INFO: `/v3/services/placement` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:00:04.534569 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b70d84d-9480-4a51-b6f1-438e112f343c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:00:04.535945 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b70d84d-9480-4a51-b6f1-438e112f343c None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:00:04.546500 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-0b70d84d-9480-4a51-b6f1-438e112f343c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 10 04:00:04.547619 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 642/1290] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Mar 10 04:00:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 04:00:04.553689 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96acf2-7c2b-43c4-948c-525eb5a7e948 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:00:04.661635 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96acf2-7c2b-43c4-948c-525eb5a7e948 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:00:04.692829 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c2ca1-1826-4834-b0b6-253ce811d64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:00:04.693479 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c2ca1-1826-4834-b0b6-253ce811d64d None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:00:04.693762 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c2ca1-1826-4834-b0b6-253ce811d64d None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:00:04.694033 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c2ca1-1826-4834-b0b6-253ce811d64d None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:00:04.694723 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c2ca1-1826-4834-b0b6-253ce811d64d None admin] RBAC: Adding query filter params (name=placement) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:00:04.695024 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c2ca1-1826-4834-b0b6-253ce811d64d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:00:04.696399 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c2ca1-1826-4834-b0b6-253ce811d64d None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:00:04.701535 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 649/1291] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Mar 10 04:00:04 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:00:04.707268 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70d84d-9480-4a51-b6f1-438e112f343c None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:00:04.799456 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70d84d-9480-4a51-b6f1-438e112f343c None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:00:04.831399 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a240789-19bb-48ba-aba4-2df30b0176ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:00:04.832081 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a240789-19bb-48ba-aba4-2df30b0176ba None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:00:04.832363 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a240789-19bb-48ba-aba4-2df30b0176ba None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:00:04.832638 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a240789-19bb-48ba-aba4-2df30b0176ba None admin] PATH_INFO: `/v3/services` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:00:04.833396 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a240789-19bb-48ba-aba4-2df30b0176ba None admin] RBAC: Adding query filter params (type=placement) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:00:04.833705 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a240789-19bb-48ba-aba4-2df30b0176ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:00:04.835047 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a240789-19bb-48ba-aba4-2df30b0176ba None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:00:04.839247 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 643/1292] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Mar 10 04:00:04 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:00:07.065379 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc80d7-5d48-4fd1-b895-f7e04a070b7d None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:00:07.065942 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc80d7-5d48-4fd1-b895-f7e04a070b7d None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:00:07.065942 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc80d7-5d48-4fd1-b895-f7e04a070b7d None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:00:07.067704 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 650/1293] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:00:07.073624 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9636ec-3fa2-4fde-87e2-a5ce924e5825 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:00:07.074023 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9636ec-3fa2-4fde-87e2-a5ce924e5825 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:00:07.074175 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9636ec-3fa2-4fde-87e2-a5ce924e5825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:00:07.090918 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-5c9636ec-3fa2-4fde-87e2-a5ce924e5825 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:00:07.092149 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-5c9636ec-3fa2-4fde-87e2-a5ce924e5825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:00:07.154624 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 644/1294] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:00:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 04:00:07.177697 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc80d7-5d48-4fd1-b895-f7e04a070b7d None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:00:07.270334 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc80d7-5d48-4fd1-b895-f7e04a070b7d None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:00:07.300895 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e760ba5-7ddd-4e15-968d-718cb6b4d034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:00:07.301540 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e760ba5-7ddd-4e15-968d-718cb6b4d034 None admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:00:07.301817 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e760ba5-7ddd-4e15-968d-718cb6b4d034 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:00:07.302090 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e760ba5-7ddd-4e15-968d-718cb6b4d034 None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:00:07.302795 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e760ba5-7ddd-4e15-968d-718cb6b4d034 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:00:07.304171 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e760ba5-7ddd-4e15-968d-718cb6b4d034 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:00:07.318120 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 651/1295] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Mar 10 04:00:07 2022] POST /identity/v3/services => generated 246 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:00:09.615425 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6d7ec-4572-4ae1-9f03-4f5aee8e4578 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:00:09.616009 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6d7ec-4572-4ae1-9f03-4f5aee8e4578 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:00:09.616009 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6d7ec-4572-4ae1-9f03-4f5aee8e4578 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:00:09.617775 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 645/1296] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:00:09.623228 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d05f7-5896-4cf7-9bab-91bc91449dfd None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:00:09.623646 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d05f7-5896-4cf7-9bab-91bc91449dfd None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:00:09.624067 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d05f7-5896-4cf7-9bab-91bc91449dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:00:09.643344 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-bb7d05f7-5896-4cf7-9bab-91bc91449dfd None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:00:09.644954 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-bb7d05f7-5896-4cf7-9bab-91bc91449dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:00:09.719898 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 652/1297] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:00:09 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 04:00:09.741897 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6d7ec-4572-4ae1-9f03-4f5aee8e4578 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:00:09.836948 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6d7ec-4572-4ae1-9f03-4f5aee8e4578 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:00:09.867597 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d48417-07c5-45db-9613-c1f940f555f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:00:09.868846 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d48417-07c5-45db-9613-c1f940f555f5 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:00:09.869127 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d48417-07c5-45db-9613-c1f940f555f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:00:09.869399 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d48417-07c5-45db-9613-c1f940f555f5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:00:09.870033 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d48417-07c5-45db-9613-c1f940f555f5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:00:09.871380 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d48417-07c5-45db-9613-c1f940f555f5 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:00:09.881853 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-57d48417-07c5-45db-9613-c1f940f555f5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 10 04:00:09.882953 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 646/1298] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Mar 10 04:00:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 04:00:09.889427 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d05f7-5896-4cf7-9bab-91bc91449dfd None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:00:09.979692 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d05f7-5896-4cf7-9bab-91bc91449dfd None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:00:10.011307 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666d236-9fa4-405b-bf30-2ba9ed7e76c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:00:10.011977 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666d236-9fa4-405b-bf30-2ba9ed7e76c0 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:00:10.012261 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666d236-9fa4-405b-bf30-2ba9ed7e76c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:00:10.012536 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666d236-9fa4-405b-bf30-2ba9ed7e76c0 None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:00:10.013229 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666d236-9fa4-405b-bf30-2ba9ed7e76c0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:00:10.013534 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666d236-9fa4-405b-bf30-2ba9ed7e76c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:00:10.014880 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666d236-9fa4-405b-bf30-2ba9ed7e76c0 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:00:10.019671 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 653/1299] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Mar 10 04:00:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:00:10.025286 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d48417-07c5-45db-9613-c1f940f555f5 None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:00:10.118197 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d48417-07c5-45db-9613-c1f940f555f5 None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:00:10.150408 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dbe3ad-1764-4c34-8a92-b749754cb302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:00:10.151048 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbe3ad-1764-4c34-8a92-b749754cb302 None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:00:10.151333 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbe3ad-1764-4c34-8a92-b749754cb302 None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:00:10.151607 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbe3ad-1764-4c34-8a92-b749754cb302 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:00:10.152413 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dbe3ad-1764-4c34-8a92-b749754cb302 None admin] RBAC: Adding query filter params (interface=public, service_id=ffa6cc7f24b04674afc8c29d1b7a9630, region_id=RegionOne) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:00:10.152722 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dbe3ad-1764-4c34-8a92-b749754cb302 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:00:10.154075 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dbe3ad-1764-4c34-8a92-b749754cb302 None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:00:10.158885 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 647/1300] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Mar 10 04:00:10 2022] GET /identity/v3/endpoints?service_id=ffa6cc7f24b04674afc8c29d1b7a9630&interface=public®ion_id=RegionOne => generated 194 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:00:10.164321 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666d236-9fa4-405b-bf30-2ba9ed7e76c0 None admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:00:10.256538 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666d236-9fa4-405b-bf30-2ba9ed7e76c0 None admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:00:10.287360 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02ceab-30b1-4301-b9e5-b209cad45195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:00:10.288025 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02ceab-30b1-4301-b9e5-b209cad45195 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:00:10.288309 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02ceab-30b1-4301-b9e5-b209cad45195 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:00:10.288587 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02ceab-30b1-4301-b9e5-b209cad45195 None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:00:10.289252 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e02ceab-30b1-4301-b9e5-b209cad45195 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:00:10.291132 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e02ceab-30b1-4301-b9e5-b209cad45195 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:00:10.297907 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 654/1301] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Mar 10 04:00:10 2022] GET /identity/v3/services => generated 2191 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:00:12.543436 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d7e7f-ab84-451c-a7a3-26f3b0c53290 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:00:12.543977 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d7e7f-ab84-451c-a7a3-26f3b0c53290 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:00:12.544140 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d7e7f-ab84-451c-a7a3-26f3b0c53290 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:00:12.545916 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 648/1302] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:00:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:00:12.551122 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342de26e-9f90-43c3-8bfa-cec963394029 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:00:12.551520 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342de26e-9f90-43c3-8bfa-cec963394029 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:00:12.551704 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342de26e-9f90-43c3-8bfa-cec963394029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:00:12.572382 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-342de26e-9f90-43c3-8bfa-cec963394029 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:00:12.573810 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-342de26e-9f90-43c3-8bfa-cec963394029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:00:12.639261 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 655/1303] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:00:12 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 10 04:00:12.662356 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d7e7f-ab84-451c-a7a3-26f3b0c53290 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:00:12.755913 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d7e7f-ab84-451c-a7a3-26f3b0c53290 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:00:12.787142 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771d2b3-9b23-42ca-8ef0-900d9006165a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:00:12.787948 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771d2b3-9b23-42ca-8ef0-900d9006165a None admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:00:12.788228 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771d2b3-9b23-42ca-8ef0-900d9006165a None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:00:12.788501 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771d2b3-9b23-42ca-8ef0-900d9006165a None admin] PATH_INFO: `/v3/services/placement` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:00:12.789136 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a771d2b3-9b23-42ca-8ef0-900d9006165a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:00:12.790511 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a771d2b3-9b23-42ca-8ef0-900d9006165a None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:00:12.801169 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING keystone.server.flask.application [None req-a771d2b3-9b23-42ca-8ef0-900d9006165a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 10 04:00:12.802225 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 649/1304] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Mar 10 04:00:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 140 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 10 04:00:12.808672 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342de26e-9f90-43c3-8bfa-cec963394029 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:00:12.897867 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342de26e-9f90-43c3-8bfa-cec963394029 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:00:12.928298 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4370a4c-2139-47c5-82f8-c8cebf90d645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:00:12.928933 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4370a4c-2139-47c5-82f8-c8cebf90d645 None admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:00:12.929212 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4370a4c-2139-47c5-82f8-c8cebf90d645 None admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:00:12.929482 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4370a4c-2139-47c5-82f8-c8cebf90d645 None admin] PATH_INFO: `/v3/services` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:00:12.930164 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4370a4c-2139-47c5-82f8-c8cebf90d645 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:00:12.930464 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4370a4c-2139-47c5-82f8-c8cebf90d645 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:00:12.932345 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4370a4c-2139-47c5-82f8-c8cebf90d645 None admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:00:12.937158 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 656/1305] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Mar 10 04:00:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:00:12.942827 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771d2b3-9b23-42ca-8ef0-900d9006165a None admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:00:13.034476 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771d2b3-9b23-42ca-8ef0-900d9006165a None admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:00:13.065339 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f85e71-3e64-44d2-8a23-d2a82f37413d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:00:13.065913 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f85e71-3e64-44d2-8a23-d2a82f37413d None admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:00:13.066194 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f85e71-3e64-44d2-8a23-d2a82f37413d None admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:00:13.066470 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f85e71-3e64-44d2-8a23-d2a82f37413d None admin] PATH_INFO: `/v3/endpoints` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:00:13.067201 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f85e71-3e64-44d2-8a23-d2a82f37413d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:00:13.068599 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f85e71-3e64-44d2-8a23-d2a82f37413d None admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:00:13.085871 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 650/1306] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Mar 10 04:00:12 2022] POST /identity/v3/endpoints => generated 331 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:01:16.572230 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83345b1a-5a87-4e65-bd22-9bb8adab5835 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:16.573075 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83345b1a-5a87-4e65-bd22-9bb8adab5835 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:16.573075 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83345b1a-5a87-4e65-bd22-9bb8adab5835 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:16.574963 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 657/1307] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:01:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:01:16.581874 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f7aac-a2ca-486a-a984-d17748936f66 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:16.582425 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f7aac-a2ca-486a-a984-d17748936f66 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:16.582425 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f7aac-a2ca-486a-a984-d17748936f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:16.654769 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-e20f7aac-a2ca-486a-a984-d17748936f66 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:01:16.655999 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-e20f7aac-a2ca-486a-a984-d17748936f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:16.762734 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 651/1308] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:01:16.785429 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83345b1a-5a87-4e65-bd22-9bb8adab5835 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:01:16.787215 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-83345b1a-5a87-4e65-bd22-9bb8adab5835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:16.918372 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83345b1a-5a87-4e65-bd22-9bb8adab5835 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:01:17.009681 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04771f-2a6f-424f-9564-d372c63105cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:01:17.010563 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04771f-2a6f-424f-9564-d372c63105cd admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:17.010988 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04771f-2a6f-424f-9564-d372c63105cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:17.011407 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04771f-2a6f-424f-9564-d372c63105cd admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:17.012315 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04771f-2a6f-424f-9564-d372c63105cd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:01:17.014159 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING py.warnings [None req-7c04771f-2a6f-424f-9564-d372c63105cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 10 04:01:17.014159 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: warnings.warn(msg) Mar 10 04:01:17.014159 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: Mar 10 04:01:17.015826 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04771f-2a6f-424f-9564-d372c63105cd admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:01:17.034288 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 658/1309] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 04:01:16 2022] GET /identity/v3/projects => generated 2553 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:01:19.397162 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d5017-c0f3-424b-b262-410bfff939a4 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:19.397738 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d5017-c0f3-424b-b262-410bfff939a4 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:19.397738 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d5017-c0f3-424b-b262-410bfff939a4 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:19.400191 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 652/1310] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:01:19.405629 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94094baf-0d0e-4d68-bbee-9d630e4d0508 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:19.406042 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94094baf-0d0e-4d68-bbee-9d630e4d0508 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:19.406172 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94094baf-0d0e-4d68-bbee-9d630e4d0508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:19.499799 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-94094baf-0d0e-4d68-bbee-9d630e4d0508 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:01:19.500993 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-94094baf-0d0e-4d68-bbee-9d630e4d0508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:19.594481 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 659/1311] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:01:19.648255 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf96079-3346-450d-8f9e-4dd7a44fc770 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:19.648457 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf96079-3346-450d-8f9e-4dd7a44fc770 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:19.648742 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf96079-3346-450d-8f9e-4dd7a44fc770 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:19.650845 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 653/1312] 10.222.0.15 () {54 vars in 964 bytes} [Thu Mar 10 04:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:01:19.657124 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa522ba4-7992-45fd-848d-1c0a41a18da0 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:19.657677 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa522ba4-7992-45fd-848d-1c0a41a18da0 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:19.658184 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa522ba4-7992-45fd-848d-1c0a41a18da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:19.740437 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-fa522ba4-7992-45fd-848d-1c0a41a18da0 None None] MFA Rules not processed for user `2faf262ae9d643c0b8708dcfecd75b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:01:19.741778 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-fa522ba4-7992-45fd-848d-1c0a41a18da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:19.834194 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 660/1313] 10.222.0.15 () {58 vars in 1061 bytes} [Thu Mar 10 04:01:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:01:19.843190 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf96079-3346-450d-8f9e-4dd7a44fc770 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:01:19.844826 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-4bf96079-3346-450d-8f9e-4dd7a44fc770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:19.957006 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf96079-3346-450d-8f9e-4dd7a44fc770 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:01:20.043246 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848274a2-3f9d-443f-8562-25cb5c445e8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:01:20.043781 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848274a2-3f9d-443f-8562-25cb5c445e8c service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:20.044065 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848274a2-3f9d-443f-8562-25cb5c445e8c service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:20.044339 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848274a2-3f9d-443f-8562-25cb5c445e8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:20.045977 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-848274a2-3f9d-443f-8562-25cb5c445e8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:20.163094 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848274a2-3f9d-443f-8562-25cb5c445e8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:01:20.164476 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848274a2-3f9d-443f-8562-25cb5c445e8c service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:01:20.184262 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 654/1314] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:01:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:01:22.762628 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303345f4-ebb0-4c49-be1b-d71908cf51b0 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:22.763141 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303345f4-ebb0-4c49-be1b-d71908cf51b0 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:22.763234 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303345f4-ebb0-4c49-be1b-d71908cf51b0 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:22.764972 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 661/1315] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:01:22.770040 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374faa02-bc47-49e2-9380-fc4c27b9a922 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:22.770478 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374faa02-bc47-49e2-9380-fc4c27b9a922 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:22.770577 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374faa02-bc47-49e2-9380-fc4c27b9a922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:22.832398 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-374faa02-bc47-49e2-9380-fc4c27b9a922 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:01:22.833572 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-374faa02-bc47-49e2-9380-fc4c27b9a922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:22.922979 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 655/1316] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:01:22.974103 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a32af-11b7-4b89-bb1a-d09ec33b70dd None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:22.974391 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a32af-11b7-4b89-bb1a-d09ec33b70dd None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:22.974671 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a32af-11b7-4b89-bb1a-d09ec33b70dd None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:22.976518 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 662/1317] 10.222.0.15 () {54 vars in 964 bytes} [Thu Mar 10 04:01:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:01:22.982567 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295c824-3e3b-4cf5-9d53-63f11e3294d6 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:22.982854 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295c824-3e3b-4cf5-9d53-63f11e3294d6 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:22.983159 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295c824-3e3b-4cf5-9d53-63f11e3294d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:23.054369 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-4295c824-3e3b-4cf5-9d53-63f11e3294d6 None None] MFA Rules not processed for user `2faf262ae9d643c0b8708dcfecd75b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:01:23.056242 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-4295c824-3e3b-4cf5-9d53-63f11e3294d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:23.127092 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 656/1318] 10.222.0.15 () {58 vars in 1061 bytes} [Thu Mar 10 04:01:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:01:23.135986 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a32af-11b7-4b89-bb1a-d09ec33b70dd None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:01:23.137479 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-c47a32af-11b7-4b89-bb1a-d09ec33b70dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:23.233753 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a32af-11b7-4b89-bb1a-d09ec33b70dd None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:01:23.301709 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70039265-36ff-409e-9daf-e89a66a21dec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:01:23.302342 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70039265-36ff-409e-9daf-e89a66a21dec service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:23.302621 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70039265-36ff-409e-9daf-e89a66a21dec service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:23.302891 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70039265-36ff-409e-9daf-e89a66a21dec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:23.304505 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-70039265-36ff-409e-9daf-e89a66a21dec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:23.405884 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70039265-36ff-409e-9daf-e89a66a21dec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:01:23.407296 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70039265-36ff-409e-9daf-e89a66a21dec service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:01:23.425135 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 663/1319] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:01:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:01:26.234553 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32034d1-8f24-4a12-87bd-78b5f8a7a53e None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:26.235072 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32034d1-8f24-4a12-87bd-78b5f8a7a53e None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:26.235169 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32034d1-8f24-4a12-87bd-78b5f8a7a53e None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:26.236983 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 657/1320] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:01:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:01:26.242155 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa81846-7d47-46d1-b297-bc42e8e6cf82 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:26.242584 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa81846-7d47-46d1-b297-bc42e8e6cf82 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:26.242736 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa81846-7d47-46d1-b297-bc42e8e6cf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:26.303953 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-3fa81846-7d47-46d1-b297-bc42e8e6cf82 None None] MFA Rules not processed for user `96a9b787ace2448a9a22c86d6847863f`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:01:26.305141 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-3fa81846-7d47-46d1-b297-bc42e8e6cf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:26.395655 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 664/1321] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:01:26 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:01:26.434673 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32034d1-8f24-4a12-87bd-78b5f8a7a53e None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:01:26.436188 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-a32034d1-8f24-4a12-87bd-78b5f8a7a53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:26.533746 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32034d1-8f24-4a12-87bd-78b5f8a7a53e None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:01:26.602536 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8882e38-263c-4fea-bf22-2a1c7c2e3646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:01:26.603172 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8882e38-263c-4fea-bf22-2a1c7c2e3646 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:26.603453 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8882e38-263c-4fea-bf22-2a1c7c2e3646 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:26.603756 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8882e38-263c-4fea-bf22-2a1c7c2e3646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:26.605356 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-a8882e38-263c-4fea-bf22-2a1c7c2e3646 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:26.712919 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8882e38-263c-4fea-bf22-2a1c7c2e3646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:01:26.714349 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8882e38-263c-4fea-bf22-2a1c7c2e3646 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:01:26.731753 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 658/1322] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:01:26 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:01:29.494568 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5fcb3-f191-4b93-8827-c80b7d51385a None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:29.495065 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5fcb3-f191-4b93-8827-c80b7d51385a None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:29.495065 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5fcb3-f191-4b93-8827-c80b7d51385a None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:29.496836 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 665/1323] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:01:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:01:29.502104 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba3e0e-b4d6-47e7-93ac-0a653a391136 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:29.502488 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba3e0e-b4d6-47e7-93ac-0a653a391136 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:29.502659 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba3e0e-b4d6-47e7-93ac-0a653a391136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:29.563513 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-4dba3e0e-b4d6-47e7-93ac-0a653a391136 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:01:29.564978 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-4dba3e0e-b4d6-47e7-93ac-0a653a391136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:29.660856 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 659/1324] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:01:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:01:29.700173 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5fcb3-f191-4b93-8827-c80b7d51385a None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:01:29.701670 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-b5d5fcb3-f191-4b93-8827-c80b7d51385a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:29.799455 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5fcb3-f191-4b93-8827-c80b7d51385a None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:01:29.867564 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9468a9-f672-4d80-bcbc-099fe5c7ce0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:01:29.868237 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9468a9-f672-4d80-bcbc-099fe5c7ce0b service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:29.868518 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9468a9-f672-4d80-bcbc-099fe5c7ce0b service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:29.868792 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9468a9-f672-4d80-bcbc-099fe5c7ce0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:29.870386 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-ad9468a9-f672-4d80-bcbc-099fe5c7ce0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:29.971576 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9468a9-f672-4d80-bcbc-099fe5c7ce0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:01:29.973019 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9468a9-f672-4d80-bcbc-099fe5c7ce0b service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:01:29.989951 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 666/1325] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:01:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:01:32.894819 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be20d1a-f09f-4114-807a-0824157f2981 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:32.895338 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be20d1a-f09f-4114-807a-0824157f2981 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:32.895442 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be20d1a-f09f-4114-807a-0824157f2981 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:32.897174 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 660/1326] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:01:32.902864 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97534e2-0c92-47b5-a6cc-6cc18d531c6f None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:32.903305 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97534e2-0c92-47b5-a6cc-6cc18d531c6f None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:32.903562 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97534e2-0c92-47b5-a6cc-6cc18d531c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:32.966845 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-f97534e2-0c92-47b5-a6cc-6cc18d531c6f None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:01:32.967960 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-f97534e2-0c92-47b5-a6cc-6cc18d531c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:33.056940 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 667/1327] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:01:33.092699 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be20d1a-f09f-4114-807a-0824157f2981 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:01:33.094210 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-3be20d1a-f09f-4114-807a-0824157f2981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:33.195777 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be20d1a-f09f-4114-807a-0824157f2981 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:01:33.265784 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8a2eb-fc72-4d36-9f2b-1facf778a96e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:01:33.266355 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8a2eb-fc72-4d36-9f2b-1facf778a96e service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:33.266637 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8a2eb-fc72-4d36-9f2b-1facf778a96e service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:33.266912 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8a2eb-fc72-4d36-9f2b-1facf778a96e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:33.268572 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-76b8a2eb-fc72-4d36-9f2b-1facf778a96e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:33.377843 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8a2eb-fc72-4d36-9f2b-1facf778a96e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:01:33.379273 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8a2eb-fc72-4d36-9f2b-1facf778a96e service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:01:33.396894 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 661/1328] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:01:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:01:35.767199 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7998acf-0c3b-4f2f-b1a5-0ff2ceeb44d2 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:35.767793 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7998acf-0c3b-4f2f-b1a5-0ff2ceeb44d2 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:35.767793 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7998acf-0c3b-4f2f-b1a5-0ff2ceeb44d2 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:35.769543 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 668/1329] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:01:35.775327 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59c694-1c55-4365-9a1e-1f4883a7e3f0 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:35.775767 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59c694-1c55-4365-9a1e-1f4883a7e3f0 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:35.776052 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59c694-1c55-4365-9a1e-1f4883a7e3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:35.838803 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-1e59c694-1c55-4365-9a1e-1f4883a7e3f0 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:01:35.840033 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-1e59c694-1c55-4365-9a1e-1f4883a7e3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:35.930623 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 662/1330] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:01:35.966856 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7998acf-0c3b-4f2f-b1a5-0ff2ceeb44d2 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:01:35.968457 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-b7998acf-0c3b-4f2f-b1a5-0ff2ceeb44d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:36.069277 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7998acf-0c3b-4f2f-b1a5-0ff2ceeb44d2 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:01:36.138595 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435aebc1-3ec9-4811-ad12-fe85e89fb6b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:01:36.139237 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435aebc1-3ec9-4811-ad12-fe85e89fb6b1 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:36.139516 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435aebc1-3ec9-4811-ad12-fe85e89fb6b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:36.139818 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435aebc1-3ec9-4811-ad12-fe85e89fb6b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:36.141408 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-435aebc1-3ec9-4811-ad12-fe85e89fb6b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:36.243756 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435aebc1-3ec9-4811-ad12-fe85e89fb6b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:01:36.245224 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435aebc1-3ec9-4811-ad12-fe85e89fb6b1 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:01:36.263094 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 669/1331] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:01:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:01:38.583215 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882c794-8fd9-460d-9a73-546cd838beaa None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:38.583788 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882c794-8fd9-460d-9a73-546cd838beaa None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:38.583788 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882c794-8fd9-460d-9a73-546cd838beaa None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:38.585715 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 663/1332] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:01:38.591179 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e038974-6df1-4881-a972-a1ef1a40e02d None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:38.591561 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e038974-6df1-4881-a972-a1ef1a40e02d None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:38.591775 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e038974-6df1-4881-a972-a1ef1a40e02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:38.653905 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-5e038974-6df1-4881-a972-a1ef1a40e02d None None] MFA Rules not processed for user `96a9b787ace2448a9a22c86d6847863f`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:01:38.655090 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-5e038974-6df1-4881-a972-a1ef1a40e02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:38.748909 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 670/1333] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:01:38 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:01:38.785841 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882c794-8fd9-460d-9a73-546cd838beaa None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:01:38.787354 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-b882c794-8fd9-460d-9a73-546cd838beaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:38.887278 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882c794-8fd9-460d-9a73-546cd838beaa None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:01:38.957496 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1b00c-430f-456c-9b98-e56e177d7134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:01:38.958138 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1b00c-430f-456c-9b98-e56e177d7134 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:38.958420 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1b00c-430f-456c-9b98-e56e177d7134 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:38.958694 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1b00c-430f-456c-9b98-e56e177d7134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:38.960327 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-6bb1b00c-430f-456c-9b98-e56e177d7134 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:39.062853 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1b00c-430f-456c-9b98-e56e177d7134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:01:39.064327 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1b00c-430f-456c-9b98-e56e177d7134 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:01:39.082663 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 664/1334] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:01:38 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:01:41.775955 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b82ff5-f00d-4228-87e2-5c43881c0265 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:41.776957 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b82ff5-f00d-4228-87e2-5c43881c0265 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:41.777065 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b82ff5-f00d-4228-87e2-5c43881c0265 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:41.778874 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 671/1335] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:01:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:01:41.784115 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd2706-2547-49c6-a819-8bbf3d12a84f None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:41.784540 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd2706-2547-49c6-a819-8bbf3d12a84f None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:41.784669 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd2706-2547-49c6-a819-8bbf3d12a84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:41.852211 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-12dd2706-2547-49c6-a819-8bbf3d12a84f None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:01:41.853425 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-12dd2706-2547-49c6-a819-8bbf3d12a84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:41.949434 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 665/1336] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:01:41.985461 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b82ff5-f00d-4228-87e2-5c43881c0265 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:01:41.986981 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-b1b82ff5-f00d-4228-87e2-5c43881c0265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:42.088421 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b82ff5-f00d-4228-87e2-5c43881c0265 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:01:42.159966 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d41e5f-6b47-4165-913e-8c3687dc19fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:01:42.160622 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d41e5f-6b47-4165-913e-8c3687dc19fa service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:42.160908 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d41e5f-6b47-4165-913e-8c3687dc19fa service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:42.161187 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d41e5f-6b47-4165-913e-8c3687dc19fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:42.162797 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-40d41e5f-6b47-4165-913e-8c3687dc19fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:42.266937 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d41e5f-6b47-4165-913e-8c3687dc19fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:01:42.268609 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d41e5f-6b47-4165-913e-8c3687dc19fa service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:01:42.285875 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 672/1337] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:01:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:01:44.603404 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8060d-b5e6-432c-aa3e-38e6ef5a384b None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:44.604004 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8060d-b5e6-432c-aa3e-38e6ef5a384b None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:44.604004 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8060d-b5e6-432c-aa3e-38e6ef5a384b None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:44.605790 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 666/1338] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:01:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:01:44.610761 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75639f-1c0a-43d2-8762-3ed0f14c7135 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:44.611180 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75639f-1c0a-43d2-8762-3ed0f14c7135 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:44.611312 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75639f-1c0a-43d2-8762-3ed0f14c7135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:44.673959 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-ef75639f-1c0a-43d2-8762-3ed0f14c7135 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:01:44.675141 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-ef75639f-1c0a-43d2-8762-3ed0f14c7135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:44.767738 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 673/1339] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:01:44.807850 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8060d-b5e6-432c-aa3e-38e6ef5a384b None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:01:44.809371 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-fdb8060d-b5e6-432c-aa3e-38e6ef5a384b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:44.908869 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8060d-b5e6-432c-aa3e-38e6ef5a384b None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:01:44.977730 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5acf0a-b69e-4d2a-afd2-4f6f28986031 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:01:44.978366 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5acf0a-b69e-4d2a-afd2-4f6f28986031 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:44.978650 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5acf0a-b69e-4d2a-afd2-4f6f28986031 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:44.978927 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5acf0a-b69e-4d2a-afd2-4f6f28986031 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:44.980601 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-2d5acf0a-b69e-4d2a-afd2-4f6f28986031 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:45.084543 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5acf0a-b69e-4d2a-afd2-4f6f28986031 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:01:45.085970 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5acf0a-b69e-4d2a-afd2-4f6f28986031 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:01:45.103149 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 667/1340] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:01:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:01:47.790365 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ada6e0-38a0-4550-ab43-6a5c0e932108 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:47.790894 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ada6e0-38a0-4550-ab43-6a5c0e932108 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:47.791010 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ada6e0-38a0-4550-ab43-6a5c0e932108 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:47.792728 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 674/1341] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:01:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:01:47.797842 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1169862-b30b-430f-b9ca-b9cf7c94dfa1 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:47.798245 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1169862-b30b-430f-b9ca-b9cf7c94dfa1 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:47.798403 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1169862-b30b-430f-b9ca-b9cf7c94dfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:47.865212 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-d1169862-b30b-430f-b9ca-b9cf7c94dfa1 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:01:47.866409 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-d1169862-b30b-430f-b9ca-b9cf7c94dfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:47.965059 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 668/1342] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:01:47 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:01:48.001420 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ada6e0-38a0-4550-ab43-6a5c0e932108 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:01:48.003592 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-a6ada6e0-38a0-4550-ab43-6a5c0e932108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:48.094686 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ada6e0-38a0-4550-ab43-6a5c0e932108 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:01:48.098098 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b605e-8e63-481f-8285-7ff2b2834e64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:01:48.098731 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b605e-8e63-481f-8285-7ff2b2834e64 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:48.099009 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b605e-8e63-481f-8285-7ff2b2834e64 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:48.099282 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b605e-8e63-481f-8285-7ff2b2834e64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:48.108081 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b605e-8e63-481f-8285-7ff2b2834e64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:01:48.109519 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b605e-8e63-481f-8285-7ff2b2834e64 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:01:48.119358 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 675/1343] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:01:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:01:52.426133 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfda1b-64e7-4df3-a401-0dd377b987e8 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:52.426645 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfda1b-64e7-4df3-a401-0dd377b987e8 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:52.426645 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfda1b-64e7-4df3-a401-0dd377b987e8 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:52.428443 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 669/1344] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:01:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:01:52.433628 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b7b30-bbab-49c1-a8ff-2a1f084f839e None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:52.434050 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b7b30-bbab-49c1-a8ff-2a1f084f839e None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:52.434189 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b7b30-bbab-49c1-a8ff-2a1f084f839e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:52.463286 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-d18b7b30-bbab-49c1-a8ff-2a1f084f839e None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:01:52.464489 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-d18b7b30-bbab-49c1-a8ff-2a1f084f839e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:52.536242 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 676/1345] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:01:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:01:52.575184 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfda1b-64e7-4df3-a401-0dd377b987e8 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:01:52.577428 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-2fcfda1b-64e7-4df3-a401-0dd377b987e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:52.591445 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfda1b-64e7-4df3-a401-0dd377b987e8 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:01:52.595082 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43875ba-b891-41d5-8ab4-c98ba39f851a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:01:52.595861 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43875ba-b891-41d5-8ab4-c98ba39f851a service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:52.596210 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43875ba-b891-41d5-8ab4-c98ba39f851a service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:52.596551 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43875ba-b891-41d5-8ab4-c98ba39f851a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:52.606089 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43875ba-b891-41d5-8ab4-c98ba39f851a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:01:52.607540 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43875ba-b891-41d5-8ab4-c98ba39f851a service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:01:52.617100 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 670/1346] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:01:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:01:55.507855 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00432ab7-f8ab-4ab9-87f1-18012067e686 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:55.508378 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00432ab7-f8ab-4ab9-87f1-18012067e686 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:55.508378 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00432ab7-f8ab-4ab9-87f1-18012067e686 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:55.510577 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 677/1347] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:01:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 04:01:55.515842 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772fc4c-84c5-4c1f-9678-836436b65f6d None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:55.516262 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772fc4c-84c5-4c1f-9678-836436b65f6d None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:55.516500 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772fc4c-84c5-4c1f-9678-836436b65f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:55.534143 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-c772fc4c-84c5-4c1f-9678-836436b65f6d None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:01:55.535307 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-c772fc4c-84c5-4c1f-9678-836436b65f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:01:55.543052 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 671/1348] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:01:55 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:01:55.580936 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00432ab7-f8ab-4ab9-87f1-18012067e686 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:01:55.594239 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00432ab7-f8ab-4ab9-87f1-18012067e686 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:01:55.597817 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd0951-d466-4f33-8fb3-532bc405fb86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:01:55.598449 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd0951-d466-4f33-8fb3-532bc405fb86 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:01:55.598727 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd0951-d466-4f33-8fb3-532bc405fb86 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:01:55.599003 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd0951-d466-4f33-8fb3-532bc405fb86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:01:55.608507 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd0951-d466-4f33-8fb3-532bc405fb86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:01:55.610007 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd0951-d466-4f33-8fb3-532bc405fb86 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:01:55.620113 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 678/1349] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:01:55 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:02:00.171005 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42b99a-80d4-4212-84cc-cbf0c6c1451e None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:00.171570 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42b99a-80d4-4212-84cc-cbf0c6c1451e None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:00.171570 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42b99a-80d4-4212-84cc-cbf0c6c1451e None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:00.173393 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 672/1350] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:02:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:02:00.178624 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac8fd4-0005-4111-9adb-0d0768b1cdf8 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:00.179029 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac8fd4-0005-4111-9adb-0d0768b1cdf8 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:00.179184 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac8fd4-0005-4111-9adb-0d0768b1cdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:00.198125 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-9dac8fd4-0005-4111-9adb-0d0768b1cdf8 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:02:00.199317 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-9dac8fd4-0005-4111-9adb-0d0768b1cdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:02:00.207316 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 679/1351] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:02:00.245321 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42b99a-80d4-4212-84cc-cbf0c6c1451e None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:02:00.257788 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42b99a-80d4-4212-84cc-cbf0c6c1451e None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:02:00.261885 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba07d4-8d78-4674-99b0-46b7c273b961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:02:00.262526 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba07d4-8d78-4674-99b0-46b7c273b961 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:00.262812 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba07d4-8d78-4674-99b0-46b7c273b961 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:00.263094 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba07d4-8d78-4674-99b0-46b7c273b961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:00.272052 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba07d4-8d78-4674-99b0-46b7c273b961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:02:00.273526 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba07d4-8d78-4674-99b0-46b7c273b961 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:02:00.282845 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 673/1352] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:02:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:02:05.738528 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09298c-73b7-4797-b7c5-f39761a6d6ef None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:05.739064 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09298c-73b7-4797-b7c5-f39761a6d6ef None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:05.739064 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09298c-73b7-4797-b7c5-f39761a6d6ef None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:05.741103 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 680/1353] 10.222.0.15 () {54 vars in 921 bytes} [Thu Mar 10 04:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:02:05.746365 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ff016-89c1-497b-9793-1fbefd2b8746 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:05.747481 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ff016-89c1-497b-9793-1fbefd2b8746 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:05.747991 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ff016-89c1-497b-9793-1fbefd2b8746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:05.816575 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-e64ff016-89c1-497b-9793-1fbefd2b8746 None None] MFA Rules not processed for user `319da006b10c41f8aa8a9d5aa2225b60`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:02:05.818043 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-e64ff016-89c1-497b-9793-1fbefd2b8746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:02:05.893489 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 674/1354] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Mar 10 04:02:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:02:10.279214 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d233af-3f27-42b2-9cd7-2b16b73434b1 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:10.280270 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d233af-3f27-42b2-9cd7-2b16b73434b1 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:10.280552 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d233af-3f27-42b2-9cd7-2b16b73434b1 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:10.282520 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 681/1355] 10.222.0.15 () {54 vars in 921 bytes} [Thu Mar 10 04:02:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:02:10.287299 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd6b72-6ed3-43aa-a41e-bb7e895fe5e9 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:10.287736 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd6b72-6ed3-43aa-a41e-bb7e895fe5e9 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:10.287946 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd6b72-6ed3-43aa-a41e-bb7e895fe5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:10.306769 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-8ecd6b72-6ed3-43aa-a41e-bb7e895fe5e9 None None] MFA Rules not processed for user `319da006b10c41f8aa8a9d5aa2225b60`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:02:10.307981 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-8ecd6b72-6ed3-43aa-a41e-bb7e895fe5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:02:10.316809 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 675/1356] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Mar 10 04:02:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:02:11.695054 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb8119-1a1d-4ea7-8603-6188065bc9ec None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:11.695605 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb8119-1a1d-4ea7-8603-6188065bc9ec None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:11.695605 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eb8119-1a1d-4ea7-8603-6188065bc9ec None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:11.698126 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 682/1357] 10.222.0.15 () {54 vars in 921 bytes} [Thu Mar 10 04:02:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:02:11.703002 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390d34a-541b-4e50-9c51-4996f7bf21f0 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:11.703411 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390d34a-541b-4e50-9c51-4996f7bf21f0 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:11.703566 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390d34a-541b-4e50-9c51-4996f7bf21f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:11.723170 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-b390d34a-541b-4e50-9c51-4996f7bf21f0 None None] MFA Rules not processed for user `319da006b10c41f8aa8a9d5aa2225b60`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:02:11.724459 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-b390d34a-541b-4e50-9c51-4996f7bf21f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:02:11.733473 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 676/1358] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Mar 10 04:02:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:02:15.561017 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73922779-6920-456a-bfeb-d01daf678af8 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:15.561521 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73922779-6920-456a-bfeb-d01daf678af8 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:15.561628 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73922779-6920-456a-bfeb-d01daf678af8 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:15.563351 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 683/1359] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:02:15.568836 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f664fa1-d53a-4482-a10d-13813984a5c0 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:15.569223 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f664fa1-d53a-4482-a10d-13813984a5c0 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:15.569544 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f664fa1-d53a-4482-a10d-13813984a5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:15.588347 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-4f664fa1-d53a-4482-a10d-13813984a5c0 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:02:15.589846 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-4f664fa1-d53a-4482-a10d-13813984a5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:02:15.598828 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 677/1360] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:02:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:02:15.648555 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be184f-cde0-45ea-85ae-1209c8ed8a78 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:15.648975 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be184f-cde0-45ea-85ae-1209c8ed8a78 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:15.649355 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be184f-cde0-45ea-85ae-1209c8ed8a78 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:15.651646 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 684/1361] 10.222.0.15 () {54 vars in 961 bytes} [Thu Mar 10 04:02:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:02:15.657028 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d7f54-d969-438e-b839-98d439cf5942 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:15.657470 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d7f54-d969-438e-b839-98d439cf5942 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:15.657757 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d7f54-d969-438e-b839-98d439cf5942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:15.706700 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-776d7f54-d969-438e-b839-98d439cf5942 None None] MFA Rules not processed for user `fbd92bd14ed04621af06d68161798fe3`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:02:15.708080 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-776d7f54-d969-438e-b839-98d439cf5942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:02:15.805453 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 678/1362] 10.222.0.15 () {58 vars in 1058 bytes} [Thu Mar 10 04:02:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:02:15.814354 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be184f-cde0-45ea-85ae-1209c8ed8a78 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:02:15.829234 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be184f-cde0-45ea-85ae-1209c8ed8a78 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:02:15.836501 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7b8b1-25e5-47e3-b2e9-b9f5870591f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:02:15.837481 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7b8b1-25e5-47e3-b2e9-b9f5870591f4 service nova] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:15.837751 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7b8b1-25e5-47e3-b2e9-b9f5870591f4 service nova] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:15.838025 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7b8b1-25e5-47e3-b2e9-b9f5870591f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:15.847016 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7b8b1-25e5-47e3-b2e9-b9f5870591f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:02:15.848826 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7b8b1-25e5-47e3-b2e9-b9f5870591f4 service nova] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:02:15.859165 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 685/1363] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:02:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:02:18.360361 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a1b26-7101-41fa-98c9-06766b84974f None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:18.360962 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a1b26-7101-41fa-98c9-06766b84974f None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:18.360962 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a1b26-7101-41fa-98c9-06766b84974f None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:18.362702 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 679/1364] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:02:18.368020 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46014da3-c609-4dd9-968b-9b12d78ff291 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:18.368437 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46014da3-c609-4dd9-968b-9b12d78ff291 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:18.368582 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46014da3-c609-4dd9-968b-9b12d78ff291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:18.386668 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-46014da3-c609-4dd9-968b-9b12d78ff291 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:02:18.387915 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-46014da3-c609-4dd9-968b-9b12d78ff291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:02:18.400063 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 686/1365] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:02:18.442230 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a1b26-7101-41fa-98c9-06766b84974f None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:02:18.457225 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a1b26-7101-41fa-98c9-06766b84974f None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:02:18.464904 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693ab86-e0ef-4c20-9c61-1dfd9fe8561f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:02:18.465817 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693ab86-e0ef-4c20-9c61-1dfd9fe8561f service nova] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:18.466113 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693ab86-e0ef-4c20-9c61-1dfd9fe8561f service nova] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:18.466401 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693ab86-e0ef-4c20-9c61-1dfd9fe8561f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:18.474690 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4693ab86-e0ef-4c20-9c61-1dfd9fe8561f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:02:18.483371 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4693ab86-e0ef-4c20-9c61-1dfd9fe8561f service nova] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:02:18.493660 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 680/1366] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:02:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:02:21.089565 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0998a9e-fca0-412a-bec3-afce6a154eda None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:21.090081 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0998a9e-fca0-412a-bec3-afce6a154eda None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:21.090081 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0998a9e-fca0-412a-bec3-afce6a154eda None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:21.091812 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 687/1367] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:02:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 10 04:02:21.097187 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d94451-5fb7-4449-bca4-d45eb7412f62 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:21.097635 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d94451-5fb7-4449-bca4-d45eb7412f62 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:21.097728 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d94451-5fb7-4449-bca4-d45eb7412f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:21.115767 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-30d94451-5fb7-4449-bca4-d45eb7412f62 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:02:21.116418 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-30d94451-5fb7-4449-bca4-d45eb7412f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:02:21.124207 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 681/1368] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:02:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:02:21.169719 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5138a47-6ca8-4461-9ef1-be3bb80c838e None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:21.170004 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5138a47-6ca8-4461-9ef1-be3bb80c838e None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:21.170280 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5138a47-6ca8-4461-9ef1-be3bb80c838e None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:21.172070 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 688/1369] 10.222.0.15 () {54 vars in 961 bytes} [Thu Mar 10 04:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:02:21.177296 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e9eac-ef62-4579-b430-7771302deaf9 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:21.177587 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e9eac-ef62-4579-b430-7771302deaf9 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:21.177867 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e9eac-ef62-4579-b430-7771302deaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:21.195999 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-d19e9eac-ef62-4579-b430-7771302deaf9 None None] MFA Rules not processed for user `fbd92bd14ed04621af06d68161798fe3`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:02:21.197636 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-d19e9eac-ef62-4579-b430-7771302deaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:02:21.206605 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 682/1370] 10.222.0.15 () {58 vars in 1058 bytes} [Thu Mar 10 04:02:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:02:21.214588 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5138a47-6ca8-4461-9ef1-be3bb80c838e None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:02:21.228461 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5138a47-6ca8-4461-9ef1-be3bb80c838e None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:02:21.234005 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b72e5e-cf94-4000-8de5-d0ae94c76552 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:02:21.234695 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b72e5e-cf94-4000-8de5-d0ae94c76552 service nova] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:21.234983 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b72e5e-cf94-4000-8de5-d0ae94c76552 service nova] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:21.235258 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b72e5e-cf94-4000-8de5-d0ae94c76552 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:21.243143 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b72e5e-cf94-4000-8de5-d0ae94c76552 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:02:21.244881 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b72e5e-cf94-4000-8de5-d0ae94c76552 service nova] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:02:21.253937 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 689/1371] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:02:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:02:23.601151 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6e5d5-bc38-4597-943a-0103bd63721e None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:23.601693 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6e5d5-bc38-4597-943a-0103bd63721e None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:23.601693 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6e5d5-bc38-4597-943a-0103bd63721e None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:23.604079 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 683/1372] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:02:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:02:23.609470 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba5403-7f41-486a-939f-2ee97e2cbdb9 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:23.610264 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba5403-7f41-486a-939f-2ee97e2cbdb9 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:23.610785 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba5403-7f41-486a-939f-2ee97e2cbdb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:23.630510 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-f1ba5403-7f41-486a-939f-2ee97e2cbdb9 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:02:23.632046 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-f1ba5403-7f41-486a-939f-2ee97e2cbdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:02:23.643718 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 690/1373] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:02:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:02:23.686090 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6e5d5-bc38-4597-943a-0103bd63721e None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:02:23.700670 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6e5d5-bc38-4597-943a-0103bd63721e None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:02:23.706314 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff232807-9490-4e69-83e5-4d7482539cba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:02:23.706983 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff232807-9490-4e69-83e5-4d7482539cba service nova] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:23.707270 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff232807-9490-4e69-83e5-4d7482539cba service nova] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:23.707550 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff232807-9490-4e69-83e5-4d7482539cba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:23.717335 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff232807-9490-4e69-83e5-4d7482539cba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:02:23.718973 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff232807-9490-4e69-83e5-4d7482539cba service nova] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:02:23.730397 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 684/1374] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:02:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:02:23.868971 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d435834-1cc9-40ca-8684-46cb22e38c93 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:23.869494 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d435834-1cc9-40ca-8684-46cb22e38c93 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:23.869916 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d435834-1cc9-40ca-8684-46cb22e38c93 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:23.871897 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 691/1375] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:02:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:02:23.877912 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbed0ab-dee8-44e1-b78c-98b494a9a3f9 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:23.878205 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbed0ab-dee8-44e1-b78c-98b494a9a3f9 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:23.878489 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbed0ab-dee8-44e1-b78c-98b494a9a3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:23.897695 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-ffbed0ab-dee8-44e1-b78c-98b494a9a3f9 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:02:23.899003 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-ffbed0ab-dee8-44e1-b78c-98b494a9a3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:02:23.919708 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 685/1376] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:02:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:02:24.203546 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feecd5a-d8a8-4c4e-989c-2fa4f895573e None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:24.203546 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feecd5a-d8a8-4c4e-989c-2fa4f895573e None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:24.203546 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feecd5a-d8a8-4c4e-989c-2fa4f895573e None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:24.205267 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 692/1377] 10.222.0.15 () {54 vars in 963 bytes} [Thu Mar 10 04:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:02:24.210061 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec707391-a1ec-4435-8a7e-8491cb8b8afb None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:24.210453 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec707391-a1ec-4435-8a7e-8491cb8b8afb None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:24.210808 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec707391-a1ec-4435-8a7e-8491cb8b8afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:24.259981 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-ec707391-a1ec-4435-8a7e-8491cb8b8afb None None] MFA Rules not processed for user `b6baa51b91a74ebbab55d644894acd81`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:02:24.261279 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-ec707391-a1ec-4435-8a7e-8491cb8b8afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:02:24.320896 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 686/1378] 10.222.0.15 () {58 vars in 1060 bytes} [Thu Mar 10 04:02:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:02:24.328779 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feecd5a-d8a8-4c4e-989c-2fa4f895573e None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:02:24.340158 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feecd5a-d8a8-4c4e-989c-2fa4f895573e None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:02:24.343730 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcae38c-6889-4a75-b7d3-02e55c49af5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:02:24.344557 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcae38c-6889-4a75-b7d3-02e55c49af5d service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:24.344933 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcae38c-6889-4a75-b7d3-02e55c49af5d service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:24.345284 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcae38c-6889-4a75-b7d3-02e55c49af5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:24.354844 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcae38c-6889-4a75-b7d3-02e55c49af5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:02:24.356382 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcae38c-6889-4a75-b7d3-02e55c49af5d service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:02:24.366416 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 693/1379] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:02:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:02:26.099071 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a5d29-13bd-428c-962b-c8e903d1acdc None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:26.099650 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a5d29-13bd-428c-962b-c8e903d1acdc None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:26.099650 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a5d29-13bd-428c-962b-c8e903d1acdc None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:26.101476 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 687/1380] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:02:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:02:26.108208 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc73d6-c5ca-4366-9de9-d43bfbc2e8a8 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:26.108753 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc73d6-c5ca-4366-9de9-d43bfbc2e8a8 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:26.108909 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc73d6-c5ca-4366-9de9-d43bfbc2e8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:26.127543 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-9adc73d6-c5ca-4366-9de9-d43bfbc2e8a8 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:02:26.128841 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-9adc73d6-c5ca-4366-9de9-d43bfbc2e8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:02:26.137172 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 694/1381] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:02:26.182480 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a5d29-13bd-428c-962b-c8e903d1acdc None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:02:26.197524 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a5d29-13bd-428c-962b-c8e903d1acdc None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:02:26.203076 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447361bc-b281-423a-a5cb-8f61e0a27a8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:02:26.203780 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447361bc-b281-423a-a5cb-8f61e0a27a8f service nova] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:26.204055 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447361bc-b281-423a-a5cb-8f61e0a27a8f service nova] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:26.204337 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447361bc-b281-423a-a5cb-8f61e0a27a8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:26.213809 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447361bc-b281-423a-a5cb-8f61e0a27a8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:02:26.215444 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447361bc-b281-423a-a5cb-8f61e0a27a8f service nova] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:02:26.225852 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 688/1382] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:02:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:02:28.541801 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc95304-1299-42a4-8356-307718b1bfed None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:28.542349 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc95304-1299-42a4-8356-307718b1bfed None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:28.542349 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc95304-1299-42a4-8356-307718b1bfed None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:28.544130 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 695/1383] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:02:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:02:28.549501 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1810d30-7ba0-48d0-8924-ee2b4ec8eb20 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:28.549926 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1810d30-7ba0-48d0-8924-ee2b4ec8eb20 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:28.550236 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1810d30-7ba0-48d0-8924-ee2b4ec8eb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:28.569083 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-e1810d30-7ba0-48d0-8924-ee2b4ec8eb20 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:02:28.570333 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-e1810d30-7ba0-48d0-8924-ee2b4ec8eb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:02:28.578386 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 689/1384] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:02:28.622939 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc95304-1299-42a4-8356-307718b1bfed None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:02:28.636990 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc95304-1299-42a4-8356-307718b1bfed None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:02:28.642320 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3f1e0-e567-470e-97a2-a291c49d6e29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:02:28.642981 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3f1e0-e567-470e-97a2-a291c49d6e29 service nova] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:28.643266 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3f1e0-e567-470e-97a2-a291c49d6e29 service nova] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:28.643542 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3f1e0-e567-470e-97a2-a291c49d6e29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:28.651708 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3f1e0-e567-470e-97a2-a291c49d6e29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:02:28.653298 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3f1e0-e567-470e-97a2-a291c49d6e29 service nova] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:02:28.662770 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 696/1385] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:02:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:02:30.983261 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ef6f5-f3c8-4341-840a-93eba8ee99b6 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:30.983838 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ef6f5-f3c8-4341-840a-93eba8ee99b6 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:30.983838 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ef6f5-f3c8-4341-840a-93eba8ee99b6 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:30.985623 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 690/1386] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:02:30.990895 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3dcbd-48cd-40c8-a59a-4caf3f35e7b1 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:30.991318 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3dcbd-48cd-40c8-a59a-4caf3f35e7b1 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:30.991452 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3dcbd-48cd-40c8-a59a-4caf3f35e7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:31.009776 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-84e3dcbd-48cd-40c8-a59a-4caf3f35e7b1 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:02:31.011218 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-84e3dcbd-48cd-40c8-a59a-4caf3f35e7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:02:31.019137 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 697/1387] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:02:31.061425 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ef6f5-f3c8-4341-840a-93eba8ee99b6 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:02:31.082035 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ef6f5-f3c8-4341-840a-93eba8ee99b6 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:02:31.088108 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0943f1-c7c0-46c6-8157-46c447d6f480 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:02:31.088831 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0943f1-c7c0-46c6-8157-46c447d6f480 service nova] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:31.089183 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0943f1-c7c0-46c6-8157-46c447d6f480 service nova] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:31.089552 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0943f1-c7c0-46c6-8157-46c447d6f480 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:31.098839 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0943f1-c7c0-46c6-8157-46c447d6f480 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:02:31.100570 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0943f1-c7c0-46c6-8157-46c447d6f480 service nova] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:02:31.110451 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 691/1388] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:02:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:02:33.429217 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c097a4d-4f4b-44fa-8b37-5799eb7f4de8 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:33.429725 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c097a4d-4f4b-44fa-8b37-5799eb7f4de8 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:33.429725 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c097a4d-4f4b-44fa-8b37-5799eb7f4de8 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:33.432036 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 698/1389] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:02:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:02:33.438133 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb32cde-8689-4155-a894-f6f401472320 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:33.438628 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb32cde-8689-4155-a894-f6f401472320 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:33.438889 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb32cde-8689-4155-a894-f6f401472320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:33.460546 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-aeb32cde-8689-4155-a894-f6f401472320 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:02:33.461739 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-aeb32cde-8689-4155-a894-f6f401472320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:02:33.469993 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 692/1390] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:02:33.513155 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c097a4d-4f4b-44fa-8b37-5799eb7f4de8 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:02:33.527615 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c097a4d-4f4b-44fa-8b37-5799eb7f4de8 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:02:33.533156 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0ac38-23c7-44d7-a37a-75a9a006647d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:02:33.533794 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0ac38-23c7-44d7-a37a-75a9a006647d service nova] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:33.534082 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0ac38-23c7-44d7-a37a-75a9a006647d service nova] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:33.534363 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0ac38-23c7-44d7-a37a-75a9a006647d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:33.542928 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0ac38-23c7-44d7-a37a-75a9a006647d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:02:33.544559 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0ac38-23c7-44d7-a37a-75a9a006647d service nova] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:02:33.553687 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 699/1391] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:02:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:02:36.548551 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9084780-044f-4dbd-a1ab-4beeea88a664 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:36.549093 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9084780-044f-4dbd-a1ab-4beeea88a664 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:36.549093 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9084780-044f-4dbd-a1ab-4beeea88a664 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:36.550872 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 693/1392] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:02:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:02:36.557193 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ececb8-97ac-45fb-8700-dc492a7f3d8b None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:36.557624 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ececb8-97ac-45fb-8700-dc492a7f3d8b None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:36.557904 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ececb8-97ac-45fb-8700-dc492a7f3d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:36.581493 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-a1ececb8-97ac-45fb-8700-dc492a7f3d8b None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:02:36.583099 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-a1ececb8-97ac-45fb-8700-dc492a7f3d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:02:36.593594 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 700/1393] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:02:36.640732 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9084780-044f-4dbd-a1ab-4beeea88a664 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:02:36.654481 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9084780-044f-4dbd-a1ab-4beeea88a664 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:02:36.659825 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ee9fa-fe56-4bd4-976d-f999361c3b34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:02:36.660451 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ee9fa-fe56-4bd4-976d-f999361c3b34 service nova] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:36.660728 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ee9fa-fe56-4bd4-976d-f999361c3b34 service nova] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:36.660998 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ee9fa-fe56-4bd4-976d-f999361c3b34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:36.669420 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ee9fa-fe56-4bd4-976d-f999361c3b34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:02:36.671594 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ee9fa-fe56-4bd4-976d-f999361c3b34 service nova] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:02:36.684773 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 694/1394] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:02:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:02:39.005228 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad32e8-c27b-44da-810d-ac4961c28aff None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:39.005805 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad32e8-c27b-44da-810d-ac4961c28aff None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:39.005805 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad32e8-c27b-44da-810d-ac4961c28aff None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:39.007617 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 701/1395] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:02:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:02:39.014043 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6631eb9-0e96-466b-9944-4ce218e68454 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:39.014538 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6631eb9-0e96-466b-9944-4ce218e68454 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:39.014751 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6631eb9-0e96-466b-9944-4ce218e68454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:39.032119 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-c6631eb9-0e96-466b-9944-4ce218e68454 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:02:39.033309 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-c6631eb9-0e96-466b-9944-4ce218e68454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:02:39.041675 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 695/1396] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:02:39.085115 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad32e8-c27b-44da-810d-ac4961c28aff None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:02:39.099008 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad32e8-c27b-44da-810d-ac4961c28aff None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:02:39.105060 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7fa82d-1aac-4038-8b32-e7495f77a740 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:02:39.105678 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fa82d-1aac-4038-8b32-e7495f77a740 service nova] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:39.105962 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fa82d-1aac-4038-8b32-e7495f77a740 service nova] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:39.106234 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fa82d-1aac-4038-8b32-e7495f77a740 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:39.114546 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7fa82d-1aac-4038-8b32-e7495f77a740 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:02:39.116153 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7fa82d-1aac-4038-8b32-e7495f77a740 service nova] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:02:39.126277 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 702/1397] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:02:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:02:40.169210 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1aa29f-53ac-404e-9e15-7a7d3ee85a6d None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:40.169768 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1aa29f-53ac-404e-9e15-7a7d3ee85a6d None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:40.169768 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1aa29f-53ac-404e-9e15-7a7d3ee85a6d None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:40.171607 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 696/1398] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:02:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:02:40.176863 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc46ed-ada1-4cea-8b07-e5b2c7838a38 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:40.177289 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc46ed-ada1-4cea-8b07-e5b2c7838a38 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:40.177424 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc46ed-ada1-4cea-8b07-e5b2c7838a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:40.195503 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-a5cc46ed-ada1-4cea-8b07-e5b2c7838a38 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:02:40.197354 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-a5cc46ed-ada1-4cea-8b07-e5b2c7838a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:02:40.205217 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 703/1399] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:02:40.261662 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924533b1-befd-4b97-8a87-caf546a504b6 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:40.261941 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924533b1-befd-4b97-8a87-caf546a504b6 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:40.262212 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924533b1-befd-4b97-8a87-caf546a504b6 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:40.264187 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 697/1400] 10.222.0.15 () {54 vars in 961 bytes} [Thu Mar 10 04:02:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:02:40.269752 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7ea20-0144-48b1-af7c-f8c0d77a8ca8 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:40.270048 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7ea20-0144-48b1-af7c-f8c0d77a8ca8 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:40.270312 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7ea20-0144-48b1-af7c-f8c0d77a8ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:40.317511 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-53b7ea20-0144-48b1-af7c-f8c0d77a8ca8 None None] MFA Rules not processed for user `6e7c195f91114855acc58163631544d7`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:02:40.318691 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-53b7ea20-0144-48b1-af7c-f8c0d77a8ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:02:40.375234 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 704/1401] 10.222.0.15 () {58 vars in 1058 bytes} [Thu Mar 10 04:02:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:02:40.382697 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924533b1-befd-4b97-8a87-caf546a504b6 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:02:40.393748 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924533b1-befd-4b97-8a87-caf546a504b6 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:02:40.397164 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2c59f-5e2c-4b2e-a00a-b2bef41c5abd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7c195f91114855acc58163631544d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:02:40.397792 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2c59f-5e2c-4b2e-a00a-b2bef41c5abd service glance] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:40.398074 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2c59f-5e2c-4b2e-a00a-b2bef41c5abd service glance] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:40.398348 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2c59f-5e2c-4b2e-a00a-b2bef41c5abd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:40.406911 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2c59f-5e2c-4b2e-a00a-b2bef41c5abd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:02:40.408361 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2c59f-5e2c-4b2e-a00a-b2bef41c5abd service glance] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:02:40.417568 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 698/1402] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:02:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:02:40.849238 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f701c-fc55-49a8-a062-833c9fce8d63 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:40.849551 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f701c-fc55-49a8-a062-833c9fce8d63 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:40.849816 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f701c-fc55-49a8-a062-833c9fce8d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:40.897431 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-230f701c-fc55-49a8-a062-833c9fce8d63 None None] MFA Rules not processed for user `7eb560db53cd4af192bb82abdfad3590`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:02:40.898575 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-230f701c-fc55-49a8-a062-833c9fce8d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:02:40.958962 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 705/1403] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Mar 10 04:02:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:02:41.000091 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6e6cd-933b-434c-b992-9bcdb2f016af None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:41.000379 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6e6cd-933b-434c-b992-9bcdb2f016af None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:41.000659 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6e6cd-933b-434c-b992-9bcdb2f016af None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:41.002470 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 699/1404] 10.222.0.15 () {54 vars in 942 bytes} [Thu Mar 10 04:02:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:02:41.008790 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a59605-b334-4910-a504-f1025b7793d4 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:41.009088 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a59605-b334-4910-a504-f1025b7793d4 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:41.009373 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a59605-b334-4910-a504-f1025b7793d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:41.056391 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-66a59605-b334-4910-a504-f1025b7793d4 None None] MFA Rules not processed for user `260f561c676b4d049553eac4626b5502`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:02:41.057570 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-66a59605-b334-4910-a504-f1025b7793d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:02:41.130494 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 706/1405] 10.222.0.15 () {58 vars in 1039 bytes} [Thu Mar 10 04:02:41 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:02:41.139879 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6e6cd-933b-434c-b992-9bcdb2f016af None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:02:41.153529 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6e6cd-933b-434c-b992-9bcdb2f016af None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:02:41.158329 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edea7b3-1ab6-468b-8af2-46f2baefeab9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260f561c676b4d049553eac4626b5502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:02:41.158960 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edea7b3-1ab6-468b-8af2-46f2baefeab9 service swift] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:41.159246 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edea7b3-1ab6-468b-8af2-46f2baefeab9 service swift] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:41.159522 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edea7b3-1ab6-468b-8af2-46f2baefeab9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:41.168006 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edea7b3-1ab6-468b-8af2-46f2baefeab9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:02:41.169568 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edea7b3-1ab6-468b-8af2-46f2baefeab9 service swift] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:02:41.177638 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 700/1406] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Mar 10 04:02:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 10 04:02:41.447856 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990222c6-8d74-4f3c-b833-1d73f23a0d0a None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:41.448797 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990222c6-8d74-4f3c-b833-1d73f23a0d0a None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:41.449106 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990222c6-8d74-4f3c-b833-1d73f23a0d0a None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:41.457853 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 707/1407] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:02:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:02:41.459600 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6b2dd-3ea3-40d4-b53d-9b3d7a89c0c4 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:41.460303 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6b2dd-3ea3-40d4-b53d-9b3d7a89c0c4 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:41.461071 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6b2dd-3ea3-40d4-b53d-9b3d7a89c0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:41.480323 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-ece6b2dd-3ea3-40d4-b53d-9b3d7a89c0c4 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:02:41.481837 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-ece6b2dd-3ea3-40d4-b53d-9b3d7a89c0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:02:41.489807 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 701/1408] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:02:41.534514 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990222c6-8d74-4f3c-b833-1d73f23a0d0a None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:02:41.549330 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990222c6-8d74-4f3c-b833-1d73f23a0d0a None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:02:41.555254 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76281a59-ad67-4cc0-9d36-6e72be5bef8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:02:41.555972 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76281a59-ad67-4cc0-9d36-6e72be5bef8a service nova] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:41.556254 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76281a59-ad67-4cc0-9d36-6e72be5bef8a service nova] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:41.556529 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76281a59-ad67-4cc0-9d36-6e72be5bef8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:41.565037 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76281a59-ad67-4cc0-9d36-6e72be5bef8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:02:41.566627 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76281a59-ad67-4cc0-9d36-6e72be5bef8a service nova] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:02:41.580067 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 708/1409] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:02:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:02:44.013221 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbeb05f-3521-4abf-853e-e6f28f8a543f None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:44.013756 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbeb05f-3521-4abf-853e-e6f28f8a543f None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:44.013756 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbeb05f-3521-4abf-853e-e6f28f8a543f None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:44.015552 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 702/1410] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:02:44.020707 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452e2ff-9a7f-467a-88c2-4de39f72db95 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:44.021124 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452e2ff-9a7f-467a-88c2-4de39f72db95 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:44.021321 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452e2ff-9a7f-467a-88c2-4de39f72db95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:44.039283 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-e452e2ff-9a7f-467a-88c2-4de39f72db95 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:02:44.040610 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-e452e2ff-9a7f-467a-88c2-4de39f72db95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:02:44.049099 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 709/1411] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:02:44.093667 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbeb05f-3521-4abf-853e-e6f28f8a543f None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:02:44.108158 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbeb05f-3521-4abf-853e-e6f28f8a543f None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:02:44.113935 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0384a-bfbf-4014-b226-3a720ed6e234 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:02:44.114706 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0384a-bfbf-4014-b226-3a720ed6e234 service nova] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:02:44.114991 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0384a-bfbf-4014-b226-3a720ed6e234 service nova] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:02:44.115267 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0384a-bfbf-4014-b226-3a720ed6e234 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:02:44.128728 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0384a-bfbf-4014-b226-3a720ed6e234 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:02:44.130343 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0384a-bfbf-4014-b226-3a720ed6e234 service nova] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:02:44.140779 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 703/1412] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:02:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:03:04.291931 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e48a9d-3c63-4241-912c-a23330b1afbb None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:04.292953 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e48a9d-3c63-4241-912c-a23330b1afbb None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:04.292953 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e48a9d-3c63-4241-912c-a23330b1afbb None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:04.294265 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 710/1413] 10.222.0.15 () {54 vars in 918 bytes} [Thu Mar 10 04:03:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:03:04.299578 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb8885-d31a-4703-ad74-64fe50bc8b7d None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:04.300052 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb8885-d31a-4703-ad74-64fe50bc8b7d None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:04.300152 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb8885-d31a-4703-ad74-64fe50bc8b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:04.318248 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-d9eb8885-d31a-4703-ad74-64fe50bc8b7d None None] MFA Rules not processed for user `319da006b10c41f8aa8a9d5aa2225b60`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:03:04.319429 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-d9eb8885-d31a-4703-ad74-64fe50bc8b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:03:04.328316 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 704/1414] 10.222.0.15 () {58 vars in 1015 bytes} [Thu Mar 10 04:03:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:03:04.342081 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be8a59-d755-4a8f-a6bf-77570ef556e2 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:04.342364 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be8a59-d755-4a8f-a6bf-77570ef556e2 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:04.342638 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be8a59-d755-4a8f-a6bf-77570ef556e2 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:04.344399 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 711/1415] 10.222.0.15 () {54 vars in 918 bytes} [Thu Mar 10 04:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:03:04.348922 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800d6f3-8f4d-4a0b-8bb4-2c6f0666a552 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:04.349233 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800d6f3-8f4d-4a0b-8bb4-2c6f0666a552 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:04.349532 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800d6f3-8f4d-4a0b-8bb4-2c6f0666a552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:04.366479 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-5800d6f3-8f4d-4a0b-8bb4-2c6f0666a552 None None] MFA Rules not processed for user `fbd92bd14ed04621af06d68161798fe3`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:03:04.367571 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-5800d6f3-8f4d-4a0b-8bb4-2c6f0666a552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:03:04.376836 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 705/1416] 10.222.0.15 () {58 vars in 1015 bytes} [Thu Mar 10 04:03:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:03:07.120300 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f05bde-a88e-47c0-902b-3823e322bbdb None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:07.120792 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f05bde-a88e-47c0-902b-3823e322bbdb None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:07.120934 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f05bde-a88e-47c0-902b-3823e322bbdb None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:07.122650 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 10 04:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:03:07.127912 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb6bde-811c-4682-9c75-432f173cf4ff None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:07.128355 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb6bde-811c-4682-9c75-432f173cf4ff None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:07.128602 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb6bde-811c-4682-9c75-432f173cf4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:07.146384 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-39eb6bde-811c-4682-9c75-432f173cf4ff None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:03:07.147665 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-39eb6bde-811c-4682-9c75-432f173cf4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:03:07.155928 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 10 04:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:03:07.198170 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f05bde-a88e-47c0-902b-3823e322bbdb None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:03:07.211881 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f05bde-a88e-47c0-902b-3823e322bbdb None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:03:07.217160 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14c0da-da2e-4f91-8ec2-41bc0bfa7ded service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:03:07.217776 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14c0da-da2e-4f91-8ec2-41bc0bfa7ded service nova] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:07.218059 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14c0da-da2e-4f91-8ec2-41bc0bfa7ded service nova] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:07.218334 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14c0da-da2e-4f91-8ec2-41bc0bfa7ded service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:07.226114 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14c0da-da2e-4f91-8ec2-41bc0bfa7ded service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:03:07.227675 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14c0da-da2e-4f91-8ec2-41bc0bfa7ded service nova] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:03:07.236749 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 713/1419] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:03:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:03:08.585751 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378db6b-f9a6-4ef0-9fe2-7a119d1f5ddf None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:08.586315 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378db6b-f9a6-4ef0-9fe2-7a119d1f5ddf None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:08.586315 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378db6b-f9a6-4ef0-9fe2-7a119d1f5ddf None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:08.588753 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 10 04:03:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:03:08.593665 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992209b-a58e-4168-bba4-d049226e7410 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:08.594064 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992209b-a58e-4168-bba4-d049226e7410 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:08.594209 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992209b-a58e-4168-bba4-d049226e7410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:08.611865 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-4992209b-a58e-4168-bba4-d049226e7410 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:03:08.613028 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-4992209b-a58e-4168-bba4-d049226e7410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:03:08.620697 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 10 04:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:03:08.782004 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378db6b-f9a6-4ef0-9fe2-7a119d1f5ddf None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:03:08.796141 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378db6b-f9a6-4ef0-9fe2-7a119d1f5ddf None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:03:08.803301 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b20cbe-d5ab-42ee-9110-b36dcc7b5bbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:03:08.803965 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b20cbe-d5ab-42ee-9110-b36dcc7b5bbd service nova] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:08.804249 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b20cbe-d5ab-42ee-9110-b36dcc7b5bbd service nova] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:08.804524 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b20cbe-d5ab-42ee-9110-b36dcc7b5bbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:08.812951 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b20cbe-d5ab-42ee-9110-b36dcc7b5bbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:03:08.814525 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b20cbe-d5ab-42ee-9110-b36dcc7b5bbd service nova] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:03:08.824688 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 708/1422] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:03:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:03:10.110095 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666415d-c797-424f-ac8d-317dc113fbfe None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:10.110662 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666415d-c797-424f-ac8d-317dc113fbfe None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:10.110662 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666415d-c797-424f-ac8d-317dc113fbfe None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:10.112448 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 10 04:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:03:10.117362 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8fc2e-7c1d-44b5-8b0b-44df116e7d3b None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:10.117748 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8fc2e-7c1d-44b5-8b0b-44df116e7d3b None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:10.117922 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8fc2e-7c1d-44b5-8b0b-44df116e7d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:10.135975 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-f8a8fc2e-7c1d-44b5-8b0b-44df116e7d3b None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:03:10.137160 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-f8a8fc2e-7c1d-44b5-8b0b-44df116e7d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:03:10.144791 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 10 04:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:03:10.293476 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666415d-c797-424f-ac8d-317dc113fbfe None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:03:10.307810 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666415d-c797-424f-ac8d-317dc113fbfe None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:03:10.313018 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e46f61-e694-4f35-983e-2976053799a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:03:10.313639 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e46f61-e694-4f35-983e-2976053799a3 service nova] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:10.313920 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e46f61-e694-4f35-983e-2976053799a3 service nova] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:10.314195 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e46f61-e694-4f35-983e-2976053799a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:10.322728 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e46f61-e694-4f35-983e-2976053799a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:03:10.324336 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e46f61-e694-4f35-983e-2976053799a3 service nova] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:03:10.333239 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 716/1425] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:03:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:03:11.637525 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b3232-6fef-4471-970d-a2e61d51cb2c None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:11.638096 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b3232-6fef-4471-970d-a2e61d51cb2c None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:11.638096 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b3232-6fef-4471-970d-a2e61d51cb2c None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:11.639920 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 10 04:03:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:03:11.644997 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca973d8-508b-4a53-aa66-b4bc2dd6238a None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:11.645403 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca973d8-508b-4a53-aa66-b4bc2dd6238a None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:11.645553 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca973d8-508b-4a53-aa66-b4bc2dd6238a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:11.663621 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-7ca973d8-508b-4a53-aa66-b4bc2dd6238a None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:03:11.664815 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-7ca973d8-508b-4a53-aa66-b4bc2dd6238a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:03:11.672581 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 10 04:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:03:11.820760 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b3232-6fef-4471-970d-a2e61d51cb2c None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:03:11.835191 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b3232-6fef-4471-970d-a2e61d51cb2c None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:03:11.840423 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb56ade-2b14-4b47-83b0-e92d51755a26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:03:11.841073 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb56ade-2b14-4b47-83b0-e92d51755a26 service nova] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:11.841357 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb56ade-2b14-4b47-83b0-e92d51755a26 service nova] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:11.841627 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb56ade-2b14-4b47-83b0-e92d51755a26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:11.849374 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb56ade-2b14-4b47-83b0-e92d51755a26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:03:11.850932 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb56ade-2b14-4b47-83b0-e92d51755a26 service nova] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:03:11.860004 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 711/1428] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:03:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:03:13.153734 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9869a7-11ed-48c7-a5ba-c5a3e5e5efd5 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:13.154218 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9869a7-11ed-48c7-a5ba-c5a3e5e5efd5 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:13.154331 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9869a7-11ed-48c7-a5ba-c5a3e5e5efd5 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:13.156078 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 10 04:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:03:13.161066 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f67937-570d-422e-b380-36066ca65128 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:13.161505 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f67937-570d-422e-b380-36066ca65128 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:13.161630 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f67937-570d-422e-b380-36066ca65128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:13.178992 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-40f67937-570d-422e-b380-36066ca65128 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:03:13.180207 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-40f67937-570d-422e-b380-36066ca65128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:03:13.188287 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 10 04:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:03:13.336011 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9869a7-11ed-48c7-a5ba-c5a3e5e5efd5 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:03:13.350076 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9869a7-11ed-48c7-a5ba-c5a3e5e5efd5 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:03:13.355616 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d4fb3-9ef7-4fee-820b-831366a37788 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:03:13.356299 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d4fb3-9ef7-4fee-820b-831366a37788 service nova] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:13.356581 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d4fb3-9ef7-4fee-820b-831366a37788 service nova] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:13.356855 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d4fb3-9ef7-4fee-820b-831366a37788 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:13.365176 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d4fb3-9ef7-4fee-820b-831366a37788 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:03:13.366707 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d4fb3-9ef7-4fee-820b-831366a37788 service nova] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:03:13.376603 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 719/1431] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:03:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:03:14.609108 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed7e0e-1195-4ad4-8075-b9997832b8d7 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:14.609684 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed7e0e-1195-4ad4-8075-b9997832b8d7 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:14.609684 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed7e0e-1195-4ad4-8075-b9997832b8d7 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:14.611486 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 10 04:03:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:03:14.616615 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc6d96-0fc7-4b09-8a09-190e681edb8e None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:14.617019 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc6d96-0fc7-4b09-8a09-190e681edb8e None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:14.617170 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc6d96-0fc7-4b09-8a09-190e681edb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:14.635075 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-39fc6d96-0fc7-4b09-8a09-190e681edb8e None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:03:14.636287 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-39fc6d96-0fc7-4b09-8a09-190e681edb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:03:14.643784 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 10 04:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:03:14.793406 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed7e0e-1195-4ad4-8075-b9997832b8d7 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:03:14.807710 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed7e0e-1195-4ad4-8075-b9997832b8d7 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:03:14.813190 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375f1d3-97f8-4b03-8b51-ecb8889ed2ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:03:14.813817 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375f1d3-97f8-4b03-8b51-ecb8889ed2ea service nova] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:14.814099 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375f1d3-97f8-4b03-8b51-ecb8889ed2ea service nova] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:14.814376 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375f1d3-97f8-4b03-8b51-ecb8889ed2ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:14.823320 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375f1d3-97f8-4b03-8b51-ecb8889ed2ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:03:14.824922 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375f1d3-97f8-4b03-8b51-ecb8889ed2ea service nova] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:03:14.833999 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 714/1434] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:03:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:03:16.082782 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865aa975-1408-47bc-85ed-c435fc095326 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:16.083304 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865aa975-1408-47bc-85ed-c435fc095326 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:16.083399 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865aa975-1408-47bc-85ed-c435fc095326 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:16.085195 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 10 04:03:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:03:16.090731 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bfd2b-b8f2-4987-a38a-bddccbf4fe16 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:16.091183 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bfd2b-b8f2-4987-a38a-bddccbf4fe16 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:16.091326 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bfd2b-b8f2-4987-a38a-bddccbf4fe16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:16.109142 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-5c9bfd2b-b8f2-4987-a38a-bddccbf4fe16 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:03:16.110348 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-5c9bfd2b-b8f2-4987-a38a-bddccbf4fe16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:03:16.118409 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 10 04:03:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:03:16.268544 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865aa975-1408-47bc-85ed-c435fc095326 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:03:16.282394 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865aa975-1408-47bc-85ed-c435fc095326 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:03:16.287816 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e846f-6888-4f87-8cf3-f45a3e8ce810 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:03:16.288437 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e846f-6888-4f87-8cf3-f45a3e8ce810 service nova] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:16.288724 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e846f-6888-4f87-8cf3-f45a3e8ce810 service nova] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:16.288998 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e846f-6888-4f87-8cf3-f45a3e8ce810 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:16.296825 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e846f-6888-4f87-8cf3-f45a3e8ce810 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:03:16.298387 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e846f-6888-4f87-8cf3-f45a3e8ce810 service nova] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:03:16.307950 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 722/1437] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:03:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:03:17.539470 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ec3d4-92ff-458f-b2b6-175627d8038f None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:17.540027 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ec3d4-92ff-458f-b2b6-175627d8038f None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:17.540120 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ec3d4-92ff-458f-b2b6-175627d8038f None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:17.541865 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 10 04:03:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:03:17.546963 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b04ce-8334-49a1-943c-c3885938bc7c None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:17.547362 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b04ce-8334-49a1-943c-c3885938bc7c None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:17.547525 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b04ce-8334-49a1-943c-c3885938bc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:17.566045 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-fd4b04ce-8334-49a1-943c-c3885938bc7c None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:03:17.567208 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-fd4b04ce-8334-49a1-943c-c3885938bc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:03:17.575449 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 10 04:03:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:03:17.723165 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ec3d4-92ff-458f-b2b6-175627d8038f None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:03:17.737111 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ec3d4-92ff-458f-b2b6-175627d8038f None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:03:17.742445 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214c31f-3cb5-43d6-a5af-1d7a4e17859c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:03:17.743068 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214c31f-3cb5-43d6-a5af-1d7a4e17859c service nova] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:17.743352 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214c31f-3cb5-43d6-a5af-1d7a4e17859c service nova] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:17.743632 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214c31f-3cb5-43d6-a5af-1d7a4e17859c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:17.752053 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214c31f-3cb5-43d6-a5af-1d7a4e17859c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:03:17.753616 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214c31f-3cb5-43d6-a5af-1d7a4e17859c service nova] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:03:17.763325 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 717/1440] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:03:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:03:18.996525 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2cec1-47a3-4e2c-bb30-1f35b72ccce6 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:18.997068 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2cec1-47a3-4e2c-bb30-1f35b72ccce6 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:18.997068 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2cec1-47a3-4e2c-bb30-1f35b72ccce6 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:18.998819 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 10 04:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:03:19.003676 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a2d6e-fa38-4288-9b19-25dc54deb515 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:19.004130 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a2d6e-fa38-4288-9b19-25dc54deb515 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:19.004249 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a2d6e-fa38-4288-9b19-25dc54deb515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:19.022219 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-6b8a2d6e-fa38-4288-9b19-25dc54deb515 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:03:19.023430 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-6b8a2d6e-fa38-4288-9b19-25dc54deb515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:03:19.031641 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 10 04:03:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:03:19.181254 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2cec1-47a3-4e2c-bb30-1f35b72ccce6 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:03:19.196075 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2cec1-47a3-4e2c-bb30-1f35b72ccce6 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:03:19.201981 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473e6b5-0254-4c0c-9923-b86b7b546350 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:03:19.202605 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473e6b5-0254-4c0c-9923-b86b7b546350 service nova] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:19.202885 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473e6b5-0254-4c0c-9923-b86b7b546350 service nova] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:19.203155 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473e6b5-0254-4c0c-9923-b86b7b546350 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:19.210839 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c473e6b5-0254-4c0c-9923-b86b7b546350 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:03:19.212450 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c473e6b5-0254-4c0c-9923-b86b7b546350 service nova] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:03:19.221479 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 725/1443] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:03:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:03:21.381071 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15121ac9-4761-47a7-8cd7-40c89ff753c0 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:21.381582 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15121ac9-4761-47a7-8cd7-40c89ff753c0 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:21.381582 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15121ac9-4761-47a7-8cd7-40c89ff753c0 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:21.383334 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 10 04:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:03:21.389245 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66193033-76fc-4113-afc2-ca74042032fc None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:21.389672 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66193033-76fc-4113-afc2-ca74042032fc None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:21.389790 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66193033-76fc-4113-afc2-ca74042032fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:21.406946 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-66193033-76fc-4113-afc2-ca74042032fc None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:03:21.408202 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-66193033-76fc-4113-afc2-ca74042032fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:03:21.416076 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 10 04:03:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:03:21.455094 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15121ac9-4761-47a7-8cd7-40c89ff753c0 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:03:21.465623 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15121ac9-4761-47a7-8cd7-40c89ff753c0 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:03:21.469066 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e4109-8a3b-4b51-b435-b36058386473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:03:21.469695 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e4109-8a3b-4b51-b435-b36058386473 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:21.469985 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e4109-8a3b-4b51-b435-b36058386473 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:21.470260 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e4109-8a3b-4b51-b435-b36058386473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:21.479192 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e4109-8a3b-4b51-b435-b36058386473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:03:21.480655 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e4109-8a3b-4b51-b435-b36058386473 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:03:21.489821 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 720/1446] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:03:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:03:23.902176 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f4e46-6e36-4621-b631-1d0ba722f389 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:23.902738 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f4e46-6e36-4621-b631-1d0ba722f389 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:23.902738 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f4e46-6e36-4621-b631-1d0ba722f389 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:23.904501 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 10 04:03:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:03:23.909891 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f3202-f1a4-420b-be20-a08acfe98b2c None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:23.910314 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f3202-f1a4-420b-be20-a08acfe98b2c None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:23.910445 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f3202-f1a4-420b-be20-a08acfe98b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:23.928473 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-4a1f3202-f1a4-420b-be20-a08acfe98b2c None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:03:23.929655 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-4a1f3202-f1a4-420b-be20-a08acfe98b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:03:23.937302 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 10 04:03:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:03:23.974744 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f4e46-6e36-4621-b631-1d0ba722f389 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:03:23.985591 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f4e46-6e36-4621-b631-1d0ba722f389 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:03:23.989071 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568d4f9-c807-4a26-9218-8b1639054d98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:03:23.989694 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568d4f9-c807-4a26-9218-8b1639054d98 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:23.989974 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568d4f9-c807-4a26-9218-8b1639054d98 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:23.990248 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568d4f9-c807-4a26-9218-8b1639054d98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:23.998777 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568d4f9-c807-4a26-9218-8b1639054d98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:03:24.000247 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568d4f9-c807-4a26-9218-8b1639054d98 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:03:24.009251 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 728/1449] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:03:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:03:26.591757 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff359d-b138-4910-a9f2-75c3a696b26d None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:26.592343 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff359d-b138-4910-a9f2-75c3a696b26d None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:26.592343 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff359d-b138-4910-a9f2-75c3a696b26d None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:26.594130 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 10 04:03:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:03:26.599237 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec9ff5-ec04-414a-b651-20d5da9586b1 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:26.599666 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec9ff5-ec04-414a-b651-20d5da9586b1 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:26.599805 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec9ff5-ec04-414a-b651-20d5da9586b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:26.617438 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-a6ec9ff5-ec04-414a-b651-20d5da9586b1 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:03:26.618722 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-a6ec9ff5-ec04-414a-b651-20d5da9586b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:03:26.627052 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 10 04:03:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:03:26.665798 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff359d-b138-4910-a9f2-75c3a696b26d None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:03:26.676729 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff359d-b138-4910-a9f2-75c3a696b26d None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:03:26.680180 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217176ac-1284-4e1e-9de6-019fa7db8881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:03:26.680803 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217176ac-1284-4e1e-9de6-019fa7db8881 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:26.681087 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217176ac-1284-4e1e-9de6-019fa7db8881 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:26.681365 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217176ac-1284-4e1e-9de6-019fa7db8881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:26.690014 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217176ac-1284-4e1e-9de6-019fa7db8881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:03:26.691442 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217176ac-1284-4e1e-9de6-019fa7db8881 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:03:26.700994 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 723/1452] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:03:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:03:29.080964 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd5fe5-f2d9-4c98-8205-d982d4b723b3 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:29.081506 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd5fe5-f2d9-4c98-8205-d982d4b723b3 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:29.081506 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd5fe5-f2d9-4c98-8205-d982d4b723b3 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:29.083264 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 10 04:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:03:29.088561 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc1a26-7df1-4b42-b5b9-d6990e073582 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:29.088980 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc1a26-7df1-4b42-b5b9-d6990e073582 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:29.089123 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc1a26-7df1-4b42-b5b9-d6990e073582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:29.106556 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-88dc1a26-7df1-4b42-b5b9-d6990e073582 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:03:29.107759 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-88dc1a26-7df1-4b42-b5b9-d6990e073582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:03:29.115828 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 10 04:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:03:29.154353 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd5fe5-f2d9-4c98-8205-d982d4b723b3 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:03:29.164783 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd5fe5-f2d9-4c98-8205-d982d4b723b3 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:03:29.168296 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904272b3-df1b-4df7-89aa-870e6135c541 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:03:29.168916 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904272b3-df1b-4df7-89aa-870e6135c541 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:29.169195 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904272b3-df1b-4df7-89aa-870e6135c541 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:29.169465 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904272b3-df1b-4df7-89aa-870e6135c541 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:29.177833 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904272b3-df1b-4df7-89aa-870e6135c541 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:03:29.179246 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904272b3-df1b-4df7-89aa-870e6135c541 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:03:29.188869 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 731/1455] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:03:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:03:31.561165 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f979b-409d-4b0f-a24e-0041fa6d5dda None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:31.561691 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f979b-409d-4b0f-a24e-0041fa6d5dda None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:31.561808 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f979b-409d-4b0f-a24e-0041fa6d5dda None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:31.563499 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 10 04:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:03:31.568966 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f89e8b-25dc-457d-87e4-807ac5c57fc8 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:31.569375 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f89e8b-25dc-457d-87e4-807ac5c57fc8 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:31.569521 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f89e8b-25dc-457d-87e4-807ac5c57fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:31.587665 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-16f89e8b-25dc-457d-87e4-807ac5c57fc8 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:03:31.589510 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-16f89e8b-25dc-457d-87e4-807ac5c57fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:03:31.597288 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 10 04:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:03:31.634223 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f979b-409d-4b0f-a24e-0041fa6d5dda None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:03:31.645075 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f979b-409d-4b0f-a24e-0041fa6d5dda None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:03:31.648527 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a005a-4741-4e81-ab64-837236707cda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:03:31.649149 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a005a-4741-4e81-ab64-837236707cda service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:31.649429 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a005a-4741-4e81-ab64-837236707cda service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:31.649702 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a005a-4741-4e81-ab64-837236707cda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:31.658893 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a005a-4741-4e81-ab64-837236707cda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:03:31.660335 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a005a-4741-4e81-ab64-837236707cda service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:03:31.669279 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 726/1458] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:03:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:03:34.012438 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724cbdc-5630-4a32-a686-51d3a44db291 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:34.013001 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724cbdc-5630-4a32-a686-51d3a44db291 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:34.013001 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724cbdc-5630-4a32-a686-51d3a44db291 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:34.014752 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 10 04:03:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:03:34.019963 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe7058-940c-471f-a559-61de699f874b None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:34.020339 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe7058-940c-471f-a559-61de699f874b None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:34.020521 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe7058-940c-471f-a559-61de699f874b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:34.039220 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-1afe7058-940c-471f-a559-61de699f874b None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:03:34.040442 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-1afe7058-940c-471f-a559-61de699f874b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:03:34.048204 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 10 04:03:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:03:34.086016 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724cbdc-5630-4a32-a686-51d3a44db291 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:03:34.096971 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724cbdc-5630-4a32-a686-51d3a44db291 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:03:34.100393 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f40d6c-3570-4634-8e20-9bf239cdf892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:03:34.101017 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f40d6c-3570-4634-8e20-9bf239cdf892 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:34.101298 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f40d6c-3570-4634-8e20-9bf239cdf892 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:34.101573 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f40d6c-3570-4634-8e20-9bf239cdf892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:34.110116 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f40d6c-3570-4634-8e20-9bf239cdf892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:03:34.111542 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f40d6c-3570-4634-8e20-9bf239cdf892 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:03:34.121295 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 734/1461] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:03:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:03:36.437319 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7a92a-4e82-4842-ba49-02e6d2dfa7de None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:36.437869 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7a92a-4e82-4842-ba49-02e6d2dfa7de None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:36.437869 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a7a92a-4e82-4842-ba49-02e6d2dfa7de None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:36.439570 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 10 04:03:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:03:36.445043 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb25eb-21eb-4cab-85af-74e9601fe461 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:36.445423 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb25eb-21eb-4cab-85af-74e9601fe461 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:36.445602 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb25eb-21eb-4cab-85af-74e9601fe461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:36.462805 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-d9bb25eb-21eb-4cab-85af-74e9601fe461 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:03:36.464549 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-d9bb25eb-21eb-4cab-85af-74e9601fe461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:03:36.472208 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 10 04:03:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:03:36.509014 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7a92a-4e82-4842-ba49-02e6d2dfa7de None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:03:36.519316 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a7a92a-4e82-4842-ba49-02e6d2dfa7de None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:03:36.522815 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b3e85-88ce-4ced-86d5-1a975f2d1e28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:03:36.523436 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b3e85-88ce-4ced-86d5-1a975f2d1e28 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:36.523747 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b3e85-88ce-4ced-86d5-1a975f2d1e28 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:36.524027 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b3e85-88ce-4ced-86d5-1a975f2d1e28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:36.533096 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b3e85-88ce-4ced-86d5-1a975f2d1e28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:03:36.534513 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b3e85-88ce-4ced-86d5-1a975f2d1e28 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:03:36.544319 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 729/1464] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:03:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:03:38.880889 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745efd2-45c7-4bb5-bf06-47c4a6624c7b None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:38.881405 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745efd2-45c7-4bb5-bf06-47c4a6624c7b None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:38.881516 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745efd2-45c7-4bb5-bf06-47c4a6624c7b None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:38.883228 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 10 04:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:03:38.889096 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d4b7e-226a-405d-a8af-da1760e2d21b None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:38.889593 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d4b7e-226a-405d-a8af-da1760e2d21b None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:38.889690 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d4b7e-226a-405d-a8af-da1760e2d21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:38.907392 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-2f8d4b7e-226a-405d-a8af-da1760e2d21b None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:03:38.908695 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-2f8d4b7e-226a-405d-a8af-da1760e2d21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:03:38.916426 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 10 04:03:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:03:38.954004 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745efd2-45c7-4bb5-bf06-47c4a6624c7b None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:03:38.964267 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745efd2-45c7-4bb5-bf06-47c4a6624c7b None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:03:38.967640 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a25abe4-37b1-4d82-a7d8-bb05d191814d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:03:38.968286 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25abe4-37b1-4d82-a7d8-bb05d191814d service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:38.968566 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25abe4-37b1-4d82-a7d8-bb05d191814d service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:38.968838 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25abe4-37b1-4d82-a7d8-bb05d191814d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:38.977219 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25abe4-37b1-4d82-a7d8-bb05d191814d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:03:38.978624 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a25abe4-37b1-4d82-a7d8-bb05d191814d service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:03:38.988267 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 737/1467] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:03:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:03:41.297044 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119645ac-98c0-4129-b07a-1c47711fe1d8 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:41.297605 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119645ac-98c0-4129-b07a-1c47711fe1d8 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:41.297605 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119645ac-98c0-4129-b07a-1c47711fe1d8 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:41.299401 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 10 04:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:03:41.304551 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737df7e-51c0-4a27-a08f-ad30a4325658 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:41.304991 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737df7e-51c0-4a27-a08f-ad30a4325658 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:41.305088 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737df7e-51c0-4a27-a08f-ad30a4325658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:41.322413 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-1737df7e-51c0-4a27-a08f-ad30a4325658 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:03:41.324104 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-1737df7e-51c0-4a27-a08f-ad30a4325658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:03:41.331555 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 10 04:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:03:41.368010 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119645ac-98c0-4129-b07a-1c47711fe1d8 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:03:41.378587 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119645ac-98c0-4129-b07a-1c47711fe1d8 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:03:41.382187 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68808122-374f-4098-b2fd-ecd88fb712ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:03:41.386199 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68808122-374f-4098-b2fd-ecd88fb712ba service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:41.386485 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68808122-374f-4098-b2fd-ecd88fb712ba service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:41.386762 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68808122-374f-4098-b2fd-ecd88fb712ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:41.397782 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68808122-374f-4098-b2fd-ecd88fb712ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:03:41.399213 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68808122-374f-4098-b2fd-ecd88fb712ba service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:03:41.409237 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 732/1470] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:03:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:03:43.716360 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6e006-d992-4f27-9fa7-306de703e0e2 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:43.716887 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6e006-d992-4f27-9fa7-306de703e0e2 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:43.716887 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6e006-d992-4f27-9fa7-306de703e0e2 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:43.718595 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 739/1471] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 10 04:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:03:43.724010 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8019350-83a5-4343-8d5e-3b7461bc9792 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:43.724431 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8019350-83a5-4343-8d5e-3b7461bc9792 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:43.724562 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8019350-83a5-4343-8d5e-3b7461bc9792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:43.742261 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-c8019350-83a5-4343-8d5e-3b7461bc9792 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:03:43.743443 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-c8019350-83a5-4343-8d5e-3b7461bc9792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:03:43.751788 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 733/1472] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 10 04:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:03:43.787110 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6e006-d992-4f27-9fa7-306de703e0e2 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:03:43.797814 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6e006-d992-4f27-9fa7-306de703e0e2 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:03:43.801219 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3101a2be-6df0-4c25-862b-8f7014f2640f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:03:43.801834 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101a2be-6df0-4c25-862b-8f7014f2640f service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:03:43.802113 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101a2be-6df0-4c25-862b-8f7014f2640f service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:03:43.802385 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101a2be-6df0-4c25-862b-8f7014f2640f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:03:43.811594 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3101a2be-6df0-4c25-862b-8f7014f2640f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:03:43.813056 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3101a2be-6df0-4c25-862b-8f7014f2640f service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:03:43.822657 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 740/1473] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:03:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:04:04.257322 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0599ac-a8ca-4602-a877-4e605c298bed None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:04:04.257922 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0599ac-a8ca-4602-a877-4e605c298bed None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:04:04.257922 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0599ac-a8ca-4602-a877-4e605c298bed None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:04:04.259671 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 734/1474] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:04:04.264771 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a64e5-7ac4-4f4e-85bd-14962fa5ed4b None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:04:04.265221 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a64e5-7ac4-4f4e-85bd-14962fa5ed4b None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:04:04.265358 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a64e5-7ac4-4f4e-85bd-14962fa5ed4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:04:04.283425 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-463a64e5-7ac4-4f4e-85bd-14962fa5ed4b None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:04:04.284650 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-463a64e5-7ac4-4f4e-85bd-14962fa5ed4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:04:04.293139 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 741/1475] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:04:04.338739 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa30449-d9ba-4693-81d5-76e969942c3d None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:04:04.339260 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa30449-d9ba-4693-81d5-76e969942c3d None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:04:04.339537 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa30449-d9ba-4693-81d5-76e969942c3d None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:04:04.341311 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 735/1476] 10.222.0.15 () {54 vars in 961 bytes} [Thu Mar 10 04:04:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:04:04.345999 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512088d-d08e-45fe-9b37-ae9ed0e76cc5 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:04:04.346285 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512088d-d08e-45fe-9b37-ae9ed0e76cc5 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:04:04.346560 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512088d-d08e-45fe-9b37-ae9ed0e76cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:04:04.364699 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-f512088d-d08e-45fe-9b37-ae9ed0e76cc5 None None] MFA Rules not processed for user `6e7c195f91114855acc58163631544d7`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:04:04.365909 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-f512088d-d08e-45fe-9b37-ae9ed0e76cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:04:04.372068 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 742/1477] 10.222.0.15 () {58 vars in 1058 bytes} [Thu Mar 10 04:04:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:04:04.378995 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa30449-d9ba-4693-81d5-76e969942c3d None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:04:04.389151 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa30449-d9ba-4693-81d5-76e969942c3d None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:04:04.392841 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f15fbc-7523-4b46-a68e-7d6996a61dff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7c195f91114855acc58163631544d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:04:04.393469 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f15fbc-7523-4b46-a68e-7d6996a61dff service glance] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:04:04.393761 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f15fbc-7523-4b46-a68e-7d6996a61dff service glance] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:04:04.394040 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f15fbc-7523-4b46-a68e-7d6996a61dff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:04:04.403433 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f15fbc-7523-4b46-a68e-7d6996a61dff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:04:04.404895 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f15fbc-7523-4b46-a68e-7d6996a61dff service glance] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:04:04.414046 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 736/1478] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:04:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:04:06.771308 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2fa9c-8485-48c8-a104-0087c9bd2344 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:04:06.771761 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2fa9c-8485-48c8-a104-0087c9bd2344 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:04:06.771890 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2fa9c-8485-48c8-a104-0087c9bd2344 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:04:06.773656 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 743/1479] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:04:06.778813 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d13d8-365c-46b3-86d3-fafa834c00a5 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:04:06.779240 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d13d8-365c-46b3-86d3-fafa834c00a5 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:04:06.779371 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d13d8-365c-46b3-86d3-fafa834c00a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:04:06.797129 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-1c4d13d8-365c-46b3-86d3-fafa834c00a5 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:04:06.798317 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-1c4d13d8-365c-46b3-86d3-fafa834c00a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:04:06.805946 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 737/1480] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:04:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:04:06.829933 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2fa9c-8485-48c8-a104-0087c9bd2344 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:04:06.841895 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2fa9c-8485-48c8-a104-0087c9bd2344 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:04:06.846262 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5a101-ac08-4c57-9eba-ee88fc481357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:04:06.846900 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5a101-ac08-4c57-9eba-ee88fc481357 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:04:06.847183 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5a101-ac08-4c57-9eba-ee88fc481357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:04:06.847460 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5a101-ac08-4c57-9eba-ee88fc481357 admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:04:06.848226 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5a101-ac08-4c57-9eba-ee88fc481357 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:04:06.850068 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5a101-ac08-4c57-9eba-ee88fc481357 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:04:06.863670 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 744/1481] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Mar 10 04:04:06 2022] GET /identity/v3/projects => generated 2553 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:04:09.155824 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145c3b1-2b4c-42dc-bf24-621eaeb38758 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:04:09.156292 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145c3b1-2b4c-42dc-bf24-621eaeb38758 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:04:09.156401 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145c3b1-2b4c-42dc-bf24-621eaeb38758 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:04:09.158152 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 738/1482] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:04:09.163167 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66840248-e7a9-46a4-94fc-320c59b12933 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:04:09.163582 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66840248-e7a9-46a4-94fc-320c59b12933 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:04:09.163742 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66840248-e7a9-46a4-94fc-320c59b12933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:04:09.180922 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-66840248-e7a9-46a4-94fc-320c59b12933 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:04:09.182149 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-66840248-e7a9-46a4-94fc-320c59b12933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:04:09.189733 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 745/1483] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:04:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:04:09.231465 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145c3b1-2b4c-42dc-bf24-621eaeb38758 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:04:09.245371 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145c3b1-2b4c-42dc-bf24-621eaeb38758 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:04:09.250645 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c05cef-34e3-441c-80f0-bf3bdf4ae2e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:04:09.251265 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c05cef-34e3-441c-80f0-bf3bdf4ae2e2 service nova] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:04:09.251547 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c05cef-34e3-441c-80f0-bf3bdf4ae2e2 service nova] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:04:09.251853 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c05cef-34e3-441c-80f0-bf3bdf4ae2e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:04:09.259611 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c05cef-34e3-441c-80f0-bf3bdf4ae2e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:04:09.261697 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c05cef-34e3-441c-80f0-bf3bdf4ae2e2 service nova] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:04:09.270707 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 739/1484] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:04:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:04:11.676789 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf043a8-7346-4fea-b506-65f619855406 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:04:11.677380 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf043a8-7346-4fea-b506-65f619855406 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:04:11.677380 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf043a8-7346-4fea-b506-65f619855406 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:04:11.679106 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 746/1485] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:04:11.684181 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a2505-5b74-47a0-890a-375fec6d1e58 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:04:11.684605 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a2505-5b74-47a0-890a-375fec6d1e58 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:04:11.684758 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a2505-5b74-47a0-890a-375fec6d1e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:04:11.702316 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-287a2505-5b74-47a0-890a-375fec6d1e58 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:04:11.703487 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-287a2505-5b74-47a0-890a-375fec6d1e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:04:11.711424 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 740/1486] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:04:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:04:11.747803 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf043a8-7346-4fea-b506-65f619855406 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:04:11.758071 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf043a8-7346-4fea-b506-65f619855406 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:04:11.761534 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84c298-3a9e-4e53-b2bd-f882a2f000fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:04:11.762158 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84c298-3a9e-4e53-b2bd-f882a2f000fe service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:04:11.762438 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84c298-3a9e-4e53-b2bd-f882a2f000fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:04:11.762712 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84c298-3a9e-4e53-b2bd-f882a2f000fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:04:11.771166 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f84c298-3a9e-4e53-b2bd-f882a2f000fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:04:11.772616 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f84c298-3a9e-4e53-b2bd-f882a2f000fe service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:04:11.782063 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 747/1487] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:04:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:04:14.097406 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9fb48-6b8e-4d44-b68d-947e09b9f594 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:04:14.097941 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9fb48-6b8e-4d44-b68d-947e09b9f594 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:04:14.097941 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9fb48-6b8e-4d44-b68d-947e09b9f594 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:04:14.099751 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 741/1488] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:04:14.104853 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9c36b-7758-4995-9b6d-9edf62f54af5 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:04:14.105247 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9c36b-7758-4995-9b6d-9edf62f54af5 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:04:14.105414 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9c36b-7758-4995-9b6d-9edf62f54af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:04:14.123160 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-f9e9c36b-7758-4995-9b6d-9edf62f54af5 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:04:14.124387 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-f9e9c36b-7758-4995-9b6d-9edf62f54af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:04:14.132078 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 748/1489] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:04:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:04:14.169791 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9fb48-6b8e-4d44-b68d-947e09b9f594 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:04:14.180267 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9fb48-6b8e-4d44-b68d-947e09b9f594 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:04:14.184843 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7243b-5cfc-4b8e-95cc-afca9c76e7bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:04:14.185635 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7243b-5cfc-4b8e-95cc-afca9c76e7bd service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:04:14.185948 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7243b-5cfc-4b8e-95cc-afca9c76e7bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:04:14.186446 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7243b-5cfc-4b8e-95cc-afca9c76e7bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:04:14.195370 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7243b-5cfc-4b8e-95cc-afca9c76e7bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:04:14.196834 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7243b-5cfc-4b8e-95cc-afca9c76e7bd service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:04:14.206528 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 742/1490] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:04:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:04:16.555476 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca69633-1edb-4af7-8c7f-2bbee3791d2d None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:04:16.556073 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca69633-1edb-4af7-8c7f-2bbee3791d2d None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:04:16.556073 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca69633-1edb-4af7-8c7f-2bbee3791d2d None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:04:16.558172 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 749/1491] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:04:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:04:16.564090 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b94a66-9b34-4ab3-8a54-f1973ce158db None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:04:16.564477 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b94a66-9b34-4ab3-8a54-f1973ce158db None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:04:16.564650 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b94a66-9b34-4ab3-8a54-f1973ce158db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:04:16.582872 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-d7b94a66-9b34-4ab3-8a54-f1973ce158db None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:04:16.584123 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-d7b94a66-9b34-4ab3-8a54-f1973ce158db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:04:16.593172 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 743/1492] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:04:16.632501 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca69633-1edb-4af7-8c7f-2bbee3791d2d None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:04:16.643229 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca69633-1edb-4af7-8c7f-2bbee3791d2d None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:04:16.646640 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e323d0-11cf-439e-88c4-c60c06c9a3f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:04:16.647261 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e323d0-11cf-439e-88c4-c60c06c9a3f9 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:04:16.647538 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e323d0-11cf-439e-88c4-c60c06c9a3f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:04:16.647847 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e323d0-11cf-439e-88c4-c60c06c9a3f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:04:16.656929 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e323d0-11cf-439e-88c4-c60c06c9a3f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:04:16.658343 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e323d0-11cf-439e-88c4-c60c06c9a3f9 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:04:16.667265 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 750/1493] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:04:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:04:19.157567 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cee5d9-d89d-4fc1-a47d-c522d881cdbc None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:04:19.158116 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cee5d9-d89d-4fc1-a47d-c522d881cdbc None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:04:19.158116 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cee5d9-d89d-4fc1-a47d-c522d881cdbc None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:04:19.159946 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 744/1494] 10.222.0.15 () {54 vars in 926 bytes} [Thu Mar 10 04:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:04:19.165155 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca470df-917a-46b2-8ad8-07f5c91e1b27 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:04:19.165573 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca470df-917a-46b2-8ad8-07f5c91e1b27 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:04:19.165787 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca470df-917a-46b2-8ad8-07f5c91e1b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:04:19.188272 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-9ca470df-917a-46b2-8ad8-07f5c91e1b27 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:04:19.189496 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-9ca470df-917a-46b2-8ad8-07f5c91e1b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:04:19.197602 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 751/1495] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Mar 10 04:04:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:04:19.239270 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cee5d9-d89d-4fc1-a47d-c522d881cdbc None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:04:19.251246 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cee5d9-d89d-4fc1-a47d-c522d881cdbc None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:04:19.255601 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17049f-e822-4aa4-8e84-17dc03bfdbd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:04:19.256439 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17049f-e822-4aa4-8e84-17dc03bfdbd3 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:04:19.256942 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17049f-e822-4aa4-8e84-17dc03bfdbd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:04:19.257238 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17049f-e822-4aa4-8e84-17dc03bfdbd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:04:19.266812 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17049f-e822-4aa4-8e84-17dc03bfdbd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:04:19.268295 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17049f-e822-4aa4-8e84-17dc03bfdbd3 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:04:19.278869 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 745/1496] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:04:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:05:38.137699 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cf025-4a06-42f5-ad7c-7328e33c5ee0 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:05:38.138188 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cf025-4a06-42f5-ad7c-7328e33c5ee0 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:05:38.138289 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cf025-4a06-42f5-ad7c-7328e33c5ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:05:38.155987 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-873cf025-4a06-42f5-ad7c-7328e33c5ee0 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:05:38.157151 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-873cf025-4a06-42f5-ad7c-7328e33c5ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:05:38.165236 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 752/1497] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:05:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:05:38.174260 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da2e9b-e290-46c7-96ba-ef96bd050be4 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:05:38.174781 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da2e9b-e290-46c7-96ba-ef96bd050be4 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:05:38.174921 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da2e9b-e290-46c7-96ba-ef96bd050be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:05:38.192269 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-e5da2e9b-e290-46c7-96ba-ef96bd050be4 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:05:38.193436 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-e5da2e9b-e290-46c7-96ba-ef96bd050be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:05:38.201406 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 746/1498] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:05:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:05:38.205790 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873cf025-4a06-42f5-ad7c-7328e33c5ee0 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:05:38.215415 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873cf025-4a06-42f5-ad7c-7328e33c5ee0 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:05:38.219793 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ced3a-855a-41be-978c-98c5e065d854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:05:38.220430 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ced3a-855a-41be-978c-98c5e065d854 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:05:38.220714 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ced3a-855a-41be-978c-98c5e065d854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:05:38.220985 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ced3a-855a-41be-978c-98c5e065d854 admin admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:05:38.221692 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ced3a-855a-41be-978c-98c5e065d854 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:05:38.221994 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ced3a-855a-41be-978c-98c5e065d854 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:05:38.222985 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING py.warnings [None req-308ced3a-855a-41be-978c-98c5e065d854 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 10 04:05:38.222985 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: warnings.warn(msg) Mar 10 04:05:38.222985 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: Mar 10 04:05:38.223881 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ced3a-855a-41be-978c-98c5e065d854 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:05:38.235260 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 753/1499] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:05:38.243106 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da2e9b-e290-46c7-96ba-ef96bd050be4 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:05:38.251915 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da2e9b-e290-46c7-96ba-ef96bd050be4 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:05:38.256299 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe657fa-90be-4004-9fbb-633265667151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:05:38.256922 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe657fa-90be-4004-9fbb-633265667151 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:05:38.257202 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe657fa-90be-4004-9fbb-633265667151 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:05:38.257474 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe657fa-90be-4004-9fbb-633265667151 admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:05:38.258654 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe657fa-90be-4004-9fbb-633265667151 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:05:38.260361 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING py.warnings [None req-afe657fa-90be-4004-9fbb-633265667151 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 10 04:05:38.260361 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: warnings.warn(msg) Mar 10 04:05:38.260361 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: Mar 10 04:05:38.261524 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe657fa-90be-4004-9fbb-633265667151 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:05:38.296976 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 747/1500] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:05:38 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:05:38.301099 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ced3a-855a-41be-978c-98c5e065d854 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:05:38.310500 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ced3a-855a-41be-978c-98c5e065d854 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:05:38.364237 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bde872-5b10-45a8-82e7-d447f39f1d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:05:38.364952 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bde872-5b10-45a8-82e7-d447f39f1d15 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:05:38.365183 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bde872-5b10-45a8-82e7-d447f39f1d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:05:38.365457 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bde872-5b10-45a8-82e7-d447f39f1d15 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:05:38.366143 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bde872-5b10-45a8-82e7-d447f39f1d15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:05:38.367138 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING py.warnings [None req-85bde872-5b10-45a8-82e7-d447f39f1d15 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 10 04:05:38.367138 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: warnings.warn(msg) Mar 10 04:05:38.367138 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: Mar 10 04:05:38.368383 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bde872-5b10-45a8-82e7-d447f39f1d15 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:05:38.388397 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 754/1501] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:05:38 2022] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:05:38.392728 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe657fa-90be-4004-9fbb-633265667151 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:05:38.403425 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe657fa-90be-4004-9fbb-633265667151 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:05:38.407882 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e671a02-8690-4f0f-a0b1-b6dbcd94f9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:05:38.408531 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e671a02-8690-4f0f-a0b1-b6dbcd94f9fe admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:05:38.408815 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e671a02-8690-4f0f-a0b1-b6dbcd94f9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:05:38.409094 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e671a02-8690-4f0f-a0b1-b6dbcd94f9fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:05:38.409810 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e671a02-8690-4f0f-a0b1-b6dbcd94f9fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:05:38.410819 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING py.warnings [None req-1e671a02-8690-4f0f-a0b1-b6dbcd94f9fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 10 04:05:38.410819 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: warnings.warn(msg) Mar 10 04:05:38.410819 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: Mar 10 04:05:38.411714 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e671a02-8690-4f0f-a0b1-b6dbcd94f9fe admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:05:38.423919 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 748/1502] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:05:38.427925 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bde872-5b10-45a8-82e7-d447f39f1d15 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:05:38.437364 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bde872-5b10-45a8-82e7-d447f39f1d15 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:05:38.441843 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afb5ba-d2bd-475c-9724-88410059f609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:05:38.442490 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afb5ba-d2bd-475c-9724-88410059f609 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:05:38.442772 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afb5ba-d2bd-475c-9724-88410059f609 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:05:38.443045 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afb5ba-d2bd-475c-9724-88410059f609 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:05:38.443786 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09afb5ba-d2bd-475c-9724-88410059f609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:05:38.445036 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING py.warnings [None req-09afb5ba-d2bd-475c-9724-88410059f609 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 10 04:05:38.445036 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: warnings.warn(msg) Mar 10 04:05:38.445036 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: Mar 10 04:05:38.446394 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09afb5ba-d2bd-475c-9724-88410059f609 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:05:38.459187 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 755/1503] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:05:38.463969 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e671a02-8690-4f0f-a0b1-b6dbcd94f9fe admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:05:38.473597 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e671a02-8690-4f0f-a0b1-b6dbcd94f9fe admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:05:38.478039 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a10bb0-ea2d-4bf9-ab0f-bcc783969d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:05:38.478901 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a10bb0-ea2d-4bf9-ab0f-bcc783969d54 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:05:38.479185 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a10bb0-ea2d-4bf9-ab0f-bcc783969d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:05:38.479466 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a10bb0-ea2d-4bf9-ab0f-bcc783969d54 admin admin] PATH_INFO: `/v3/projects/5a1792b10f9540578fea78df171d26ae/users/5d96fd3c048247d8aa44b09ad7854288/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:05:38.493536 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a10bb0-ea2d-4bf9-ab0f-bcc783969d54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a1792b10f9540578fea78df171d26ae, user_id=5d96fd3c048247d8aa44b09ad7854288, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:05:38.494562 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING py.warnings [None req-b1a10bb0-ea2d-4bf9-ab0f-bcc783969d54 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 10 04:05:38.494562 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: warnings.warn(msg) Mar 10 04:05:38.494562 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: Mar 10 04:05:38.496519 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a10bb0-ea2d-4bf9-ab0f-bcc783969d54 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:05:38.509976 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 749/1504] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:05:38 2022] PUT /identity/v3/projects/5a1792b10f9540578fea78df171d26ae/users/5d96fd3c048247d8aa44b09ad7854288/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:05:38.521072 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b636301-0d4c-4081-95a7-c12705d033f9 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:05:38.521360 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b636301-0d4c-4081-95a7-c12705d033f9 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:05:38.521635 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b636301-0d4c-4081-95a7-c12705d033f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:05:38.547053 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-3b636301-0d4c-4081-95a7-c12705d033f9 None None] MFA Rules not processed for user `5d96fd3c048247d8aa44b09ad7854288`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:05:38.548263 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-3b636301-0d4c-4081-95a7-c12705d033f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:05:38.608012 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 756/1505] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:05:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:05:38.619504 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a10bb0-ea2d-4bf9-ab0f-bcc783969d54 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:05:38.688354 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a10bb0-ea2d-4bf9-ab0f-bcc783969d54 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:05:38.693666 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc91c6e-5851-4973-bcd5-27bdac3d35ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:05:38.694306 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc91c6e-5851-4973-bcd5-27bdac3d35ad service nova] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:05:38.694847 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc91c6e-5851-4973-bcd5-27bdac3d35ad service nova] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:05:38.695118 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc91c6e-5851-4973-bcd5-27bdac3d35ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:05:38.703062 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc91c6e-5851-4973-bcd5-27bdac3d35ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:05:38.704665 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc91c6e-5851-4973-bcd5-27bdac3d35ad service nova] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:05:38.713029 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 750/1506] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:05:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:05:38.782940 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c7406-740c-475c-8692-8850149b8a6e None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:05:38.783234 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c7406-740c-475c-8692-8850149b8a6e None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:05:38.783531 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c7406-740c-475c-8692-8850149b8a6e None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:05:38.785278 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 757/1507] 10.222.0.15 () {52 vars in 829 bytes} [Thu Mar 10 04:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:05:38.788807 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc91c6e-5851-4973-bcd5-27bdac3d35ad service nova] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:05:38.847916 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc91c6e-5851-4973-bcd5-27bdac3d35ad service nova] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:05:38.852520 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1429148-ec5d-4db7-89c2-bcecf8281710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:05:38.853370 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1429148-ec5d-4db7-89c2-bcecf8281710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:05:38.853652 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1429148-ec5d-4db7-89c2-bcecf8281710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:05:38.853926 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1429148-ec5d-4db7-89c2-bcecf8281710 admin admin] PATH_INFO: `/v3/users/5d96fd3c048247d8aa44b09ad7854288` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:05:38.855110 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1429148-ec5d-4db7-89c2-bcecf8281710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d96fd3c048247d8aa44b09ad7854288)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:05:38.856152 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING py.warnings [None req-f1429148-ec5d-4db7-89c2-bcecf8281710 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 10 04:05:38.856152 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: warnings.warn(msg) Mar 10 04:05:38.856152 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: Mar 10 04:05:38.857330 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1429148-ec5d-4db7-89c2-bcecf8281710 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:05:38.918448 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-f1429148-ec5d-4db7-89c2-bcecf8281710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d96fd3c048247d8aa44b09ad7854288'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:05:38.919094 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-f1429148-ec5d-4db7-89c2-bcecf8281710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d96fd3c048247d8aa44b09ad7854288'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:05:38.931173 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-f1429148-ec5d-4db7-89c2-bcecf8281710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d96fd3c048247d8aa44b09ad7854288'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:05:38.948887 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-f1429148-ec5d-4db7-89c2-bcecf8281710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d96fd3c048247d8aa44b09ad7854288'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:05:38.949539 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-f1429148-ec5d-4db7-89c2-bcecf8281710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d96fd3c048247d8aa44b09ad7854288'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:05:38.963194 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 751/1508] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:05:38 2022] DELETE /identity/v3/users/5d96fd3c048247d8aa44b09ad7854288 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:05:38.967660 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053a93a-da72-4758-8c6e-9fe7a2c870dd None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:05:38.967979 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053a93a-da72-4758-8c6e-9fe7a2c870dd None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:05:38.968258 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053a93a-da72-4758-8c6e-9fe7a2c870dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:05:38.985708 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-3053a93a-da72-4758-8c6e-9fe7a2c870dd None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:05:38.986874 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-3053a93a-da72-4758-8c6e-9fe7a2c870dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:05:39.041126 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 758/1509] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:05:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:05:39.050540 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1429148-ec5d-4db7-89c2-bcecf8281710 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:05:39.052834 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-f1429148-ec5d-4db7-89c2-bcecf8281710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:05:39.107468 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1429148-ec5d-4db7-89c2-bcecf8281710 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:05:39.111049 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79e2f2-0c7d-44e4-a068-169b6fcde2f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:05:39.111705 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79e2f2-0c7d-44e4-a068-169b6fcde2f9 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:05:39.112003 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79e2f2-0c7d-44e4-a068-169b6fcde2f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:05:39.112284 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79e2f2-0c7d-44e4-a068-169b6fcde2f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:05:39.121771 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79e2f2-0c7d-44e4-a068-169b6fcde2f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:05:39.123204 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79e2f2-0c7d-44e4-a068-169b6fcde2f9 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:05:39.132365 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 752/1510] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:05:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:05:39.456488 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053a93a-da72-4758-8c6e-9fe7a2c870dd None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:05:39.458008 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-3053a93a-da72-4758-8c6e-9fe7a2c870dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:05:39.470477 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053a93a-da72-4758-8c6e-9fe7a2c870dd None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:05:39.475104 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e55a1-0bd3-4656-b312-cc65e1732bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:05:39.475998 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e55a1-0bd3-4656-b312-cc65e1732bfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:05:39.476276 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e55a1-0bd3-4656-b312-cc65e1732bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:05:39.476549 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e55a1-0bd3-4656-b312-cc65e1732bfc admin admin] PATH_INFO: `/v3/projects/5a1792b10f9540578fea78df171d26ae` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:05:39.478513 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e55a1-0bd3-4656-b312-cc65e1732bfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a1792b10f9540578fea78df171d26ae)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:05:39.479517 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING py.warnings [None req-5d3e55a1-0bd3-4656-b312-cc65e1732bfc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 10 04:05:39.479517 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: warnings.warn(msg) Mar 10 04:05:39.479517 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: Mar 10 04:05:39.480735 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e55a1-0bd3-4656-b312-cc65e1732bfc admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:05:39.537337 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5d3e55a1-0bd3-4656-b312-cc65e1732bfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a1792b10f9540578fea78df171d26ae', 'request_id': 'req-5d3e55a1-0bd3-4656-b312-cc65e1732bfc'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:05:39.543891 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5d3e55a1-0bd3-4656-b312-cc65e1732bfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a1792b10f9540578fea78df171d26ae', 'request_id': 'req-5d3e55a1-0bd3-4656-b312-cc65e1732bfc'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:05:39.556861 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5d3e55a1-0bd3-4656-b312-cc65e1732bfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a1792b10f9540578fea78df171d26ae', 'request_id': 'req-5d3e55a1-0bd3-4656-b312-cc65e1732bfc'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:05:39.571492 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5d3e55a1-0bd3-4656-b312-cc65e1732bfc admin admin] The token cache is being invalidate because project 5a1792b10f9540578fea78df171d26ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:05:39.571820 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5d3e55a1-0bd3-4656-b312-cc65e1732bfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:05:39.572440 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5d3e55a1-0bd3-4656-b312-cc65e1732bfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:05:39.574078 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 759/1511] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:05:39 2022] DELETE /identity/v3/projects/5a1792b10f9540578fea78df171d26ae => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:07:11.596919 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3777a5-e7d6-4970-8811-9975ba163164 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:07:11.597517 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3777a5-e7d6-4970-8811-9975ba163164 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:07:11.597517 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3777a5-e7d6-4970-8811-9975ba163164 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:07:11.599292 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 753/1512] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 10 04:07:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:07:11.604808 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7767c-a6b5-4466-9114-c4695dd6bed9 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:07:11.605284 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7767c-a6b5-4466-9114-c4695dd6bed9 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:07:11.605649 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7767c-a6b5-4466-9114-c4695dd6bed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:07:11.625486 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-61a7767c-a6b5-4466-9114-c4695dd6bed9 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:07:11.626679 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-61a7767c-a6b5-4466-9114-c4695dd6bed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:07:11.681177 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 760/1513] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 10 04:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:07:11.831907 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3777a5-e7d6-4970-8811-9975ba163164 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:07:11.833581 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-3e3777a5-e7d6-4970-8811-9975ba163164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:07:11.908157 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3777a5-e7d6-4970-8811-9975ba163164 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:07:11.913424 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48bf66c-e0a7-48cc-9117-a38171f011f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:07:11.914057 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bf66c-e0a7-48cc-9117-a38171f011f2 service nova] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:07:11.914339 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bf66c-e0a7-48cc-9117-a38171f011f2 service nova] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:07:11.914615 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bf66c-e0a7-48cc-9117-a38171f011f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:07:11.922435 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48bf66c-e0a7-48cc-9117-a38171f011f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:07:11.924039 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48bf66c-e0a7-48cc-9117-a38171f011f2 service nova] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:07:11.933470 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 754/1514] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:07:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:07:12.498930 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e49f9a-3e84-45b0-8167-258cb3e23dbe None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:07:12.499222 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e49f9a-3e84-45b0-8167-258cb3e23dbe None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:07:12.499502 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e49f9a-3e84-45b0-8167-258cb3e23dbe None None] PATH_INFO: `/v3` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:07:12.500843 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 761/1515] 10.222.0.26 () {54 vars in 925 bytes} [Thu Mar 10 04:07:12 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:07:12.508711 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f02e5-07ce-484b-9af7-73c9d17bc9c0 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:07:12.508998 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f02e5-07ce-484b-9af7-73c9d17bc9c0 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:07:12.509279 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f02e5-07ce-484b-9af7-73c9d17bc9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:07:12.527424 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-8f2f02e5-07ce-484b-9af7-73c9d17bc9c0 None None] MFA Rules not processed for user `319da006b10c41f8aa8a9d5aa2225b60`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:07:12.528645 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-8f2f02e5-07ce-484b-9af7-73c9d17bc9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:07:12.588329 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 755/1516] 10.222.0.26 () {58 vars in 1015 bytes} [Thu Mar 10 04:07:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:07:13.212103 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d026cd-6f9a-4bdb-9c5f-321ec7ff3112 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:07:13.212651 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d026cd-6f9a-4bdb-9c5f-321ec7ff3112 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:07:13.212651 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d026cd-6f9a-4bdb-9c5f-321ec7ff3112 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:07:13.214428 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 762/1517] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 10 04:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:07:13.219171 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeff3ca-f700-427c-aae9-b6659eb639db None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:07:13.219618 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeff3ca-f700-427c-aae9-b6659eb639db None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:07:13.219746 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeff3ca-f700-427c-aae9-b6659eb639db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:07:13.237070 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-1eeff3ca-f700-427c-aae9-b6659eb639db None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:07:13.238241 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-1eeff3ca-f700-427c-aae9-b6659eb639db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:07:13.246633 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 756/1518] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 10 04:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:07:13.397833 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d026cd-6f9a-4bdb-9c5f-321ec7ff3112 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:07:13.411605 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d026cd-6f9a-4bdb-9c5f-321ec7ff3112 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:07:13.416873 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae69912-691e-436a-8ea9-6c39b27d38cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:07:13.417496 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae69912-691e-436a-8ea9-6c39b27d38cb service nova] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:07:13.417797 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae69912-691e-436a-8ea9-6c39b27d38cb service nova] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:07:13.418068 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae69912-691e-436a-8ea9-6c39b27d38cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:07:13.425942 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae69912-691e-436a-8ea9-6c39b27d38cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:07:13.428026 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae69912-691e-436a-8ea9-6c39b27d38cb service nova] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:07:13.437395 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 763/1519] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:07:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:07:16.475245 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5bb86-b913-420b-8a3e-84a6cd0878bc None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:07:16.475809 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5bb86-b913-420b-8a3e-84a6cd0878bc None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:07:16.475809 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5bb86-b913-420b-8a3e-84a6cd0878bc None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:07:16.477563 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 757/1520] 10.222.0.15 () {54 vars in 960 bytes} [Thu Mar 10 04:07:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:07:16.482617 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802accf2-3bd8-4313-8854-397397957aec None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:07:16.483062 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802accf2-3bd8-4313-8854-397397957aec None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:07:16.483200 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802accf2-3bd8-4313-8854-397397957aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:07:16.503328 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-802accf2-3bd8-4313-8854-397397957aec None None] MFA Rules not processed for user `319da006b10c41f8aa8a9d5aa2225b60`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:07:16.504565 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-802accf2-3bd8-4313-8854-397397957aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:07:16.512981 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 764/1521] 10.222.0.15 () {58 vars in 1057 bytes} [Thu Mar 10 04:07:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:07:16.520409 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5bb86-b913-420b-8a3e-84a6cd0878bc None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:07:16.533544 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5bb86-b913-420b-8a3e-84a6cd0878bc None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:07:16.539063 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8604154-dc6b-4534-9bad-0d9fbac5c35a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319da006b10c41f8aa8a9d5aa2225b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:07:16.539853 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8604154-dc6b-4534-9bad-0d9fbac5c35a service placement] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:07:16.540143 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8604154-dc6b-4534-9bad-0d9fbac5c35a service placement] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:07:16.540425 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8604154-dc6b-4534-9bad-0d9fbac5c35a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:07:16.548781 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8604154-dc6b-4534-9bad-0d9fbac5c35a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:07:16.550395 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8604154-dc6b-4534-9bad-0d9fbac5c35a service placement] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:07:16.560848 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 758/1522] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:07:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:07:25.100984 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e022f-3c5d-4a03-9d32-8050026b1e9f None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:07:25.101567 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e022f-3c5d-4a03-9d32-8050026b1e9f None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:07:25.101567 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e022f-3c5d-4a03-9d32-8050026b1e9f None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:07:25.103271 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 765/1523] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 10 04:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:07:25.108325 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f6148-7363-4cc3-8b70-37daa9c547e5 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:07:25.108716 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f6148-7363-4cc3-8b70-37daa9c547e5 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:07:25.108938 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f6148-7363-4cc3-8b70-37daa9c547e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:07:25.127280 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-171f6148-7363-4cc3-8b70-37daa9c547e5 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:07:25.128420 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-171f6148-7363-4cc3-8b70-37daa9c547e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:07:25.136662 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 759/1524] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 10 04:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:07:25.286485 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e022f-3c5d-4a03-9d32-8050026b1e9f None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:07:25.300304 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e022f-3c5d-4a03-9d32-8050026b1e9f None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:07:25.306038 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c31ff-83e4-4767-b5f1-1cb78b39cd30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:07:25.306668 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c31ff-83e4-4767-b5f1-1cb78b39cd30 service nova] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:07:25.306953 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c31ff-83e4-4767-b5f1-1cb78b39cd30 service nova] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:07:25.307230 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c31ff-83e4-4767-b5f1-1cb78b39cd30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:07:25.314958 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c31ff-83e4-4767-b5f1-1cb78b39cd30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:07:25.316563 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c31ff-83e4-4767-b5f1-1cb78b39cd30 service nova] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:07:25.326396 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 766/1525] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:07:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:07:26.585293 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc98b5-9b6a-47f4-9678-2da517af3aee None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:07:26.585859 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc98b5-9b6a-47f4-9678-2da517af3aee None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:07:26.585859 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc98b5-9b6a-47f4-9678-2da517af3aee None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:07:26.587624 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 760/1526] 127.0.0.1 () {54 vars in 901 bytes} [Thu Mar 10 04:07:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:07:26.592675 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b5ff3-4ca4-4c7c-aa58-bd2726844ce6 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:07:26.593100 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b5ff3-4ca4-4c7c-aa58-bd2726844ce6 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:07:26.593232 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b5ff3-4ca4-4c7c-aa58-bd2726844ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:07:26.610623 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-898b5ff3-4ca4-4c7c-aa58-bd2726844ce6 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:07:26.611874 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-898b5ff3-4ca4-4c7c-aa58-bd2726844ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:07:26.620005 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 767/1527] 127.0.0.1 () {58 vars in 998 bytes} [Thu Mar 10 04:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:07:26.772550 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc98b5-9b6a-47f4-9678-2da517af3aee None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:07:26.786844 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc98b5-9b6a-47f4-9678-2da517af3aee None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:07:26.792219 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dbc20-c37c-437a-a49f-54cb66f03435 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:07:26.792848 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dbc20-c37c-437a-a49f-54cb66f03435 service nova] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:07:26.793132 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dbc20-c37c-437a-a49f-54cb66f03435 service nova] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:07:26.793413 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dbc20-c37c-437a-a49f-54cb66f03435 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:07:26.801339 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dbc20-c37c-437a-a49f-54cb66f03435 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:07:26.803418 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dbc20-c37c-437a-a49f-54cb66f03435 service nova] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:07:26.812613 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 761/1528] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:07:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:07:30.987594 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e26008-19ef-47f2-a8bf-407e1fd096e7 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:07:30.988164 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e26008-19ef-47f2-a8bf-407e1fd096e7 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:07:30.988164 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e26008-19ef-47f2-a8bf-407e1fd096e7 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:07:30.990016 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 768/1529] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 10 04:07:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:07:30.995036 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520664f-9b0f-4654-b11d-8efcdc4f0c99 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:07:30.995434 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520664f-9b0f-4654-b11d-8efcdc4f0c99 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:07:30.995588 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520664f-9b0f-4654-b11d-8efcdc4f0c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:07:31.013527 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-6520664f-9b0f-4654-b11d-8efcdc4f0c99 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:07:31.014696 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-6520664f-9b0f-4654-b11d-8efcdc4f0c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:07:31.024954 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 762/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 10 04:07:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:07:31.061118 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e26008-19ef-47f2-a8bf-407e1fd096e7 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:07:31.062765 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-e6e26008-19ef-47f2-a8bf-407e1fd096e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:07:31.118746 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e26008-19ef-47f2-a8bf-407e1fd096e7 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:07:31.122283 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feefc8b3-f096-4645-ab68-39cf0d9982c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:07:31.122881 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefc8b3-f096-4645-ab68-39cf0d9982c0 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:07:31.123167 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefc8b3-f096-4645-ab68-39cf0d9982c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:07:31.123470 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefc8b3-f096-4645-ab68-39cf0d9982c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:07:31.132856 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feefc8b3-f096-4645-ab68-39cf0d9982c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:07:31.134278 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feefc8b3-f096-4645-ab68-39cf0d9982c0 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:07:31.143479 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 769/1531] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:07:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:07:33.406370 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338291f-ee07-41eb-88e4-827b5aae28e9 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:07:33.406909 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338291f-ee07-41eb-88e4-827b5aae28e9 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:07:33.406909 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338291f-ee07-41eb-88e4-827b5aae28e9 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:07:33.408782 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 763/1532] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 10 04:07:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:07:33.413799 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced70b1-de5c-45b4-80c6-f2a642e8e93a None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:07:33.414195 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced70b1-de5c-45b4-80c6-f2a642e8e93a None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:07:33.414344 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced70b1-de5c-45b4-80c6-f2a642e8e93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:07:33.432414 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-cced70b1-de5c-45b4-80c6-f2a642e8e93a None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:07:33.433583 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-cced70b1-de5c-45b4-80c6-f2a642e8e93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:07:33.441145 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 770/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 10 04:07:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:07:33.476405 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338291f-ee07-41eb-88e4-827b5aae28e9 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:07:33.487035 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338291f-ee07-41eb-88e4-827b5aae28e9 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:07:33.491060 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f68f2-ca3a-4395-a395-c79c10e17cb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:07:33.491703 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f68f2-ca3a-4395-a395-c79c10e17cb4 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:07:33.491987 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f68f2-ca3a-4395-a395-c79c10e17cb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:07:33.492262 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f68f2-ca3a-4395-a395-c79c10e17cb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:07:33.500846 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f68f2-ca3a-4395-a395-c79c10e17cb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:07:33.502261 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f68f2-ca3a-4395-a395-c79c10e17cb4 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:07:33.512224 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 764/1534] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:07:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:07:37.339545 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b83812-c724-4de9-a405-0a39a67c6195 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:07:37.340275 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b83812-c724-4de9-a405-0a39a67c6195 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:07:37.340275 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b83812-c724-4de9-a405-0a39a67c6195 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:07:37.341921 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 771/1535] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 10 04:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:07:37.347062 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba32cf-6897-406d-8329-c32cc005f523 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:07:37.347506 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba32cf-6897-406d-8329-c32cc005f523 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:07:37.347612 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba32cf-6897-406d-8329-c32cc005f523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:07:37.365562 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-8fba32cf-6897-406d-8329-c32cc005f523 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:07:37.366738 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-8fba32cf-6897-406d-8329-c32cc005f523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:07:37.374428 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 765/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 10 04:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:07:37.646562 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b83812-c724-4de9-a405-0a39a67c6195 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:07:37.648237 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-f0b83812-c724-4de9-a405-0a39a67c6195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:07:37.702809 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b83812-c724-4de9-a405-0a39a67c6195 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:07:37.706272 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba21276-7b6d-4e70-8286-34a0b41a0c84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:07:37.706900 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba21276-7b6d-4e70-8286-34a0b41a0c84 service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:07:37.707182 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba21276-7b6d-4e70-8286-34a0b41a0c84 service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:07:37.707459 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba21276-7b6d-4e70-8286-34a0b41a0c84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:07:37.715936 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba21276-7b6d-4e70-8286-34a0b41a0c84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:07:37.717363 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba21276-7b6d-4e70-8286-34a0b41a0c84 service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:07:37.726739 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 772/1537] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:07:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:07:40.029060 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f663c3-4689-4daf-9c0a-58f25f13d25e None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:07:40.029631 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f663c3-4689-4daf-9c0a-58f25f13d25e None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:07:40.029631 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f663c3-4689-4daf-9c0a-58f25f13d25e None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:07:40.031394 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 766/1538] 127.0.0.1 () {54 vars in 916 bytes} [Thu Mar 10 04:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:07:40.036446 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab991fcb-4a53-45d6-be9c-94a1a69f6281 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:07:40.036866 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab991fcb-4a53-45d6-be9c-94a1a69f6281 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:07:40.036999 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab991fcb-4a53-45d6-be9c-94a1a69f6281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:07:40.053934 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-ab991fcb-4a53-45d6-be9c-94a1a69f6281 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:07:40.055098 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-ab991fcb-4a53-45d6-be9c-94a1a69f6281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:07:40.063530 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 773/1539] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Mar 10 04:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:07:40.311437 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d8b05-863a-4f5a-907e-85a8ae615938 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:07:40.311765 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d8b05-863a-4f5a-907e-85a8ae615938 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:07:40.312061 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d8b05-863a-4f5a-907e-85a8ae615938 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:07:40.313858 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 767/1540] 10.222.0.15 () {54 vars in 963 bytes} [Thu Mar 10 04:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:07:40.319205 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01a0eb-a3ba-491d-9040-d1444bf31427 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:07:40.319793 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01a0eb-a3ba-491d-9040-d1444bf31427 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:07:40.320073 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01a0eb-a3ba-491d-9040-d1444bf31427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:07:40.337554 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-8e01a0eb-a3ba-491d-9040-d1444bf31427 None None] MFA Rules not processed for user `b6baa51b91a74ebbab55d644894acd81`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:07:40.338716 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-8e01a0eb-a3ba-491d-9040-d1444bf31427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:07:40.344932 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 774/1541] 10.222.0.15 () {58 vars in 1060 bytes} [Thu Mar 10 04:07:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:07:40.353885 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d8b05-863a-4f5a-907e-85a8ae615938 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:07:40.364624 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d8b05-863a-4f5a-907e-85a8ae615938 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:07:40.368071 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27871991-2b09-43d0-92c3-18463eac5d02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:07:40.368696 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27871991-2b09-43d0-92c3-18463eac5d02 service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:07:40.368979 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27871991-2b09-43d0-92c3-18463eac5d02 service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:07:40.369257 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27871991-2b09-43d0-92c3-18463eac5d02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:07:40.377840 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27871991-2b09-43d0-92c3-18463eac5d02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:07:40.379261 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27871991-2b09-43d0-92c3-18463eac5d02 service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:07:40.389002 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 768/1542] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:07:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:06.411166 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fddf26-95c5-4b62-812f-4c5969d9ad12 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:06.411796 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fddf26-95c5-4b62-812f-4c5969d9ad12 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:06.411796 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fddf26-95c5-4b62-812f-4c5969d9ad12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:06.440272 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-c8fddf26-95c5-4b62-812f-4c5969d9ad12 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:06.441487 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-c8fddf26-95c5-4b62-812f-4c5969d9ad12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:06.454859 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 775/1543] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:06.464284 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474cab2-d128-47d1-bd66-8e955e74cdb5 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:06.465274 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474cab2-d128-47d1-bd66-8e955e74cdb5 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:06.465757 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474cab2-d128-47d1-bd66-8e955e74cdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:06.501590 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-2474cab2-d128-47d1-bd66-8e955e74cdb5 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:06.502914 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-2474cab2-d128-47d1-bd66-8e955e74cdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:06.511802 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 769/1544] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:06.516909 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fddf26-95c5-4b62-812f-4c5969d9ad12 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:06.530947 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d1600-8a9f-4b18-845a-5f842f2da2e6 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:06.531313 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d1600-8a9f-4b18-845a-5f842f2da2e6 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:06.531581 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d1600-8a9f-4b18-845a-5f842f2da2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:06.534349 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fddf26-95c5-4b62-812f-4c5969d9ad12 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:06.539187 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e12403-ef3d-4d8f-b7a0-c2cac2763adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:06.544156 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e12403-ef3d-4d8f-b7a0-c2cac2763adf admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:06.544481 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e12403-ef3d-4d8f-b7a0-c2cac2763adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:06.544763 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e12403-ef3d-4d8f-b7a0-c2cac2763adf admin admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:06.545536 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e12403-ef3d-4d8f-b7a0-c2cac2763adf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:09:06.545844 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e12403-ef3d-4d8f-b7a0-c2cac2763adf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:06.547490 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e12403-ef3d-4d8f-b7a0-c2cac2763adf admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:06.565371 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-d09d1600-8a9f-4b18-845a-5f842f2da2e6 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:06.566606 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-d09d1600-8a9f-4b18-845a-5f842f2da2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:06.574602 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 776/1545] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:09:06.581884 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 770/1546] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:06.582891 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e12403-ef3d-4d8f-b7a0-c2cac2763adf admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:06.592740 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a972df-a50e-4813-936c-3cc214575422 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:06.593076 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a972df-a50e-4813-936c-3cc214575422 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:06.593829 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a972df-a50e-4813-936c-3cc214575422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:06.598278 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e12403-ef3d-4d8f-b7a0-c2cac2763adf admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:06.603164 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f507c-547d-4e2c-85a3-345930b89d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:06.603848 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f507c-547d-4e2c-85a3-345930b89d25 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:06.604134 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f507c-547d-4e2c-85a3-345930b89d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:06.604410 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f507c-547d-4e2c-85a3-345930b89d25 admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:06.605114 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f507c-547d-4e2c-85a3-345930b89d25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:06.606131 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING py.warnings [None req-7b0f507c-547d-4e2c-85a3-345930b89d25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 10 04:09:06.606131 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: warnings.warn(msg) Mar 10 04:09:06.606131 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: Mar 10 04:09:06.607316 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f507c-547d-4e2c-85a3-345930b89d25 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:06.620863 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-86a972df-a50e-4813-936c-3cc214575422 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:06.622119 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-86a972df-a50e-4813-936c-3cc214575422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:06.642226 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 771/1547] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:06.648148 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a972df-a50e-4813-936c-3cc214575422 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:06.664751 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a972df-a50e-4813-936c-3cc214575422 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:06.668095 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 777/1548] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:09:06 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:09:06.672413 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f507c-547d-4e2c-85a3-345930b89d25 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:06.674439 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7882e-bfca-49da-b172-7a7222769691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:06.675124 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7882e-bfca-49da-b172-7a7222769691 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:06.675410 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7882e-bfca-49da-b172-7a7222769691 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:06.675707 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7882e-bfca-49da-b172-7a7222769691 admin admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:06.676445 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7882e-bfca-49da-b172-7a7222769691 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:09:06.676752 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7882e-bfca-49da-b172-7a7222769691 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:06.678370 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING py.warnings [None req-16e7882e-bfca-49da-b172-7a7222769691 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 10 04:09:06.678370 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: warnings.warn(msg) Mar 10 04:09:06.678370 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: Mar 10 04:09:06.679475 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7882e-bfca-49da-b172-7a7222769691 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:06.697747 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 772/1549] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 04:09:06.706665 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd79d7-ba50-443e-8fcf-eee1cfd15d2e None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:06.706991 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd79d7-ba50-443e-8fcf-eee1cfd15d2e None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:06.707238 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd79d7-ba50-443e-8fcf-eee1cfd15d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:06.740740 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-78fd79d7-ba50-443e-8fcf-eee1cfd15d2e None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:06.741963 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-78fd79d7-ba50-443e-8fcf-eee1cfd15d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:06.788178 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f507c-547d-4e2c-85a3-345930b89d25 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:06.802547 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd247f8d-dfe3-49a1-a27a-af47be87ec38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:06.803797 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd247f8d-dfe3-49a1-a27a-af47be87ec38 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:06.804082 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd247f8d-dfe3-49a1-a27a-af47be87ec38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:06.804356 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd247f8d-dfe3-49a1-a27a-af47be87ec38 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:06.805054 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd247f8d-dfe3-49a1-a27a-af47be87ec38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:06.806980 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd247f8d-dfe3-49a1-a27a-af47be87ec38 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:06.820767 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 773/1550] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:09:06.821333 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd79d7-ba50-443e-8fcf-eee1cfd15d2e None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:06.839201 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd79d7-ba50-443e-8fcf-eee1cfd15d2e None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:06.857183 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 778/1551] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:09:06 2022] POST /identity/v3/users => generated 286 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:09:06.858351 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25597874-f478-419b-a1ce-f182419c247e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:06.859033 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25597874-f478-419b-a1ce-f182419c247e admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:06.859316 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25597874-f478-419b-a1ce-f182419c247e admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:06.859593 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25597874-f478-419b-a1ce-f182419c247e admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:06.860616 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc06603-e0a9-4e72-96c0-486da2d80164 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:06.860894 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc06603-e0a9-4e72-96c0-486da2d80164 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:06.861214 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc06603-e0a9-4e72-96c0-486da2d80164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:06.861828 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25597874-f478-419b-a1ce-f182419c247e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:06.864016 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25597874-f478-419b-a1ce-f182419c247e admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:06.886023 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-5fc06603-e0a9-4e72-96c0-486da2d80164 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:06.887548 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-5fc06603-e0a9-4e72-96c0-486da2d80164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:06.898205 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 774/1552] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:09:06 2022] POST /identity/v3/projects => generated 393 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:06.898823 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 779/1553] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:06.899536 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78160c25-aa44-4fd3-9e59-e94f086fd17d None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:06.899866 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78160c25-aa44-4fd3-9e59-e94f086fd17d None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:06.900147 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78160c25-aa44-4fd3-9e59-e94f086fd17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:06.900268 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c8f97-4bb0-4f85-be3f-a8f5dfd4a1de None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:06.904027 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c8f97-4bb0-4f85-be3f-a8f5dfd4a1de None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:06.904315 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c8f97-4bb0-4f85-be3f-a8f5dfd4a1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:06.923514 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-78160c25-aa44-4fd3-9e59-e94f086fd17d None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:06.924812 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-78160c25-aa44-4fd3-9e59-e94f086fd17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:06.941878 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-3d7c8f97-4bb0-4f85-be3f-a8f5dfd4a1de None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:06.944306 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-3d7c8f97-4bb0-4f85-be3f-a8f5dfd4a1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:06.999724 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 775/1554] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:06.999724 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78160c25-aa44-4fd3-9e59-e94f086fd17d None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:07.010673 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78160c25-aa44-4fd3-9e59-e94f086fd17d None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:07.015320 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec26d6-a785-4496-a6a0-83fd1fc5d849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:07.016008 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec26d6-a785-4496-a6a0-83fd1fc5d849 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.016293 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec26d6-a785-4496-a6a0-83fd1fc5d849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.016569 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec26d6-a785-4496-a6a0-83fd1fc5d849 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.017813 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec26d6-a785-4496-a6a0-83fd1fc5d849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:07.019405 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec26d6-a785-4496-a6a0-83fd1fc5d849 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:07.021578 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 780/1555] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:07.022870 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767ba51-00e9-4a12-8a36-ef85df910a62 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.023156 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767ba51-00e9-4a12-8a36-ef85df910a62 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.023429 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767ba51-00e9-4a12-8a36-ef85df910a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.035883 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 776/1556] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:07.035883 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec26d6-a785-4496-a6a0-83fd1fc5d849 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:07.043236 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-8767ba51-00e9-4a12-8a36-ef85df910a62 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:07.044475 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-8767ba51-00e9-4a12-8a36-ef85df910a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:07.045125 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec26d6-a785-4496-a6a0-83fd1fc5d849 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:07.050032 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff611e-b87b-48a4-af92-b02d9762665c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:07.050646 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff611e-b87b-48a4-af92-b02d9762665c admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.053747 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 781/1557] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:07.053887 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff611e-b87b-48a4-af92-b02d9762665c admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.056972 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff611e-b87b-48a4-af92-b02d9762665c admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.058101 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff611e-b87b-48a4-af92-b02d9762665c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:07.059648 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING py.warnings [None req-f7ff611e-b87b-48a4-af92-b02d9762665c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 10 04:09:07.059648 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: warnings.warn(msg) Mar 10 04:09:07.059648 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: Mar 10 04:09:07.060450 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b49bfd-c645-43a2-91e2-b1fd74c79509 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.060738 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b49bfd-c645-43a2-91e2-b1fd74c79509 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.060907 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff611e-b87b-48a4-af92-b02d9762665c admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:07.061014 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b49bfd-c645-43a2-91e2-b1fd74c79509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.083057 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-05b49bfd-c645-43a2-91e2-b1fd74c79509 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:07.084124 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 777/1558] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:09:07 2022] POST /identity/v3/users => generated 297 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:07.084287 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-05b49bfd-c645-43a2-91e2-b1fd74c79509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:07.086066 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24bb09-6593-452e-8a76-07082a2d5a0b None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.086474 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24bb09-6593-452e-8a76-07082a2d5a0b None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.086778 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24bb09-6593-452e-8a76-07082a2d5a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.092256 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 782/1559] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:07.093468 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d240d-4964-48c0-83c2-5de3e9f02bc7 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.093751 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d240d-4964-48c0-83c2-5de3e9f02bc7 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.094024 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d240d-4964-48c0-83c2-5de3e9f02bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.108051 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-ed24bb09-6593-452e-8a76-07082a2d5a0b None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:07.109243 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-ed24bb09-6593-452e-8a76-07082a2d5a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:07.111793 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-037d240d-4964-48c0-83c2-5de3e9f02bc7 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:07.112936 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-037d240d-4964-48c0-83c2-5de3e9f02bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:07.119660 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 778/1560] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:07.120775 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24bb09-6593-452e-8a76-07082a2d5a0b None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:07.124927 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 783/1561] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:07.124927 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d240d-4964-48c0-83c2-5de3e9f02bc7 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:07.131561 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24bb09-6593-452e-8a76-07082a2d5a0b None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:07.133966 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d240d-4964-48c0-83c2-5de3e9f02bc7 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:07.136203 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3eb972-ef8f-4317-9b49-a2a7b3aed99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:07.136855 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3eb972-ef8f-4317-9b49-a2a7b3aed99b admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.137140 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3eb972-ef8f-4317-9b49-a2a7b3aed99b admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.137422 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3eb972-ef8f-4317-9b49-a2a7b3aed99b admin admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.138142 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3eb972-ef8f-4317-9b49-a2a7b3aed99b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:09:07.138446 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3eb972-ef8f-4317-9b49-a2a7b3aed99b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:07.138565 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851ea5c-befa-451d-94dc-4cfc67c38c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:07.139136 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851ea5c-befa-451d-94dc-4cfc67c38c5e admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.139414 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851ea5c-befa-451d-94dc-4cfc67c38c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.139717 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851ea5c-befa-451d-94dc-4cfc67c38c5e admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.140085 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3eb972-ef8f-4317-9b49-a2a7b3aed99b admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:07.140447 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1851ea5c-befa-451d-94dc-4cfc67c38c5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:07.142164 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1851ea5c-befa-451d-94dc-4cfc67c38c5e admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:07.152310 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 784/1562] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:07.152734 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 779/1563] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:09:07.153499 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7daca-075e-485e-9250-912cb3e84260 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.153783 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7daca-075e-485e-9250-912cb3e84260 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.153896 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381ab49-eb19-415e-871e-0c6c04f0ffaa None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.154060 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7daca-075e-485e-9250-912cb3e84260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.154166 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381ab49-eb19-415e-871e-0c6c04f0ffaa None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.154443 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381ab49-eb19-415e-871e-0c6c04f0ffaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.170961 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-c2b7daca-075e-485e-9250-912cb3e84260 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:07.172165 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-c2b7daca-075e-485e-9250-912cb3e84260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:07.178549 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-9381ab49-eb19-415e-871e-0c6c04f0ffaa None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:07.179880 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 785/1564] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:07.180251 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-9381ab49-eb19-415e-871e-0c6c04f0ffaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:07.180499 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7daca-075e-485e-9250-912cb3e84260 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:07.189821 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 780/1565] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:07.189987 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7daca-075e-485e-9250-912cb3e84260 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:07.190614 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381ab49-eb19-415e-871e-0c6c04f0ffaa None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:07.195213 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33754284-9ee5-471f-8d3b-1129ae937119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:07.195890 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33754284-9ee5-471f-8d3b-1129ae937119 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.196170 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33754284-9ee5-471f-8d3b-1129ae937119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.196439 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33754284-9ee5-471f-8d3b-1129ae937119 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.197158 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33754284-9ee5-471f-8d3b-1129ae937119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:07.198759 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33754284-9ee5-471f-8d3b-1129ae937119 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:07.200987 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381ab49-eb19-415e-871e-0c6c04f0ffaa None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:07.206043 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb049d05-7c4a-49f5-9a86-6201954fde26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:07.206682 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb049d05-7c4a-49f5-9a86-6201954fde26 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.206963 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb049d05-7c4a-49f5-9a86-6201954fde26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.207238 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb049d05-7c4a-49f5-9a86-6201954fde26 admin admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.207990 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb049d05-7c4a-49f5-9a86-6201954fde26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:09:07.208295 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb049d05-7c4a-49f5-9a86-6201954fde26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:07.209129 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 786/1566] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:07.209871 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb049d05-7c4a-49f5-9a86-6201954fde26 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:07.209984 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33754284-9ee5-471f-8d3b-1129ae937119 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:07.220630 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33754284-9ee5-471f-8d3b-1129ae937119 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:07.227808 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 781/1567] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:09:07.227808 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e641e-c389-4d42-b284-7a41180ab681 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.227808 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e641e-c389-4d42-b284-7a41180ab681 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.227808 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e641e-c389-4d42-b284-7a41180ab681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.231499 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403efc7-54d7-4cad-88f7-43cc60de6f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:07.232167 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403efc7-54d7-4cad-88f7-43cc60de6f93 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.232450 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403efc7-54d7-4cad-88f7-43cc60de6f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.232725 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403efc7-54d7-4cad-88f7-43cc60de6f93 admin admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.233430 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403efc7-54d7-4cad-88f7-43cc60de6f93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:09:07.233731 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403efc7-54d7-4cad-88f7-43cc60de6f93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:07.235331 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403efc7-54d7-4cad-88f7-43cc60de6f93 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:07.244169 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-bb4e641e-c389-4d42-b284-7a41180ab681 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:07.245410 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-bb4e641e-c389-4d42-b284-7a41180ab681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:07.246829 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 787/1568] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:09:07.248430 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403efc7-54d7-4cad-88f7-43cc60de6f93 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:07.256931 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 782/1569] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:07.256931 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e641e-c389-4d42-b284-7a41180ab681 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:07.261064 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403efc7-54d7-4cad-88f7-43cc60de6f93 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:07.263806 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e641e-c389-4d42-b284-7a41180ab681 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:07.265586 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb4460-c76a-48b5-9c81-df9173f4a94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:07.266271 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb4460-c76a-48b5-9c81-df9173f4a94b admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.266553 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb4460-c76a-48b5-9c81-df9173f4a94b admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.266874 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb4460-c76a-48b5-9c81-df9173f4a94b admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.268142 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb4460-c76a-48b5-9c81-df9173f4a94b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:07.268902 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c537b-f768-45a2-8e49-36234bc07bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:07.269744 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c537b-f768-45a2-8e49-36234bc07bc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.270018 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb4460-c76a-48b5-9c81-df9173f4a94b admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:07.270113 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c537b-f768-45a2-8e49-36234bc07bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.270288 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c537b-f768-45a2-8e49-36234bc07bc9 admin admin] PATH_INFO: `/v3/projects/41f196a6d1a94fd6909466025650e596/users/ea310fa8f701448da87eca14f0c66be1/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.284314 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5c537b-f768-45a2-8e49-36234bc07bc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41f196a6d1a94fd6909466025650e596, user_id=ea310fa8f701448da87eca14f0c66be1, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:07.286989 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5c537b-f768-45a2-8e49-36234bc07bc9 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:07.298006 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 788/1570] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:09:07 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:07.298006 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3b722-c1c6-4238-ac85-ea1fde11ba78 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.298006 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3b722-c1c6-4238-ac85-ea1fde11ba78 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.298006 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3b722-c1c6-4238-ac85-ea1fde11ba78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.300611 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 783/1571] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:07 2022] PUT /identity/v3/projects/41f196a6d1a94fd6909466025650e596/users/ea310fa8f701448da87eca14f0c66be1/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:07.308596 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c537b-f768-45a2-8e49-36234bc07bc9 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:07.315198 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-18b3b722-c1c6-4238-ac85-ea1fde11ba78 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:07.316418 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-18b3b722-c1c6-4238-ac85-ea1fde11ba78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:07.367032 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c537b-f768-45a2-8e49-36234bc07bc9 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:07.371443 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84529b-6099-4c20-b53e-9a61d5f617b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:07.371619 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 789/1572] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:07.372140 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84529b-6099-4c20-b53e-9a61d5f617b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.372321 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3b722-c1c6-4238-ac85-ea1fde11ba78 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:07.372513 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84529b-6099-4c20-b53e-9a61d5f617b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.372788 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84529b-6099-4c20-b53e-9a61d5f617b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.373552 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84529b-6099-4c20-b53e-9a61d5f617b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:09:07.373863 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84529b-6099-4c20-b53e-9a61d5f617b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:07.375577 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84529b-6099-4c20-b53e-9a61d5f617b9 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:07.381712 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3b722-c1c6-4238-ac85-ea1fde11ba78 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:07.386491 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adfad6a-e384-4559-9ece-6ca6ac885374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:07.387136 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfad6a-e384-4559-9ece-6ca6ac885374 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.387370 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 784/1573] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:09:07.395129 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfad6a-e384-4559-9ece-6ca6ac885374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.395129 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfad6a-e384-4559-9ece-6ca6ac885374 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.395320 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84529b-6099-4c20-b53e-9a61d5f617b9 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:07.395416 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adfad6a-e384-4559-9ece-6ca6ac885374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:07.395416 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adfad6a-e384-4559-9ece-6ca6ac885374 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:07.403842 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 790/1574] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:07.403842 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adfad6a-e384-4559-9ece-6ca6ac885374 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:07.405253 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84529b-6099-4c20-b53e-9a61d5f617b9 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:07.409733 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947aa0fa-27f1-4dac-8d5d-6d8b6e4841d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:07.410375 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947aa0fa-27f1-4dac-8d5d-6d8b6e4841d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.410658 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947aa0fa-27f1-4dac-8d5d-6d8b6e4841d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.410812 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adfad6a-e384-4559-9ece-6ca6ac885374 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:07.410918 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947aa0fa-27f1-4dac-8d5d-6d8b6e4841d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.411603 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947aa0fa-27f1-4dac-8d5d-6d8b6e4841d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:07.413553 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947aa0fa-27f1-4dac-8d5d-6d8b6e4841d5 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:07.415335 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e477eba-4aee-4053-8ad6-912664a8a114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:07.415987 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e477eba-4aee-4053-8ad6-912664a8a114 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.416269 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e477eba-4aee-4053-8ad6-912664a8a114 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.416546 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e477eba-4aee-4053-8ad6-912664a8a114 admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.417216 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e477eba-4aee-4053-8ad6-912664a8a114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:07.419071 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e477eba-4aee-4053-8ad6-912664a8a114 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:07.442403 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 785/1575] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:09:07 2022] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:07.443116 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947aa0fa-27f1-4dac-8d5d-6d8b6e4841d5 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:07.447978 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 791/1576] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:09:07 2022] POST /identity/v3/projects => generated 401 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:07.447978 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e477eba-4aee-4053-8ad6-912664a8a114 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:07.505323 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e477eba-4aee-4053-8ad6-912664a8a114 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:07.505580 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947aa0fa-27f1-4dac-8d5d-6d8b6e4841d5 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:07.509968 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f402d-8592-47ca-863a-6c19cbd4ae22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:07.510103 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35faabaf-75ba-4812-95f2-3ab678a1eed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:07.510636 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f402d-8592-47ca-863a-6c19cbd4ae22 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.510766 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35faabaf-75ba-4812-95f2-3ab678a1eed9 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.510915 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35faabaf-75ba-4812-95f2-3ab678a1eed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.511058 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f402d-8592-47ca-863a-6c19cbd4ae22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.511218 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35faabaf-75ba-4812-95f2-3ab678a1eed9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.511326 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f402d-8592-47ca-863a-6c19cbd4ae22 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.511929 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35faabaf-75ba-4812-95f2-3ab678a1eed9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:09:07.512046 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f402d-8592-47ca-863a-6c19cbd4ae22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:07.512235 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35faabaf-75ba-4812-95f2-3ab678a1eed9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:07.513794 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35faabaf-75ba-4812-95f2-3ab678a1eed9 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:07.513918 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f402d-8592-47ca-863a-6c19cbd4ae22 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:07.525546 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 786/1577] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:09:07.526790 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113193b9-7ed0-4d67-9006-79fc8f7637e8 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.527076 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113193b9-7ed0-4d67-9006-79fc8f7637e8 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.527394 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113193b9-7ed0-4d67-9006-79fc8f7637e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.543754 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 792/1578] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:09:07 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:07.543754 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f402d-8592-47ca-863a-6c19cbd4ae22 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:07.551045 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f402d-8592-47ca-863a-6c19cbd4ae22 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:07.555536 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173731a-29b0-4cde-84e6-0af70c36b061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:07.556208 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173731a-29b0-4cde-84e6-0af70c36b061 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.556490 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173731a-29b0-4cde-84e6-0af70c36b061 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.556769 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173731a-29b0-4cde-84e6-0af70c36b061 admin admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.557511 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173731a-29b0-4cde-84e6-0af70c36b061 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:09:07.557816 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173731a-29b0-4cde-84e6-0af70c36b061 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:07.558053 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-113193b9-7ed0-4d67-9006-79fc8f7637e8 None None] MFA Rules not processed for user `ea310fa8f701448da87eca14f0c66be1`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:07.559227 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-113193b9-7ed0-4d67-9006-79fc8f7637e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:07.559396 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173731a-29b0-4cde-84e6-0af70c36b061 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:07.571865 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 793/1579] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:09:07.579322 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173731a-29b0-4cde-84e6-0af70c36b061 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:07.584144 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173731a-29b0-4cde-84e6-0af70c36b061 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:07.588896 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32bce1-6d49-4b6b-a00d-dbac49d8d3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:07.589525 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32bce1-6d49-4b6b-a00d-dbac49d8d3d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.589907 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32bce1-6d49-4b6b-a00d-dbac49d8d3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.590074 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32bce1-6d49-4b6b-a00d-dbac49d8d3d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.590752 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32bce1-6d49-4b6b-a00d-dbac49d8d3d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:07.592687 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32bce1-6d49-4b6b-a00d-dbac49d8d3d3 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:07.618250 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 794/1580] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:09:07 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:07.619286 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32bce1-6d49-4b6b-a00d-dbac49d8d3d3 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:07.624253 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 787/1581] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:07.625051 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113193b9-7ed0-4d67-9006-79fc8f7637e8 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:07.635297 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113193b9-7ed0-4d67-9006-79fc8f7637e8 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:07.677783 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32bce1-6d49-4b6b-a00d-dbac49d8d3d3 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:07.682421 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73763ac4-aa4e-4cc5-b18e-8c764b5f1ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:07.683331 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73763ac4-aa4e-4cc5-b18e-8c764b5f1ac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.683639 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73763ac4-aa4e-4cc5-b18e-8c764b5f1ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.683941 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73763ac4-aa4e-4cc5-b18e-8c764b5f1ac4 admin admin] PATH_INFO: `/v3/projects/c83ea9d1851f48939afa94258e6af2fc/users/b96ee0c3a9e44e14bf62619829b0acd9/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.687229 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4f08b-d873-46b3-9c99-b0bf0b80103d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:07.687916 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4f08b-d873-46b3-9c99-b0bf0b80103d admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.688200 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4f08b-d873-46b3-9c99-b0bf0b80103d admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.688474 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4f08b-d873-46b3-9c99-b0bf0b80103d admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.689730 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e4f08b-d873-46b3-9c99-b0bf0b80103d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:07.691643 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e4f08b-d873-46b3-9c99-b0bf0b80103d admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:07.698513 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73763ac4-aa4e-4cc5-b18e-8c764b5f1ac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c83ea9d1851f48939afa94258e6af2fc, user_id=b96ee0c3a9e44e14bf62619829b0acd9, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:07.699457 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING py.warnings [None req-73763ac4-aa4e-4cc5-b18e-8c764b5f1ac4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 10 04:09:07.699457 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: warnings.warn(msg) Mar 10 04:09:07.699457 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: Mar 10 04:09:07.701425 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73763ac4-aa4e-4cc5-b18e-8c764b5f1ac4 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:07.712152 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 788/1582] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:09:07 2022] POST /identity/v3/users => generated 301 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:07.713152 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4f08b-d873-46b3-9c99-b0bf0b80103d admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:07.714452 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 795/1583] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:07 2022] PUT /identity/v3/projects/c83ea9d1851f48939afa94258e6af2fc/users/b96ee0c3a9e44e14bf62619829b0acd9/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:07.715278 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73763ac4-aa4e-4cc5-b18e-8c764b5f1ac4 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:07.723122 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4f08b-d873-46b3-9c99-b0bf0b80103d admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:07.774559 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73763ac4-aa4e-4cc5-b18e-8c764b5f1ac4 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:07.776054 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17541d-8319-4a22-9548-119d454a7672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:07.776713 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17541d-8319-4a22-9548-119d454a7672 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.776991 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17541d-8319-4a22-9548-119d454a7672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.777265 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17541d-8319-4a22-9548-119d454a7672 admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.777937 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17541d-8319-4a22-9548-119d454a7672 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:07.779036 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd18010-d51c-47ae-8d23-ae3547ba6c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:07.779697 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd18010-d51c-47ae-8d23-ae3547ba6c24 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.779864 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17541d-8319-4a22-9548-119d454a7672 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:07.779979 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd18010-d51c-47ae-8d23-ae3547ba6c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.780251 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd18010-d51c-47ae-8d23-ae3547ba6c24 admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.780927 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd18010-d51c-47ae-8d23-ae3547ba6c24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:07.782806 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd18010-d51c-47ae-8d23-ae3547ba6c24 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:07.800192 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 789/1584] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:09:07 2022] POST /identity/v3/users => generated 295 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:07.801203 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17541d-8319-4a22-9548-119d454a7672 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:07.811209 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 796/1585] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:09:07 2022] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:07.811209 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd18010-d51c-47ae-8d23-ae3547ba6c24 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:07.811633 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17541d-8319-4a22-9548-119d454a7672 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:07.864813 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdf40c-0100-4183-be7c-9bfc13e6c51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:07.865476 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdf40c-0100-4183-be7c-9bfc13e6c51f admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.865790 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdf40c-0100-4183-be7c-9bfc13e6c51f admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.866181 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdf40c-0100-4183-be7c-9bfc13e6c51f admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.866889 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd18010-d51c-47ae-8d23-ae3547ba6c24 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:07.867003 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbdf40c-0100-4183-be7c-9bfc13e6c51f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:07.868540 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbdf40c-0100-4183-be7c-9bfc13e6c51f admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:07.871386 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1ac03-bfa2-4218-a0d9-c39efbff1e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:07.872054 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1ac03-bfa2-4218-a0d9-c39efbff1e96 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.872336 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1ac03-bfa2-4218-a0d9-c39efbff1e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.872607 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1ac03-bfa2-4218-a0d9-c39efbff1e96 admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.873282 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1ac03-bfa2-4218-a0d9-c39efbff1e96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:07.875137 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1ac03-bfa2-4218-a0d9-c39efbff1e96 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:07.878804 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 790/1586] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:07.879608 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdf40c-0100-4183-be7c-9bfc13e6c51f admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:07.889013 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdf40c-0100-4183-be7c-9bfc13e6c51f admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:07.893694 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c082c24-5dc9-47b4-bf57-6cc38e6d3a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:07.894397 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c082c24-5dc9-47b4-bf57-6cc38e6d3a1d admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.894709 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c082c24-5dc9-47b4-bf57-6cc38e6d3a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.894988 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c082c24-5dc9-47b4-bf57-6cc38e6d3a1d admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.895660 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c082c24-5dc9-47b4-bf57-6cc38e6d3a1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:07.897604 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c082c24-5dc9-47b4-bf57-6cc38e6d3a1d admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:07.899938 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 797/1587] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:09:07 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:07.900696 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1ac03-bfa2-4218-a0d9-c39efbff1e96 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:07.917548 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 791/1588] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:09:07 2022] POST /identity/v3/users => generated 292 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:07.918511 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c082c24-5dc9-47b4-bf57-6cc38e6d3a1d admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:07.928201 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c082c24-5dc9-47b4-bf57-6cc38e6d3a1d admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:07.962218 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1ac03-bfa2-4218-a0d9-c39efbff1e96 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:07.966582 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834dcd9e-27af-41e3-ba56-eb1093f3e41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:07.967232 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834dcd9e-27af-41e3-ba56-eb1093f3e41a admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.967512 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834dcd9e-27af-41e3-ba56-eb1093f3e41a admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.967813 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834dcd9e-27af-41e3-ba56-eb1093f3e41a admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.968491 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834dcd9e-27af-41e3-ba56-eb1093f3e41a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:07.970851 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834dcd9e-27af-41e3-ba56-eb1093f3e41a admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:07.981115 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a534d78-441c-4996-83a9-99c914c6c138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:07.981771 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a534d78-441c-4996-83a9-99c914c6c138 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:07.982050 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a534d78-441c-4996-83a9-99c914c6c138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:07.982325 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a534d78-441c-4996-83a9-99c914c6c138 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:07.983045 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a534d78-441c-4996-83a9-99c914c6c138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:07.984658 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a534d78-441c-4996-83a9-99c914c6c138 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:07.995515 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 792/1589] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:07.996306 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 798/1590] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:09:07 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:07.999554 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834dcd9e-27af-41e3-ba56-eb1093f3e41a admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:08.000058 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f394b0b-21bd-4b3b-a34a-f5feb63d4c8b None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:08.000345 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f394b0b-21bd-4b3b-a34a-f5feb63d4c8b None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:08.000620 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f394b0b-21bd-4b3b-a34a-f5feb63d4c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:08.017777 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-6f394b0b-21bd-4b3b-a34a-f5feb63d4c8b None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:08.018999 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-6f394b0b-21bd-4b3b-a34a-f5feb63d4c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:08.057701 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834dcd9e-27af-41e3-ba56-eb1093f3e41a admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:08.062441 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84581b6d-e122-4f90-9972-b2789450b8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:08.063093 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84581b6d-e122-4f90-9972-b2789450b8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:08.063374 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84581b6d-e122-4f90-9972-b2789450b8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:08.063728 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84581b6d-e122-4f90-9972-b2789450b8a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:08.064498 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84581b6d-e122-4f90-9972-b2789450b8a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:08.066072 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84581b6d-e122-4f90-9972-b2789450b8a6 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:08.075429 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 793/1591] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:08.076507 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f394b0b-21bd-4b3b-a34a-f5feb63d4c8b None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:08.079403 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 799/1592] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:08.080255 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84581b6d-e122-4f90-9972-b2789450b8a6 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:08.087507 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f394b0b-21bd-4b3b-a34a-f5feb63d4c8b None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:08.089348 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84581b6d-e122-4f90-9972-b2789450b8a6 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:08.092112 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d844613-0106-4ad4-94ca-7ad7d1990a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:08.092769 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d844613-0106-4ad4-94ca-7ad7d1990a66 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:08.093054 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d844613-0106-4ad4-94ca-7ad7d1990a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:08.093337 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d844613-0106-4ad4-94ca-7ad7d1990a66 admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:08.094026 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d844613-0106-4ad4-94ca-7ad7d1990a66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:08.094161 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d04ebf-46c3-4fef-9ee8-1a4cae27e6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:08.094656 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d04ebf-46c3-4fef-9ee8-1a4cae27e6ca admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:08.094933 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d04ebf-46c3-4fef-9ee8-1a4cae27e6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:08.095203 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d04ebf-46c3-4fef-9ee8-1a4cae27e6ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:08.096439 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d04ebf-46c3-4fef-9ee8-1a4cae27e6ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:08.096556 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d844613-0106-4ad4-94ca-7ad7d1990a66 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:08.097986 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d04ebf-46c3-4fef-9ee8-1a4cae27e6ca admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:08.108497 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 800/1593] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:08.112712 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d04ebf-46c3-4fef-9ee8-1a4cae27e6ca admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:08.118653 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 794/1594] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:09:08 2022] POST /identity/v3/users => generated 290 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:08.118653 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d844613-0106-4ad4-94ca-7ad7d1990a66 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:08.123268 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d04ebf-46c3-4fef-9ee8-1a4cae27e6ca admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:08.125799 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d844613-0106-4ad4-94ca-7ad7d1990a66 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:08.127818 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728bbec-5dde-4e32-86de-5e51d6a7274a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:08.128585 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728bbec-5dde-4e32-86de-5e51d6a7274a admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:08.128867 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728bbec-5dde-4e32-86de-5e51d6a7274a admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:08.129141 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728bbec-5dde-4e32-86de-5e51d6a7274a admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:08.129828 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0728bbec-5dde-4e32-86de-5e51d6a7274a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:08.130596 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ec47f-1f03-4022-81e9-f9fce15b2467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:08.131248 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ec47f-1f03-4022-81e9-f9fce15b2467 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:08.131583 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ec47f-1f03-4022-81e9-f9fce15b2467 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:08.131775 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0728bbec-5dde-4e32-86de-5e51d6a7274a admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:08.131893 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ec47f-1f03-4022-81e9-f9fce15b2467 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:08.132615 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ec47f-1f03-4022-81e9-f9fce15b2467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:08.134198 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ec47f-1f03-4022-81e9-f9fce15b2467 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:08.145073 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 795/1595] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:08.146029 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ec47f-1f03-4022-81e9-f9fce15b2467 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:08.150955 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 801/1596] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:09:08 2022] POST /identity/v3/users => generated 287 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:08.151894 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728bbec-5dde-4e32-86de-5e51d6a7274a admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:08.156076 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ec47f-1f03-4022-81e9-f9fce15b2467 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:08.161248 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822862c-0547-473f-8b50-c2f5b7c30911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:08.161892 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822862c-0547-473f-8b50-c2f5b7c30911 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:08.162177 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822862c-0547-473f-8b50-c2f5b7c30911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:08.162456 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822862c-0547-473f-8b50-c2f5b7c30911 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:08.162579 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728bbec-5dde-4e32-86de-5e51d6a7274a admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:08.163169 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822862c-0547-473f-8b50-c2f5b7c30911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:08.164845 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822862c-0547-473f-8b50-c2f5b7c30911 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:08.167222 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477f383-62f4-490d-9673-d7ffb43f2e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:08.167886 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477f383-62f4-490d-9673-d7ffb43f2e02 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:08.168170 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477f383-62f4-490d-9673-d7ffb43f2e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:08.168443 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477f383-62f4-490d-9673-d7ffb43f2e02 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:08.169113 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477f383-62f4-490d-9673-d7ffb43f2e02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:08.170983 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477f383-62f4-490d-9673-d7ffb43f2e02 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:08.175442 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 796/1597] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:08.176245 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822862c-0547-473f-8b50-c2f5b7c30911 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:08.185450 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822862c-0547-473f-8b50-c2f5b7c30911 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:08.190539 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f5e2d-6def-464e-839e-0faa1e167e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:08.191170 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f5e2d-6def-464e-839e-0faa1e167e17 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:08.191450 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f5e2d-6def-464e-839e-0faa1e167e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:08.194743 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 802/1598] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:09:08 2022] POST /identity/v3/users => generated 293 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:08.194878 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f5e2d-6def-464e-839e-0faa1e167e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:08.194973 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477f383-62f4-490d-9673-d7ffb43f2e02 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:08.195083 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f5e2d-6def-464e-839e-0faa1e167e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:08.195083 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f5e2d-6def-464e-839e-0faa1e167e17 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:08.207473 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 797/1599] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:08.207473 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f5e2d-6def-464e-839e-0faa1e167e17 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:08.215147 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f5e2d-6def-464e-839e-0faa1e167e17 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:08.219665 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00390d1-eda4-4bfd-ab4e-0b25f2f226e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:08.221083 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00390d1-eda4-4bfd-ab4e-0b25f2f226e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:08.221359 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00390d1-eda4-4bfd-ab4e-0b25f2f226e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:08.221629 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00390d1-eda4-4bfd-ab4e-0b25f2f226e7 admin admin] PATH_INFO: `/v3/projects/3e97d1f0909345a18e41a584770c8642/users/9b9d4fe6e0014449aeaf33ce321be4e5/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:08.235121 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00390d1-eda4-4bfd-ab4e-0b25f2f226e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e97d1f0909345a18e41a584770c8642, user_id=9b9d4fe6e0014449aeaf33ce321be4e5, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:08.238342 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00390d1-eda4-4bfd-ab4e-0b25f2f226e7 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:08.245380 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477f383-62f4-490d-9673-d7ffb43f2e02 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:08.251008 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 798/1600] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:08 2022] PUT /identity/v3/projects/3e97d1f0909345a18e41a584770c8642/users/9b9d4fe6e0014449aeaf33ce321be4e5/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:08.251896 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00390d1-eda4-4bfd-ab4e-0b25f2f226e7 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:08.299024 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c747eb-4a47-42a9-a35e-9201d227924a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:08.299676 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c747eb-4a47-42a9-a35e-9201d227924a service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:08.299974 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c747eb-4a47-42a9-a35e-9201d227924a service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:08.300244 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c747eb-4a47-42a9-a35e-9201d227924a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:08.310317 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00390d1-eda4-4bfd-ab4e-0b25f2f226e7 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:08.314818 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b52ef0-3712-414b-9e5a-d3bb7a504b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:08.315489 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b52ef0-3712-414b-9e5a-d3bb7a504b8e admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:08.315829 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b52ef0-3712-414b-9e5a-d3bb7a504b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:08.316094 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b52ef0-3712-414b-9e5a-d3bb7a504b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:08.316815 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b52ef0-3712-414b-9e5a-d3bb7a504b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:08.318421 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b52ef0-3712-414b-9e5a-d3bb7a504b8e admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:08.331491 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 799/1601] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:08.331491 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b52ef0-3712-414b-9e5a-d3bb7a504b8e admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:08.338514 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b52ef0-3712-414b-9e5a-d3bb7a504b8e admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:08.343004 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c01610-6eda-4130-9fc2-05ba28f1bc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:08.343616 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c01610-6eda-4130-9fc2-05ba28f1bc69 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:08.343934 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c01610-6eda-4130-9fc2-05ba28f1bc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:08.344210 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c01610-6eda-4130-9fc2-05ba28f1bc69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:08.344909 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c01610-6eda-4130-9fc2-05ba28f1bc69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:08.347053 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c01610-6eda-4130-9fc2-05ba28f1bc69 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:08.356638 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 800/1602] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:08.357415 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c01610-6eda-4130-9fc2-05ba28f1bc69 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:08.358420 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c747eb-4a47-42a9-a35e-9201d227924a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:08.360381 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c747eb-4a47-42a9-a35e-9201d227924a service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:08.366561 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c01610-6eda-4130-9fc2-05ba28f1bc69 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:08.369661 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 803/1603] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:08.370406 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c747eb-4a47-42a9-a35e-9201d227924a service neutron] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:08.371604 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e6613-0b21-4d92-b620-ae1ae3e2c139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:08.372288 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e6613-0b21-4d92-b620-ae1ae3e2c139 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:08.372574 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e6613-0b21-4d92-b620-ae1ae3e2c139 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:08.372852 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e6613-0b21-4d92-b620-ae1ae3e2c139 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:08.373569 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e6613-0b21-4d92-b620-ae1ae3e2c139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:08.375134 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e6613-0b21-4d92-b620-ae1ae3e2c139 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:08.379924 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c747eb-4a47-42a9-a35e-9201d227924a service neutron] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:08.387890 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 801/1604] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:08.387890 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e6613-0b21-4d92-b620-ae1ae3e2c139 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:08.390091 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7514d-1df6-4a1a-b45b-21021cefbcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:08.390978 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7514d-1df6-4a1a-b45b-21021cefbcb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:08.391260 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7514d-1df6-4a1a-b45b-21021cefbcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:08.391546 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7514d-1df6-4a1a-b45b-21021cefbcb1 admin admin] PATH_INFO: `/v3/projects/3eca265def914237bde319b10918c2f9/users/c9d6bda7a7ac4f01962f2f9ca72fd71b/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:08.398292 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e6613-0b21-4d92-b620-ae1ae3e2c139 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:08.404023 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa71bc3-ba34-41f3-91f4-2f00d70336e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:08.404723 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa71bc3-ba34-41f3-91f4-2f00d70336e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:08.405007 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa71bc3-ba34-41f3-91f4-2f00d70336e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:08.405286 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa71bc3-ba34-41f3-91f4-2f00d70336e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:08.406007 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa71bc3-ba34-41f3-91f4-2f00d70336e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:08.407655 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa71bc3-ba34-41f3-91f4-2f00d70336e8 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:08.408892 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7514d-1df6-4a1a-b45b-21021cefbcb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eca265def914237bde319b10918c2f9, user_id=c9d6bda7a7ac4f01962f2f9ca72fd71b, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:08.411544 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7514d-1df6-4a1a-b45b-21021cefbcb1 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:08.419754 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 802/1605] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:08.420379 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa71bc3-ba34-41f3-91f4-2f00d70336e8 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:08.429325 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 804/1606] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:08 2022] PUT /identity/v3/projects/3eca265def914237bde319b10918c2f9/users/c9d6bda7a7ac4f01962f2f9ca72fd71b/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:08.430820 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91e431-d1bc-4f04-9808-6b660882b377 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:08.431244 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91e431-d1bc-4f04-9808-6b660882b377 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:08.431539 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91e431-d1bc-4f04-9808-6b660882b377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:08.437637 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa71bc3-ba34-41f3-91f4-2f00d70336e8 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:08.461009 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-eb91e431-d1bc-4f04-9808-6b660882b377 None None] MFA Rules not processed for user `9b9d4fe6e0014449aeaf33ce321be4e5`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:08.462425 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-eb91e431-d1bc-4f04-9808-6b660882b377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:08.500649 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77dd7e-f186-4e5a-b472-4273ba66fa9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:08.501837 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77dd7e-f186-4e5a-b472-4273ba66fa9b admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:08.502113 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77dd7e-f186-4e5a-b472-4273ba66fa9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:08.502391 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77dd7e-f186-4e5a-b472-4273ba66fa9b admin admin] PATH_INFO: `/v3/projects/1043931780a941138b2c0a8bd33e3723/users/382fc34b389c4338b8e9fcae2b4d89e3/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:08.519643 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77dd7e-f186-4e5a-b472-4273ba66fa9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1043931780a941138b2c0a8bd33e3723, user_id=382fc34b389c4338b8e9fcae2b4d89e3, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:08.522585 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77dd7e-f186-4e5a-b472-4273ba66fa9b admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:08.533895 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 805/1607] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:08 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:08.536788 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91e431-d1bc-4f04-9808-6b660882b377 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:08.538675 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 803/1608] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:08 2022] PUT /identity/v3/projects/1043931780a941138b2c0a8bd33e3723/users/382fc34b389c4338b8e9fcae2b4d89e3/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:08.539774 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77dd7e-f186-4e5a-b472-4273ba66fa9b admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:08.549599 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91e431-d1bc-4f04-9808-6b660882b377 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:08.609730 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77dd7e-f186-4e5a-b472-4273ba66fa9b admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:08.610787 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c8704-f68e-4fa7-bd96-2ecb2ba72aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:08.612554 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c8704-f68e-4fa7-bd96-2ecb2ba72aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:08.612554 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c8704-f68e-4fa7-bd96-2ecb2ba72aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:08.612554 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c8704-f68e-4fa7-bd96-2ecb2ba72aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:08.613793 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c8704-f68e-4fa7-bd96-2ecb2ba72aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:08.615531 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c8704-f68e-4fa7-bd96-2ecb2ba72aa7 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:08.617535 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c06638-dc5e-48e0-b531-6a86be31c82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:08.618505 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c06638-dc5e-48e0-b531-6a86be31c82a admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:08.618863 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c06638-dc5e-48e0-b531-6a86be31c82a admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:08.619233 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c06638-dc5e-48e0-b531-6a86be31c82a admin admin] PATH_INFO: `/v3/projects/2e617a5a84b449da8e8806baed547052/users/af9aa388314f4cfca823c8d13f67a8e0/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:08.629762 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 806/1609] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:08.629762 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c8704-f68e-4fa7-bd96-2ecb2ba72aa7 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:08.640128 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c8704-f68e-4fa7-bd96-2ecb2ba72aa7 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:08.641569 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c06638-dc5e-48e0-b531-6a86be31c82a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e617a5a84b449da8e8806baed547052, user_id=af9aa388314f4cfca823c8d13f67a8e0, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:08.645252 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c06638-dc5e-48e0-b531-6a86be31c82a admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:08.646295 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4f962-7df9-4b5b-866a-c82bbe4cea33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:08.647027 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4f962-7df9-4b5b-866a-c82bbe4cea33 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:08.647382 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4f962-7df9-4b5b-866a-c82bbe4cea33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:08.647763 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4f962-7df9-4b5b-866a-c82bbe4cea33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:08.648558 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b4f962-7df9-4b5b-866a-c82bbe4cea33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:08.650226 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b4f962-7df9-4b5b-866a-c82bbe4cea33 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:08.661503 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 804/1610] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:08 2022] PUT /identity/v3/projects/2e617a5a84b449da8e8806baed547052/users/af9aa388314f4cfca823c8d13f67a8e0/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:08.665234 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 807/1611] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:08.665234 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5bb70-fb69-4f29-982d-1b757b983ee2 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:08.665234 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5bb70-fb69-4f29-982d-1b757b983ee2 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:08.665234 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5bb70-fb69-4f29-982d-1b757b983ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:08.665620 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c06638-dc5e-48e0-b531-6a86be31c82a admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:08.697871 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-feb5bb70-fb69-4f29-982d-1b757b983ee2 None None] MFA Rules not processed for user `c9d6bda7a7ac4f01962f2f9ca72fd71b`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:08.700005 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-feb5bb70-fb69-4f29-982d-1b757b983ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:08.734910 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c06638-dc5e-48e0-b531-6a86be31c82a admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:08.741702 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facadd11-7f6e-4dd0-a9f2-546b82f24141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:08.743696 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facadd11-7f6e-4dd0-a9f2-546b82f24141 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:08.745220 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facadd11-7f6e-4dd0-a9f2-546b82f24141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:08.745623 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facadd11-7f6e-4dd0-a9f2-546b82f24141 admin admin] PATH_INFO: `/v3/projects/ffe4fe85e7f94a55ac41e20783d9f996/users/ed91bf71e98f48a0a20b46517b8005e9/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:08.781632 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facadd11-7f6e-4dd0-a9f2-546b82f24141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffe4fe85e7f94a55ac41e20783d9f996, user_id=ed91bf71e98f48a0a20b46517b8005e9, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:08.782485 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 808/1612] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:08.783495 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5bb70-fb69-4f29-982d-1b757b983ee2 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:08.785088 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facadd11-7f6e-4dd0-a9f2-546b82f24141 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:08.798100 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5bb70-fb69-4f29-982d-1b757b983ee2 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:08.807018 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 805/1613] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:08 2022] PUT /identity/v3/projects/ffe4fe85e7f94a55ac41e20783d9f996/users/ed91bf71e98f48a0a20b46517b8005e9/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:08.808705 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e997e-ad27-4d6d-99a5-c432c9a97daf None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:08.809100 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e997e-ad27-4d6d-99a5-c432c9a97daf None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:08.809530 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e997e-ad27-4d6d-99a5-c432c9a97daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:08.831192 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-d20e997e-ad27-4d6d-99a5-c432c9a97daf None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:08.832489 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-d20e997e-ad27-4d6d-99a5-c432c9a97daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:08.867870 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a69ce9-82c6-48fa-b4f0-6d0d25d4b3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:08.868781 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a69ce9-82c6-48fa-b4f0-6d0d25d4b3b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:08.869136 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a69ce9-82c6-48fa-b4f0-6d0d25d4b3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:08.869485 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a69ce9-82c6-48fa-b4f0-6d0d25d4b3b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:08.870242 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a69ce9-82c6-48fa-b4f0-6d0d25d4b3b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:08.872258 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a69ce9-82c6-48fa-b4f0-6d0d25d4b3b1 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:08.893045 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 806/1614] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:08.893903 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e997e-ad27-4d6d-99a5-c432c9a97daf None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:08.904308 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 809/1615] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:09:08 2022] POST /identity/v3/projects => generated 365 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:08.904581 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e997e-ad27-4d6d-99a5-c432c9a97daf None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:08.906145 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d3d18-f699-4c02-a6f9-a7ed192d0816 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:08.906609 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d3d18-f699-4c02-a6f9-a7ed192d0816 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:08.906890 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d3d18-f699-4c02-a6f9-a7ed192d0816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:08.924838 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-763d3d18-f699-4c02-a6f9-a7ed192d0816 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:08.926054 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-763d3d18-f699-4c02-a6f9-a7ed192d0816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:08.964527 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a3a0e-0268-4dc1-b462-2247383e5ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:08.965509 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a3a0e-0268-4dc1-b462-2247383e5ba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:08.965862 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a3a0e-0268-4dc1-b462-2247383e5ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:08.966208 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a3a0e-0268-4dc1-b462-2247383e5ba6 admin admin] PATH_INFO: `/v3/projects/8709904b3d2c45eeaf39c924b23a36b7/users/d7f2c45ac1b0456fae21ecc1150a3cff/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:08.983660 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a3a0e-0268-4dc1-b462-2247383e5ba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8709904b3d2c45eeaf39c924b23a36b7, user_id=d7f2c45ac1b0456fae21ecc1150a3cff, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:08.986686 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a3a0e-0268-4dc1-b462-2247383e5ba6 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:09.002805 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 810/1616] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:09.003747 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d3d18-f699-4c02-a6f9-a7ed192d0816 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:09.004431 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 807/1617] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:08 2022] PUT /identity/v3/projects/8709904b3d2c45eeaf39c924b23a36b7/users/d7f2c45ac1b0456fae21ecc1150a3cff/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:09.008257 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a3a0e-0268-4dc1-b462-2247383e5ba6 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:09.015829 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d3d18-f699-4c02-a6f9-a7ed192d0816 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:09.097670 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a3a0e-0268-4dc1-b462-2247383e5ba6 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:09.105074 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb924b-ee52-4299-a09a-7b91db0107df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:09.105911 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb924b-ee52-4299-a09a-7b91db0107df admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:09.106302 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb924b-ee52-4299-a09a-7b91db0107df admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:09.106649 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb924b-ee52-4299-a09a-7b91db0107df admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:09.107508 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb924b-ee52-4299-a09a-7b91db0107df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:09.109348 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5d6f4-1e9a-4d6a-9ec3-fcc39db14dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:09.110343 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5d6f4-1e9a-4d6a-9ec3-fcc39db14dac admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:09.110689 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5d6f4-1e9a-4d6a-9ec3-fcc39db14dac admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:09.111535 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5d6f4-1e9a-4d6a-9ec3-fcc39db14dac admin admin] PATH_INFO: `/v3/projects/b4a6ef2efd7a4a919e76818371144129/users/7d2e7e41f2ec4121a02aef71bd776d0b/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:09.117061 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb924b-ee52-4299-a09a-7b91db0107df admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:09.128822 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5d6f4-1e9a-4d6a-9ec3-fcc39db14dac admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4a6ef2efd7a4a919e76818371144129, user_id=7d2e7e41f2ec4121a02aef71bd776d0b, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:09.131547 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5d6f4-1e9a-4d6a-9ec3-fcc39db14dac admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:09.154297 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 811/1618] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:09 2022] PUT /identity/v3/projects/b4a6ef2efd7a4a919e76818371144129/users/7d2e7e41f2ec4121a02aef71bd776d0b/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:09.156029 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5d6f4-1e9a-4d6a-9ec3-fcc39db14dac admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:09.168114 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 808/1619] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:09:09 2022] POST /identity/v3/projects => generated 399 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:09.169023 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb924b-ee52-4299-a09a-7b91db0107df admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:09.241125 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb924b-ee52-4299-a09a-7b91db0107df admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:09.246205 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf172933-919c-4067-8b28-c50bf9003416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:09.247017 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf172933-919c-4067-8b28-c50bf9003416 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:09.247341 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf172933-919c-4067-8b28-c50bf9003416 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:09.247666 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf172933-919c-4067-8b28-c50bf9003416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:09.250925 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5d6f4-1e9a-4d6a-9ec3-fcc39db14dac admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:09.311530 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a43603-6baa-4d60-8dc5-6e9e1a54d901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:09.312236 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a43603-6baa-4d60-8dc5-6e9e1a54d901 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:09.312516 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a43603-6baa-4d60-8dc5-6e9e1a54d901 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:09.312788 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a43603-6baa-4d60-8dc5-6e9e1a54d901 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:09.313519 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a43603-6baa-4d60-8dc5-6e9e1a54d901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:09.315909 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a43603-6baa-4d60-8dc5-6e9e1a54d901 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:09.318646 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf172933-919c-4067-8b28-c50bf9003416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:09.320364 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf172933-919c-4067-8b28-c50bf9003416 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:09.329983 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 812/1620] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:09.329983 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a43603-6baa-4d60-8dc5-6e9e1a54d901 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:09.330526 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 809/1621] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:09.331595 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab05bc-51af-4a43-9d1d-4d2dcacf039c None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:09.331913 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab05bc-51af-4a43-9d1d-4d2dcacf039c None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:09.332194 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab05bc-51af-4a43-9d1d-4d2dcacf039c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:09.339861 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a43603-6baa-4d60-8dc5-6e9e1a54d901 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:09.344492 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8224258f-fb18-4780-8780-06012809dfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:09.345235 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224258f-fb18-4780-8780-06012809dfba admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:09.345625 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224258f-fb18-4780-8780-06012809dfba admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:09.345974 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224258f-fb18-4780-8780-06012809dfba admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:09.346727 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8224258f-fb18-4780-8780-06012809dfba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:09.348838 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8224258f-fb18-4780-8780-06012809dfba admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:09.348954 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-ffab05bc-51af-4a43-9d1d-4d2dcacf039c None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:09.350055 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-ffab05bc-51af-4a43-9d1d-4d2dcacf039c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:09.362109 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 810/1622] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:09.362109 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab05bc-51af-4a43-9d1d-4d2dcacf039c None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:09.375742 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 813/1623] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:09:09 2022] POST /identity/v3/users => generated 289 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:09.375973 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab05bc-51af-4a43-9d1d-4d2dcacf039c None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:09.377752 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2573354-a99c-486d-a192-4b98cdca4f07 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:09.378094 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2573354-a99c-486d-a192-4b98cdca4f07 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:09.378376 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2573354-a99c-486d-a192-4b98cdca4f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:09.382238 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2eae4-ee81-4c6d-af03-2cc64cc57dd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:09.382884 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2eae4-ee81-4c6d-af03-2cc64cc57dd5 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:09.383171 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2eae4-ee81-4c6d-af03-2cc64cc57dd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:09.383452 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2eae4-ee81-4c6d-af03-2cc64cc57dd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:09.393243 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2eae4-ee81-4c6d-af03-2cc64cc57dd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:09.394785 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2eae4-ee81-4c6d-af03-2cc64cc57dd5 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:09.408554 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 811/1624] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:09.409817 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-c2573354-a99c-486d-a192-4b98cdca4f07 None None] MFA Rules not processed for user `7d2e7e41f2ec4121a02aef71bd776d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:09.410098 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2eae4-ee81-4c6d-af03-2cc64cc57dd5 service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:09.411354 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-c2573354-a99c-486d-a192-4b98cdca4f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:09.420890 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2eae4-ee81-4c6d-af03-2cc64cc57dd5 service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:09.426769 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a031e1-04a9-4730-8ba3-a814b6b6b971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:09.427430 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a031e1-04a9-4730-8ba3-a814b6b6b971 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:09.427758 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a031e1-04a9-4730-8ba3-a814b6b6b971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:09.428079 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a031e1-04a9-4730-8ba3-a814b6b6b971 admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:09.428712 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a031e1-04a9-4730-8ba3-a814b6b6b971 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:09.430658 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a031e1-04a9-4730-8ba3-a814b6b6b971 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:09.456815 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 812/1625] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:09:09 2022] POST /identity/v3/users => generated 306 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:09.456815 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a031e1-04a9-4730-8ba3-a814b6b6b971 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:09.467535 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a031e1-04a9-4730-8ba3-a814b6b6b971 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:09.473235 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feee9a6-04a8-451e-b628-0f78a8e7437b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:09.474236 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feee9a6-04a8-451e-b628-0f78a8e7437b admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:09.474615 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feee9a6-04a8-451e-b628-0f78a8e7437b admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:09.475104 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feee9a6-04a8-451e-b628-0f78a8e7437b admin admin] PATH_INFO: `/v3/projects/ffe4fe85e7f94a55ac41e20783d9f996/users/ed91bf71e98f48a0a20b46517b8005e9/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:09.477556 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feee9a6-04a8-451e-b628-0f78a8e7437b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffe4fe85e7f94a55ac41e20783d9f996, user_id=ed91bf71e98f48a0a20b46517b8005e9, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:09.480323 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feee9a6-04a8-451e-b628-0f78a8e7437b admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:09.491539 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 814/1626] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:09.491539 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2573354-a99c-486d-a192-4b98cdca4f07 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:09.491539 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-c2573354-a99c-486d-a192-4b98cdca4f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:09.499046 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 813/1627] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:09 2022] PUT /identity/v3/projects/ffe4fe85e7f94a55ac41e20783d9f996/users/ed91bf71e98f48a0a20b46517b8005e9/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:09.500340 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feee9a6-04a8-451e-b628-0f78a8e7437b admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:09.512088 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2573354-a99c-486d-a192-4b98cdca4f07 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:09.567198 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f7baa-696e-4671-a967-f7b8f88c0e4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:09.567936 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f7baa-696e-4671-a967-f7b8f88c0e4d service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:09.568223 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f7baa-696e-4671-a967-f7b8f88c0e4d service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:09.568496 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f7baa-696e-4671-a967-f7b8f88c0e4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:09.583187 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feee9a6-04a8-451e-b628-0f78a8e7437b admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:09.588163 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfaadd0-f794-43f1-9d9e-204b24a74922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:09.588835 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfaadd0-f794-43f1-9d9e-204b24a74922 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:09.589122 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfaadd0-f794-43f1-9d9e-204b24a74922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:09.589403 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfaadd0-f794-43f1-9d9e-204b24a74922 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:09.590131 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfaadd0-f794-43f1-9d9e-204b24a74922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:09.591773 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfaadd0-f794-43f1-9d9e-204b24a74922 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:09.603876 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 814/1628] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:09.605209 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfaadd0-f794-43f1-9d9e-204b24a74922 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:09.618388 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfaadd0-f794-43f1-9d9e-204b24a74922 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:09.623512 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b4271-cbc7-4356-95ed-60178f107062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:09.624203 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b4271-cbc7-4356-95ed-60178f107062 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:09.624491 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b4271-cbc7-4356-95ed-60178f107062 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:09.624785 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b4271-cbc7-4356-95ed-60178f107062 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:09.625518 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b4271-cbc7-4356-95ed-60178f107062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:09.627210 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b4271-cbc7-4356-95ed-60178f107062 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:09.637737 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 815/1629] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:09.639095 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff29733-84ef-4668-a4e8-b3de666e679c None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:09.639371 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff29733-84ef-4668-a4e8-b3de666e679c None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:09.639764 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff29733-84ef-4668-a4e8-b3de666e679c None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:09.641500 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 816/1630] 10.222.0.15 () {54 vars in 961 bytes} [Thu Mar 10 04:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:09:09.642433 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f64be-c70c-4e3b-b51f-9fa9ebbf23ad None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:09.642856 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f64be-c70c-4e3b-b51f-9fa9ebbf23ad None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:09.643160 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f64be-c70c-4e3b-b51f-9fa9ebbf23ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:09.646492 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f7baa-696e-4671-a967-f7b8f88c0e4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:09.648127 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f7baa-696e-4671-a967-f7b8f88c0e4d service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:09.661425 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 815/1631] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:09.665286 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f7baa-696e-4671-a967-f7b8f88c0e4d service neutron] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:09.671779 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-7f5f64be-c70c-4e3b-b51f-9fa9ebbf23ad None None] MFA Rules not processed for user `ed91bf71e98f48a0a20b46517b8005e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:09.673206 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-7f5f64be-c70c-4e3b-b51f-9fa9ebbf23ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:09.679386 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f7baa-696e-4671-a967-f7b8f88c0e4d service neutron] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:09.687226 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c281b-6398-41f0-8a49-e89cd0cb4533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:09.688394 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c281b-6398-41f0-8a49-e89cd0cb4533 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:09.688805 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c281b-6398-41f0-8a49-e89cd0cb4533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:09.689289 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c281b-6398-41f0-8a49-e89cd0cb4533 admin admin] PATH_INFO: `/v3/projects/45df59a4f62e4363a10c0d5751e09e30/users/b950a1958f7645d58447431f511f891b/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:09.706368 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c281b-6398-41f0-8a49-e89cd0cb4533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45df59a4f62e4363a10c0d5751e09e30, user_id=b950a1958f7645d58447431f511f891b, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:09.710150 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c281b-6398-41f0-8a49-e89cd0cb4533 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:09.731913 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 816/1632] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:09 2022] PUT /identity/v3/projects/45df59a4f62e4363a10c0d5751e09e30/users/b950a1958f7645d58447431f511f891b/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:09.734155 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c281b-6398-41f0-8a49-e89cd0cb4533 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:09.774100 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 817/1633] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:09.775525 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ad1e5-0e56-4daa-813b-f1db6610f15f None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:09.775874 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ad1e5-0e56-4daa-813b-f1db6610f15f None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:09.776683 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ad1e5-0e56-4daa-813b-f1db6610f15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:09.796530 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-187ad1e5-0e56-4daa-813b-f1db6610f15f None None] MFA Rules not processed for user `fbd92bd14ed04621af06d68161798fe3`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:09.798406 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-187ad1e5-0e56-4daa-813b-f1db6610f15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:09.804903 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c281b-6398-41f0-8a49-e89cd0cb4533 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:09.810522 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7860ce-d76c-4443-8fdf-53ffda5d6fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:09.811751 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7860ce-d76c-4443-8fdf-53ffda5d6fa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:09.812240 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7860ce-d76c-4443-8fdf-53ffda5d6fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:09.812691 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7860ce-d76c-4443-8fdf-53ffda5d6fa8 admin admin] PATH_INFO: `/v3/projects/1766f5f6f89948d38f6e979b7271536a/users/e60f4d9b038644efaa7379a6351726c0/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:09.830793 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7860ce-d76c-4443-8fdf-53ffda5d6fa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1766f5f6f89948d38f6e979b7271536a, user_id=e60f4d9b038644efaa7379a6351726c0, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:09.833627 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7860ce-d76c-4443-8fdf-53ffda5d6fa8 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:09.855084 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 817/1634] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:09 2022] PUT /identity/v3/projects/1766f5f6f89948d38f6e979b7271536a/users/e60f4d9b038644efaa7379a6351726c0/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:09.855084 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7860ce-d76c-4443-8fdf-53ffda5d6fa8 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:09.893499 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 818/1635] 10.222.0.15 () {58 vars in 1058 bytes} [Thu Mar 10 04:09:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:09.894680 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ad1e5-0e56-4daa-813b-f1db6610f15f None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:09.966520 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7860ce-d76c-4443-8fdf-53ffda5d6fa8 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:09.973547 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1f1fa-7101-4c68-a29c-cc047db5ea7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:09.974284 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1f1fa-7101-4c68-a29c-cc047db5ea7f admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:09.974569 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1f1fa-7101-4c68-a29c-cc047db5ea7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:09.974847 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1f1fa-7101-4c68-a29c-cc047db5ea7f admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:09.976158 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1f1fa-7101-4c68-a29c-cc047db5ea7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:09.978395 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1f1fa-7101-4c68-a29c-cc047db5ea7f admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:09.988922 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ad1e5-0e56-4daa-813b-f1db6610f15f None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:09.991727 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 818/1636] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:09.992777 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1f1fa-7101-4c68-a29c-cc047db5ea7f admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:10.006117 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1f1fa-7101-4c68-a29c-cc047db5ea7f admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:10.012068 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9e4db-06e2-4689-99cd-a14f24c23ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:10.012868 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9e4db-06e2-4689-99cd-a14f24c23ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:10.013496 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9e4db-06e2-4689-99cd-a14f24c23ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:10.013496 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9e4db-06e2-4689-99cd-a14f24c23ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:10.014239 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9e4db-06e2-4689-99cd-a14f24c23ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:10.016419 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9e4db-06e2-4689-99cd-a14f24c23ec4 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:10.031881 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 819/1637] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:10.038224 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9e4db-06e2-4689-99cd-a14f24c23ec4 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:10.059129 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba346cc8-beee-473f-9ce7-bd11c50baec3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:10.060168 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba346cc8-beee-473f-9ce7-bd11c50baec3 service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:10.060552 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba346cc8-beee-473f-9ce7-bd11c50baec3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:10.061481 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba346cc8-beee-473f-9ce7-bd11c50baec3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:10.150887 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba346cc8-beee-473f-9ce7-bd11c50baec3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:10.153608 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba346cc8-beee-473f-9ce7-bd11c50baec3 service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:10.170211 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 819/1638] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:09 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:10.171198 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba346cc8-beee-473f-9ce7-bd11c50baec3 service cinder] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:10.179942 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9e4db-06e2-4689-99cd-a14f24c23ec4 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:10.186455 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba346cc8-beee-473f-9ce7-bd11c50baec3 service cinder] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:10.194503 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a8274-3eef-407d-8509-985d658e25ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:10.195636 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a8274-3eef-407d-8509-985d658e25ab admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:10.196060 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a8274-3eef-407d-8509-985d658e25ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:10.198332 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a8274-3eef-407d-8509-985d658e25ab admin admin] PATH_INFO: `/v3/projects/45df59a4f62e4363a10c0d5751e09e30/users/b950a1958f7645d58447431f511f891b/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:10.200437 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ab6e3-99d5-4723-86cd-ce2dfeb108f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:10.201083 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a8274-3eef-407d-8509-985d658e25ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=45df59a4f62e4363a10c0d5751e09e30, user_id=b950a1958f7645d58447431f511f891b, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:10.201318 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ab6e3-99d5-4723-86cd-ce2dfeb108f4 service nova] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:10.201417 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ab6e3-99d5-4723-86cd-ce2dfeb108f4 service nova] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:10.201650 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ab6e3-99d5-4723-86cd-ce2dfeb108f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:10.205816 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a8274-3eef-407d-8509-985d658e25ab admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:10.219854 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 820/1639] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:10 2022] PUT /identity/v3/projects/45df59a4f62e4363a10c0d5751e09e30/users/b950a1958f7645d58447431f511f891b/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:10.220990 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a8274-3eef-407d-8509-985d658e25ab admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:10.352074 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ab6e3-99d5-4723-86cd-ce2dfeb108f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:10.356590 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ab6e3-99d5-4723-86cd-ce2dfeb108f4 service nova] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:10.359781 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a8274-3eef-407d-8509-985d658e25ab admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:10.373168 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb590d-7bde-4f24-90b3-9d989e7c30ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:10.377391 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb590d-7bde-4f24-90b3-9d989e7c30ef admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:10.377848 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb590d-7bde-4f24-90b3-9d989e7c30ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:10.379008 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb590d-7bde-4f24-90b3-9d989e7c30ef admin admin] PATH_INFO: `/v3/projects/1766f5f6f89948d38f6e979b7271536a/users/e60f4d9b038644efaa7379a6351726c0/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:10.390489 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb590d-7bde-4f24-90b3-9d989e7c30ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=1766f5f6f89948d38f6e979b7271536a, user_id=e60f4d9b038644efaa7379a6351726c0, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:10.394677 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb590d-7bde-4f24-90b3-9d989e7c30ef admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:10.397958 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 820/1640] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:10.401969 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78013966-bfee-4354-936d-7887e5eda4a8 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:10.402886 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78013966-bfee-4354-936d-7887e5eda4a8 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:10.404809 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78013966-bfee-4354-936d-7887e5eda4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:10.426891 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 821/1641] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:10 2022] PUT /identity/v3/projects/1766f5f6f89948d38f6e979b7271536a/users/e60f4d9b038644efaa7379a6351726c0/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:10.428362 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb590d-7bde-4f24-90b3-9d989e7c30ef admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:10.538841 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-78013966-bfee-4354-936d-7887e5eda4a8 None None] MFA Rules not processed for user `b950a1958f7645d58447431f511f891b`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:10.546224 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-78013966-bfee-4354-936d-7887e5eda4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:10.680274 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb590d-7bde-4f24-90b3-9d989e7c30ef admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:10.692438 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b80f6-3c19-4832-8b7e-849f0bc04766 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:10.692903 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b80f6-3c19-4832-8b7e-849f0bc04766 service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:10.693502 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b80f6-3c19-4832-8b7e-849f0bc04766 service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:10.694026 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b80f6-3c19-4832-8b7e-849f0bc04766 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:10.765461 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 821/1642] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:10 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:10.769291 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e8258-1cf8-46f9-ae6b-cdb53bc70c49 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:10.769798 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e8258-1cf8-46f9-ae6b-cdb53bc70c49 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:10.770548 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e8258-1cf8-46f9-ae6b-cdb53bc70c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:10.818284 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-315e8258-1cf8-46f9-ae6b-cdb53bc70c49 None None] MFA Rules not processed for user `e60f4d9b038644efaa7379a6351726c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:10.821642 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-315e8258-1cf8-46f9-ae6b-cdb53bc70c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:10.833917 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b80f6-3c19-4832-8b7e-849f0bc04766 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:10.838875 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b80f6-3c19-4832-8b7e-849f0bc04766 service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:10.860375 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 822/1643] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:10.862115 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a095487-25c6-4073-a234-661e31a8c533 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:10.862408 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a095487-25c6-4073-a234-661e31a8c533 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:10.862687 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a095487-25c6-4073-a234-661e31a8c533 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:10.864625 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 823/1644] 10.222.0.15 () {54 vars in 912 bytes} [Thu Mar 10 04:09:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:09:10.865198 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a095487-25c6-4073-a234-661e31a8c533 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:10.898455 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a095487-25c6-4073-a234-661e31a8c533 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:10.905063 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd16319-35e6-4ad7-aafb-ea5c6e3f4256 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:10.907003 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd16319-35e6-4ad7-aafb-ea5c6e3f4256 service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:10.907658 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd16319-35e6-4ad7-aafb-ea5c6e3f4256 service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:10.909480 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd16319-35e6-4ad7-aafb-ea5c6e3f4256 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:10.942016 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd16319-35e6-4ad7-aafb-ea5c6e3f4256 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:10.944239 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd16319-35e6-4ad7-aafb-ea5c6e3f4256 service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:10.958765 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 824/1645] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:10 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:10.960835 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00048d-31cd-44ee-ba89-0f91228fdf2a None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:10.961056 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00048d-31cd-44ee-ba89-0f91228fdf2a None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:10.961475 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00048d-31cd-44ee-ba89-0f91228fdf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:10.967842 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 822/1646] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:10 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:10.973754 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b521f-971f-4b87-bc7c-80c8d254b059 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:10.976364 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b521f-971f-4b87-bc7c-80c8d254b059 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:10.976726 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b521f-971f-4b87-bc7c-80c8d254b059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:10.988692 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-ff00048d-31cd-44ee-ba89-0f91228fdf2a None None] MFA Rules not processed for user `fbd92bd14ed04621af06d68161798fe3`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:10.991925 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-ff00048d-31cd-44ee-ba89-0f91228fdf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:11.034358 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-470b521f-971f-4b87-bc7c-80c8d254b059 None None] MFA Rules not processed for user `d7f2c45ac1b0456fae21ecc1150a3cff`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:11.035800 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-470b521f-971f-4b87-bc7c-80c8d254b059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:11.128850 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 825/1647] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Mar 10 04:09:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:11.131672 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00048d-31cd-44ee-ba89-0f91228fdf2a None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:11.161002 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 823/1648] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:11.161254 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00048d-31cd-44ee-ba89-0f91228fdf2a None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:11.165300 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa43b6d-9b0d-4856-a27f-0b67dddeda15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:11.165300 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa43b6d-9b0d-4856-a27f-0b67dddeda15 service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:11.165766 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e92492-d311-4935-857a-8c752298d558 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:11.165883 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa43b6d-9b0d-4856-a27f-0b67dddeda15 service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:11.166045 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e92492-d311-4935-857a-8c752298d558 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:11.166288 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e92492-d311-4935-857a-8c752298d558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:11.166732 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa43b6d-9b0d-4856-a27f-0b67dddeda15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:11.188714 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa43b6d-9b0d-4856-a27f-0b67dddeda15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:11.192143 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa43b6d-9b0d-4856-a27f-0b67dddeda15 service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:11.221117 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 826/1649] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:11 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:11.225491 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-b2e92492-d311-4935-857a-8c752298d558 None None] MFA Rules not processed for user `d7f2c45ac1b0456fae21ecc1150a3cff`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:11.227392 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-b2e92492-d311-4935-857a-8c752298d558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:11.256071 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 824/1650] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:11.261992 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38426970-2c6e-435a-b9bd-45ff425a57e6 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:11.262543 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38426970-2c6e-435a-b9bd-45ff425a57e6 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:11.263117 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38426970-2c6e-435a-b9bd-45ff425a57e6 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:11.265120 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 827/1651] 10.222.0.15 () {54 vars in 961 bytes} [Thu Mar 10 04:09:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:09:11.278745 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b1dea-ee3c-476f-b6cc-1ffb7e133b72 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:11.279209 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b1dea-ee3c-476f-b6cc-1ffb7e133b72 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:11.279489 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b1dea-ee3c-476f-b6cc-1ffb7e133b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:11.315619 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38426970-2c6e-435a-b9bd-45ff425a57e6 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:11.333511 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-b34b1dea-ee3c-476f-b6cc-1ffb7e133b72 None None] MFA Rules not processed for user `fbd92bd14ed04621af06d68161798fe3`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:11.337326 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-b34b1dea-ee3c-476f-b6cc-1ffb7e133b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:11.337468 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38426970-2c6e-435a-b9bd-45ff425a57e6 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:11.346854 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd20b8-4544-469f-a4e4-2825a43cb245 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:11.347520 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd20b8-4544-469f-a4e4-2825a43cb245 service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:11.347822 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd20b8-4544-469f-a4e4-2825a43cb245 service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:11.348557 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd20b8-4544-469f-a4e4-2825a43cb245 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:11.367624 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 825/1652] 10.222.0.15 () {58 vars in 1058 bytes} [Thu Mar 10 04:09:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:11.385411 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b1dea-ee3c-476f-b6cc-1ffb7e133b72 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:11.389099 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd20b8-4544-469f-a4e4-2825a43cb245 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:11.393478 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd20b8-4544-469f-a4e4-2825a43cb245 service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:11.411733 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b1dea-ee3c-476f-b6cc-1ffb7e133b72 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:11.432461 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 828/1653] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:09:11.436218 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6389ae4-cb2a-4ece-ac71-935486491224 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:11.438561 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6389ae4-cb2a-4ece-ac71-935486491224 service nova] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:11.438854 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6389ae4-cb2a-4ece-ac71-935486491224 service nova] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:11.439183 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6389ae4-cb2a-4ece-ac71-935486491224 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:11.450253 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd20b8-4544-469f-a4e4-2825a43cb245 service cinder] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:11.460873 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd20b8-4544-469f-a4e4-2825a43cb245 service cinder] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:11.465411 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37b54e-d5b4-46c8-8337-6ded3a7160fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:11.466400 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37b54e-d5b4-46c8-8337-6ded3a7160fe service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:11.466916 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37b54e-d5b4-46c8-8337-6ded3a7160fe service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:11.467427 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37b54e-d5b4-46c8-8337-6ded3a7160fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:11.471447 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6389ae4-cb2a-4ece-ac71-935486491224 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:11.473288 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6389ae4-cb2a-4ece-ac71-935486491224 service nova] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:11.497662 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 826/1654] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:11.543219 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37b54e-d5b4-46c8-8337-6ded3a7160fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:11.545586 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37b54e-d5b4-46c8-8337-6ded3a7160fe service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:11.574343 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 829/1655] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:11 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:09:11.926979 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf023d-bd41-496e-8d5c-a2484bbe4609 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:11.927496 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf023d-bd41-496e-8d5c-a2484bbe4609 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:11.927609 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf023d-bd41-496e-8d5c-a2484bbe4609 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:11.929202 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37b54e-d5b4-46c8-8337-6ded3a7160fe service cinder] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:11.936671 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 827/1656] 10.222.0.15 () {54 vars in 912 bytes} [Thu Mar 10 04:09:11 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:09:11.942685 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37b54e-d5b4-46c8-8337-6ded3a7160fe service cinder] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:11.943032 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff05c9a-383b-40a6-bf03-ad7c573308f3 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:11.943376 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff05c9a-383b-40a6-bf03-ad7c573308f3 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:11.943658 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff05c9a-383b-40a6-bf03-ad7c573308f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:11.948860 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65819c2-27bd-420d-9c5a-fe87d09fb1c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:11.949562 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65819c2-27bd-420d-9c5a-fe87d09fb1c8 service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:11.949848 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65819c2-27bd-420d-9c5a-fe87d09fb1c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:11.950133 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65819c2-27bd-420d-9c5a-fe87d09fb1c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:11.964500 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-4ff05c9a-383b-40a6-bf03-ad7c573308f3 None None] MFA Rules not processed for user `fbd92bd14ed04621af06d68161798fe3`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:11.965804 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-4ff05c9a-383b-40a6-bf03-ad7c573308f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:11.990966 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 828/1657] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Mar 10 04:09:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:11.992373 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff05c9a-383b-40a6-bf03-ad7c573308f3 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:11.994261 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-4ff05c9a-383b-40a6-bf03-ad7c573308f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:12.061561 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65819c2-27bd-420d-9c5a-fe87d09fb1c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:12.084710 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65819c2-27bd-420d-9c5a-fe87d09fb1c8 service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:12.121907 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff05c9a-383b-40a6-bf03-ad7c573308f3 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:12.128494 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 830/1658] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:11 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:12.131251 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240fa5a-18c8-44ed-9ef5-fd0a10e71161 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7c195f91114855acc58163631544d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:12.131997 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240fa5a-18c8-44ed-9ef5-fd0a10e71161 service glance] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:12.132282 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240fa5a-18c8-44ed-9ef5-fd0a10e71161 service glance] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:12.132662 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240fa5a-18c8-44ed-9ef5-fd0a10e71161 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:12.150434 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240fa5a-18c8-44ed-9ef5-fd0a10e71161 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:12.151857 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240fa5a-18c8-44ed-9ef5-fd0a10e71161 service glance] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:12.188034 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 829/1659] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:09:12.930522 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf05962-17e2-4cef-a75d-79e813d84dfc None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:12.930995 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf05962-17e2-4cef-a75d-79e813d84dfc None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:12.931084 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf05962-17e2-4cef-a75d-79e813d84dfc None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:12.933673 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 831/1660] 10.222.0.15 () {54 vars in 912 bytes} [Thu Mar 10 04:09:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:09:12.953941 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7840e5-f498-4122-8eaa-12387a64a2fd None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:12.954404 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7840e5-f498-4122-8eaa-12387a64a2fd None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:12.954491 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7840e5-f498-4122-8eaa-12387a64a2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:13.068495 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-ba7840e5-f498-4122-8eaa-12387a64a2fd None None] MFA Rules not processed for user `2faf262ae9d643c0b8708dcfecd75b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:13.073708 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-ba7840e5-f498-4122-8eaa-12387a64a2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:13.173833 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 830/1661] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Mar 10 04:09:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:09:13.355610 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf05962-17e2-4cef-a75d-79e813d84dfc None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:13.383704 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf05962-17e2-4cef-a75d-79e813d84dfc None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:13.420805 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e4c92-a2e3-4f87-a5de-f805c813bcd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:13.430539 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e4c92-a2e3-4f87-a5de-f805c813bcd5 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:13.430822 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e4c92-a2e3-4f87-a5de-f805c813bcd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:13.432258 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e4c92-a2e3-4f87-a5de-f805c813bcd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:13.477152 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e4c92-a2e3-4f87-a5de-f805c813bcd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:13.478800 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e4c92-a2e3-4f87-a5de-f805c813bcd5 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:13.544357 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 832/1662] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:15.100588 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac979aa-f9dc-4a04-8174-103f22d968bc None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:15.101050 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac979aa-f9dc-4a04-8174-103f22d968bc None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:15.101204 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac979aa-f9dc-4a04-8174-103f22d968bc None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:15.103034 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 831/1663] 10.222.0.15 () {54 vars in 960 bytes} [Thu Mar 10 04:09:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:09:15.113523 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3518b-f33b-47ac-b93e-251486353f34 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:15.114069 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3518b-f33b-47ac-b93e-251486353f34 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:15.114069 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3518b-f33b-47ac-b93e-251486353f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:15.150304 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-3bb3518b-f33b-47ac-b93e-251486353f34 None None] MFA Rules not processed for user `319da006b10c41f8aa8a9d5aa2225b60`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:15.151579 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-3bb3518b-f33b-47ac-b93e-251486353f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:15.377421 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 833/1664] 10.222.0.15 () {58 vars in 1057 bytes} [Thu Mar 10 04:09:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:09:15.378568 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac979aa-f9dc-4a04-8174-103f22d968bc None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:15.396910 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac979aa-f9dc-4a04-8174-103f22d968bc None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:15.403068 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17368a34-00a2-4975-9af9-1690bdc24958 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319da006b10c41f8aa8a9d5aa2225b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:15.404097 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17368a34-00a2-4975-9af9-1690bdc24958 service placement] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:15.404565 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17368a34-00a2-4975-9af9-1690bdc24958 service placement] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:15.405041 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17368a34-00a2-4975-9af9-1690bdc24958 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:15.408573 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-17368a34-00a2-4975-9af9-1690bdc24958 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:15.422946 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17368a34-00a2-4975-9af9-1690bdc24958 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:15.425363 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17368a34-00a2-4975-9af9-1690bdc24958 service placement] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:15.451376 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 832/1665] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:15.498101 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3518b-f33b-47ac-b93e-251486353f34 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:15.549548 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17368a34-00a2-4975-9af9-1690bdc24958 service placement] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:15.697038 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3518b-f33b-47ac-b93e-251486353f34 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:15.712947 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2475a-b772-4f4c-bdd0-e435307a3b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:15.713819 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2475a-b772-4f4c-bdd0-e435307a3b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:15.714575 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2475a-b772-4f4c-bdd0-e435307a3b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:15.716001 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2475a-b772-4f4c-bdd0-e435307a3b1b admin admin] PATH_INFO: `/v3/users/7d2e7e41f2ec4121a02aef71bd776d0b` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:15.716968 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17368a34-00a2-4975-9af9-1690bdc24958 service placement] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:15.718452 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2475a-b772-4f4c-bdd0-e435307a3b1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d2e7e41f2ec4121a02aef71bd776d0b)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:15.722283 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2475a-b772-4f4c-bdd0-e435307a3b1b admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:15.728257 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d5e7f-954b-4d91-815f-15b112a59f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:15.729147 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d5e7f-954b-4d91-815f-15b112a59f6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:15.729424 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d5e7f-954b-4d91-815f-15b112a59f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:15.729695 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d5e7f-954b-4d91-815f-15b112a59f6e admin admin] PATH_INFO: `/v3/users/9b9d4fe6e0014449aeaf33ce321be4e5` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:15.733221 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d5e7f-954b-4d91-815f-15b112a59f6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b9d4fe6e0014449aeaf33ce321be4e5)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:15.733221 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: WARNING py.warnings [None req-803d5e7f-954b-4d91-815f-15b112a59f6e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 10 04:09:15.733221 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: warnings.warn(msg) Mar 10 04:09:15.733221 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: Mar 10 04:09:15.734331 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d5e7f-954b-4d91-815f-15b112a59f6e admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:15.828760 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b9c2475a-b772-4f4c-bdd0-e435307a3b1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d2e7e41f2ec4121a02aef71bd776d0b'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:15.836445 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b9c2475a-b772-4f4c-bdd0-e435307a3b1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d2e7e41f2ec4121a02aef71bd776d0b'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:15.845772 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b9c2475a-b772-4f4c-bdd0-e435307a3b1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d2e7e41f2ec4121a02aef71bd776d0b'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:15.859282 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-803d5e7f-954b-4d91-815f-15b112a59f6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b9d4fe6e0014449aeaf33ce321be4e5'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:15.872476 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b9c2475a-b772-4f4c-bdd0-e435307a3b1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d2e7e41f2ec4121a02aef71bd776d0b'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:15.880179 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b9c2475a-b772-4f4c-bdd0-e435307a3b1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d2e7e41f2ec4121a02aef71bd776d0b'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:15.883619 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-803d5e7f-954b-4d91-815f-15b112a59f6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b9d4fe6e0014449aeaf33ce321be4e5'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:15.901946 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 834/1666] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:09:15 2022] DELETE /identity/v3/users/7d2e7e41f2ec4121a02aef71bd776d0b => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:15.903918 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-803d5e7f-954b-4d91-815f-15b112a59f6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b9d4fe6e0014449aeaf33ce321be4e5'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:15.907386 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf5ef4-78f0-43bf-80da-4e663f9b578c None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:15.908360 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf5ef4-78f0-43bf-80da-4e663f9b578c None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:15.908706 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf5ef4-78f0-43bf-80da-4e663f9b578c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:15.941417 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-31cf5ef4-78f0-43bf-80da-4e663f9b578c None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:15.943308 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-31cf5ef4-78f0-43bf-80da-4e663f9b578c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:15.969828 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-803d5e7f-954b-4d91-815f-15b112a59f6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b9d4fe6e0014449aeaf33ce321be4e5'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:15.971587 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-803d5e7f-954b-4d91-815f-15b112a59f6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b9d4fe6e0014449aeaf33ce321be4e5'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:15.979047 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 833/1667] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:09:15 2022] DELETE /identity/v3/users/9b9d4fe6e0014449aeaf33ce321be4e5 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:15.983751 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fbe0f-fa94-4e1d-aa04-1b2b7d2dfbaa None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:15.984785 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fbe0f-fa94-4e1d-aa04-1b2b7d2dfbaa None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:15.986966 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fbe0f-fa94-4e1d-aa04-1b2b7d2dfbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:16.029350 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-f51fbe0f-fa94-4e1d-aa04-1b2b7d2dfbaa None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:16.030791 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-f51fbe0f-fa94-4e1d-aa04-1b2b7d2dfbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:16.117682 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 835/1668] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:16.195379 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 834/1669] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:16.203482 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf5ef4-78f0-43bf-80da-4e663f9b578c None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:16.205995 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-31cf5ef4-78f0-43bf-80da-4e663f9b578c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:16.239918 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fbe0f-fa94-4e1d-aa04-1b2b7d2dfbaa None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:16.241404 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-f51fbe0f-fa94-4e1d-aa04-1b2b7d2dfbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:16.384941 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fbe0f-fa94-4e1d-aa04-1b2b7d2dfbaa None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:16.398233 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab69f68-55ba-4d59-9f4e-dbed2b88e56f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:16.401398 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab69f68-55ba-4d59-9f4e-dbed2b88e56f service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:16.401710 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab69f68-55ba-4d59-9f4e-dbed2b88e56f service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:16.402058 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab69f68-55ba-4d59-9f4e-dbed2b88e56f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:16.418512 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf5ef4-78f0-43bf-80da-4e663f9b578c None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:16.424934 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab69f68-55ba-4d59-9f4e-dbed2b88e56f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:16.428913 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab69f68-55ba-4d59-9f4e-dbed2b88e56f service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:16.438092 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0498bc-9641-4a3c-9a6c-94115f1c7220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:16.439333 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0498bc-9641-4a3c-9a6c-94115f1c7220 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:16.439615 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0498bc-9641-4a3c-9a6c-94115f1c7220 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:16.443544 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0498bc-9641-4a3c-9a6c-94115f1c7220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:16.457943 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 835/1670] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:09:16.469140 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0498bc-9641-4a3c-9a6c-94115f1c7220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:16.471843 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0498bc-9641-4a3c-9a6c-94115f1c7220 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:16.498435 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 836/1671] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:17.442374 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab69f68-55ba-4d59-9f4e-dbed2b88e56f service neutron] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:17.444719 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-6ab69f68-55ba-4d59-9f4e-dbed2b88e56f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:17.485478 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab69f68-55ba-4d59-9f4e-dbed2b88e56f service neutron] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:17.494335 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b906c5-8e07-4b3b-b88d-b69f715983a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:17.495575 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b906c5-8e07-4b3b-b88d-b69f715983a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:17.496037 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b906c5-8e07-4b3b-b88d-b69f715983a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:17.496463 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b906c5-8e07-4b3b-b88d-b69f715983a5 admin admin] PATH_INFO: `/v3/projects/b4a6ef2efd7a4a919e76818371144129` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:17.504260 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b906c5-8e07-4b3b-b88d-b69f715983a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4a6ef2efd7a4a919e76818371144129)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:17.506243 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b906c5-8e07-4b3b-b88d-b69f715983a5 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:17.615854 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-49b906c5-8e07-4b3b-b88d-b69f715983a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4a6ef2efd7a4a919e76818371144129', 'request_id': 'req-49b906c5-8e07-4b3b-b88d-b69f715983a5'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:17.622468 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-49b906c5-8e07-4b3b-b88d-b69f715983a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4a6ef2efd7a4a919e76818371144129', 'request_id': 'req-49b906c5-8e07-4b3b-b88d-b69f715983a5'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:17.634420 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-49b906c5-8e07-4b3b-b88d-b69f715983a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4a6ef2efd7a4a919e76818371144129', 'request_id': 'req-49b906c5-8e07-4b3b-b88d-b69f715983a5'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:17.663059 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-49b906c5-8e07-4b3b-b88d-b69f715983a5 admin admin] The token cache is being invalidate because project b4a6ef2efd7a4a919e76818371144129 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:09:17.663429 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-49b906c5-8e07-4b3b-b88d-b69f715983a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:17.664333 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-49b906c5-8e07-4b3b-b88d-b69f715983a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:17.667476 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 836/1672] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:09:17 2022] DELETE /identity/v3/projects/b4a6ef2efd7a4a919e76818371144129 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:17.672563 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909ecdb-c5cd-47f0-9d1f-da13386012c5 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:17.673109 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909ecdb-c5cd-47f0-9d1f-da13386012c5 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:17.673204 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909ecdb-c5cd-47f0-9d1f-da13386012c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:17.743543 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-7909ecdb-c5cd-47f0-9d1f-da13386012c5 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:17.744855 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-7909ecdb-c5cd-47f0-9d1f-da13386012c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:17.886485 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 837/1673] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:09:17.894704 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17734609-6f46-4c37-babc-f1c4dee35cc4 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:17.895467 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17734609-6f46-4c37-babc-f1c4dee35cc4 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:17.895981 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17734609-6f46-4c37-babc-f1c4dee35cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:17.943489 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909ecdb-c5cd-47f0-9d1f-da13386012c5 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:17.945459 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-7909ecdb-c5cd-47f0-9d1f-da13386012c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:17.946634 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-17734609-6f46-4c37-babc-f1c4dee35cc4 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:17.953351 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-17734609-6f46-4c37-babc-f1c4dee35cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:17.965923 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909ecdb-c5cd-47f0-9d1f-da13386012c5 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:17.977541 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695d344-ad13-46a1-9474-c06a2350e35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:17.980161 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695d344-ad13-46a1-9474-c06a2350e35d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:17.980463 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695d344-ad13-46a1-9474-c06a2350e35d admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:17.982324 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695d344-ad13-46a1-9474-c06a2350e35d admin admin] PATH_INFO: `/v3/projects/3e97d1f0909345a18e41a584770c8642` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:17.984626 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695d344-ad13-46a1-9474-c06a2350e35d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e97d1f0909345a18e41a584770c8642)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:17.988723 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 837/1674] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:17.989869 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17734609-6f46-4c37-babc-f1c4dee35cc4 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:17.990779 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: WARNING py.warnings [None req-2695d344-ad13-46a1-9474-c06a2350e35d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 10 04:09:17.990779 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: warnings.warn(msg) Mar 10 04:09:17.990779 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: Mar 10 04:09:17.995449 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695d344-ad13-46a1-9474-c06a2350e35d admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:18.017109 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17734609-6f46-4c37-babc-f1c4dee35cc4 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:18.024992 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf4429-c8fc-48b3-9fe1-725ebca4710b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:18.026086 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf4429-c8fc-48b3-9fe1-725ebca4710b admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:18.026739 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf4429-c8fc-48b3-9fe1-725ebca4710b admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:18.027236 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf4429-c8fc-48b3-9fe1-725ebca4710b admin admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:18.029714 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf4429-c8fc-48b3-9fe1-725ebca4710b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:09:18.030271 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf4429-c8fc-48b3-9fe1-725ebca4710b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:18.032238 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf4429-c8fc-48b3-9fe1-725ebca4710b admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:18.060457 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 838/1675] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:09:18.062104 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf4429-c8fc-48b3-9fe1-725ebca4710b admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:18.076874 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf4429-c8fc-48b3-9fe1-725ebca4710b admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:18.083798 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062ecbb-fd55-4902-bf2f-12c69f7b7fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:18.084680 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062ecbb-fd55-4902-bf2f-12c69f7b7fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:18.085141 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062ecbb-fd55-4902-bf2f-12c69f7b7fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:18.087029 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062ecbb-fd55-4902-bf2f-12c69f7b7fd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:18.088168 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062ecbb-fd55-4902-bf2f-12c69f7b7fd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:18.091898 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062ecbb-fd55-4902-bf2f-12c69f7b7fd4 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:18.145512 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 839/1676] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:09:18 2022] POST /identity/v3/projects => generated 371 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:18.150706 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062ecbb-fd55-4902-bf2f-12c69f7b7fd4 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:18.162145 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-2695d344-ad13-46a1-9474-c06a2350e35d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e97d1f0909345a18e41a584770c8642', 'request_id': 'req-2695d344-ad13-46a1-9474-c06a2350e35d'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:18.179307 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-2695d344-ad13-46a1-9474-c06a2350e35d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e97d1f0909345a18e41a584770c8642', 'request_id': 'req-2695d344-ad13-46a1-9474-c06a2350e35d'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:18.230491 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-2695d344-ad13-46a1-9474-c06a2350e35d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e97d1f0909345a18e41a584770c8642', 'request_id': 'req-2695d344-ad13-46a1-9474-c06a2350e35d'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:18.259541 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-2695d344-ad13-46a1-9474-c06a2350e35d admin admin] The token cache is being invalidate because project 3e97d1f0909345a18e41a584770c8642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:09:18.260030 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-2695d344-ad13-46a1-9474-c06a2350e35d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:18.261095 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-2695d344-ad13-46a1-9474-c06a2350e35d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:18.263294 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 838/1677] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:09:17 2022] DELETE /identity/v3/projects/3e97d1f0909345a18e41a584770c8642 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:18.267045 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695d344-ad13-46a1-9474-c06a2350e35d admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:18.272273 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-2695d344-ad13-46a1-9474-c06a2350e35d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:18.288910 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062ecbb-fd55-4902-bf2f-12c69f7b7fd4 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:18.308045 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09caf9-a2b0-4fc3-b401-8ce57fe348c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:18.309963 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09caf9-a2b0-4fc3-b401-8ce57fe348c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:18.312618 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09caf9-a2b0-4fc3-b401-8ce57fe348c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:18.313056 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09caf9-a2b0-4fc3-b401-8ce57fe348c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:18.315452 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09caf9-a2b0-4fc3-b401-8ce57fe348c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:18.321387 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09caf9-a2b0-4fc3-b401-8ce57fe348c5 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:18.367661 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 840/1678] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:09:18 2022] POST /identity/v3/users => generated 286 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:18.369465 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09caf9-a2b0-4fc3-b401-8ce57fe348c5 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:18.374373 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-aa09caf9-a2b0-4fc3-b401-8ce57fe348c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:18.402454 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09caf9-a2b0-4fc3-b401-8ce57fe348c5 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:18.415643 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1718e-9d5e-4457-b5ac-bb672eb763d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:18.416532 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1718e-9d5e-4457-b5ac-bb672eb763d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:18.416912 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1718e-9d5e-4457-b5ac-bb672eb763d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:18.417289 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1718e-9d5e-4457-b5ac-bb672eb763d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:18.418178 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1718e-9d5e-4457-b5ac-bb672eb763d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:18.418446 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695d344-ad13-46a1-9474-c06a2350e35d admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:18.421396 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1718e-9d5e-4457-b5ac-bb672eb763d7 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:18.430332 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa44f9-bc28-4ae7-9048-42999c7a3a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:18.434393 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa44f9-bc28-4ae7-9048-42999c7a3a9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:18.434689 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa44f9-bc28-4ae7-9048-42999c7a3a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:18.435041 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa44f9-bc28-4ae7-9048-42999c7a3a9b admin admin] PATH_INFO: `/v3/users/b950a1958f7645d58447431f511f891b` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:18.442036 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa44f9-bc28-4ae7-9048-42999c7a3a9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b950a1958f7645d58447431f511f891b)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:18.445413 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa44f9-bc28-4ae7-9048-42999c7a3a9b admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:18.452122 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 841/1679] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:18.456030 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1718e-9d5e-4457-b5ac-bb672eb763d7 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:18.481413 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1718e-9d5e-4457-b5ac-bb672eb763d7 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:18.498665 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77875b78-1f60-4d09-b164-142155a3b004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:18.500918 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77875b78-1f60-4d09-b164-142155a3b004 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:18.502481 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77875b78-1f60-4d09-b164-142155a3b004 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:18.503072 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77875b78-1f60-4d09-b164-142155a3b004 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:18.504074 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77875b78-1f60-4d09-b164-142155a3b004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:18.511210 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77875b78-1f60-4d09-b164-142155a3b004 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:18.539803 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 842/1680] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:18.544175 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77875b78-1f60-4d09-b164-142155a3b004 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:18.559141 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77875b78-1f60-4d09-b164-142155a3b004 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:18.565248 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-f9fa44f9-bc28-4ae7-9048-42999c7a3a9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b950a1958f7645d58447431f511f891b'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:18.566047 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41032c35-cb3e-4dff-ae8d-f3a2562bd514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:18.567393 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41032c35-cb3e-4dff-ae8d-f3a2562bd514 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:18.567640 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41032c35-cb3e-4dff-ae8d-f3a2562bd514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:18.568189 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41032c35-cb3e-4dff-ae8d-f3a2562bd514 admin admin] PATH_INFO: `/v3/projects/509e067b04a84e45b51dfb3cd3e82bbc/users/b7710a417f7c40eb873297e568db1154/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:18.570197 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-f9fa44f9-bc28-4ae7-9048-42999c7a3a9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b950a1958f7645d58447431f511f891b'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:18.588943 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41032c35-cb3e-4dff-ae8d-f3a2562bd514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=509e067b04a84e45b51dfb3cd3e82bbc, user_id=b7710a417f7c40eb873297e568db1154, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:18.592793 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41032c35-cb3e-4dff-ae8d-f3a2562bd514 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:18.601882 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-f9fa44f9-bc28-4ae7-9048-42999c7a3a9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b950a1958f7645d58447431f511f891b'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:18.613037 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 843/1681] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:18 2022] PUT /identity/v3/projects/509e067b04a84e45b51dfb3cd3e82bbc/users/b7710a417f7c40eb873297e568db1154/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:18.629085 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aedbc6-ee9c-4bc0-8679-6148a1991c6a None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:18.629799 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aedbc6-ee9c-4bc0-8679-6148a1991c6a None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:18.630095 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aedbc6-ee9c-4bc0-8679-6148a1991c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:18.640469 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-f9fa44f9-bc28-4ae7-9048-42999c7a3a9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b950a1958f7645d58447431f511f891b'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:18.641217 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-f9fa44f9-bc28-4ae7-9048-42999c7a3a9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b950a1958f7645d58447431f511f891b'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:18.669083 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 839/1682] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:09:18 2022] DELETE /identity/v3/users/b950a1958f7645d58447431f511f891b => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:18.715583 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-19aedbc6-ee9c-4bc0-8679-6148a1991c6a None None] MFA Rules not processed for user `b7710a417f7c40eb873297e568db1154`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:18.717558 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-19aedbc6-ee9c-4bc0-8679-6148a1991c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:18.900974 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 844/1683] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:18.904674 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa44f9-bc28-4ae7-9048-42999c7a3a9b admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:18.906320 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-f9fa44f9-bc28-4ae7-9048-42999c7a3a9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:19.055000 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa44f9-bc28-4ae7-9048-42999c7a3a9b admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:19.070535 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe8d1d-901c-44af-856a-44f3f1c73522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:19.071223 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe8d1d-901c-44af-856a-44f3f1c73522 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:19.072799 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe8d1d-901c-44af-856a-44f3f1c73522 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:19.075736 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe8d1d-901c-44af-856a-44f3f1c73522 admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:19.077205 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe8d1d-901c-44af-856a-44f3f1c73522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:19.082571 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe8d1d-901c-44af-856a-44f3f1c73522 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:19.145677 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 840/1684] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:09:18 2022] POST /identity/v3/projects => generated 373 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:19.148476 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aedbc6-ee9c-4bc0-8679-6148a1991c6a None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:19.179645 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aedbc6-ee9c-4bc0-8679-6148a1991c6a None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:19.197341 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe8d1d-901c-44af-856a-44f3f1c73522 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:19.201667 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-d8fe8d1d-901c-44af-856a-44f3f1c73522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:19.427635 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe8d1d-901c-44af-856a-44f3f1c73522 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:19.439497 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fdc8e-2d29-4ee3-8240-81a988d71725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:19.440216 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fdc8e-2d29-4ee3-8240-81a988d71725 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:19.440501 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fdc8e-2d29-4ee3-8240-81a988d71725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:19.440779 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fdc8e-2d29-4ee3-8240-81a988d71725 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:19.441477 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1fdc8e-2d29-4ee3-8240-81a988d71725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:19.447298 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b4f14-c7e1-484e-8b70-ab48374788d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:19.448228 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b4f14-c7e1-484e-8b70-ab48374788d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:19.448507 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b4f14-c7e1-484e-8b70-ab48374788d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:19.448780 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b4f14-c7e1-484e-8b70-ab48374788d4 admin admin] PATH_INFO: `/v3/users/c9d6bda7a7ac4f01962f2f9ca72fd71b` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:19.450052 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1fdc8e-2d29-4ee3-8240-81a988d71725 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:19.457879 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b4f14-c7e1-484e-8b70-ab48374788d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9d6bda7a7ac4f01962f2f9ca72fd71b)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:19.461317 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b4f14-c7e1-484e-8b70-ab48374788d4 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:19.517835 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 845/1685] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:09:19 2022] POST /identity/v3/users => generated 293 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:19.520904 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fdc8e-2d29-4ee3-8240-81a988d71725 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:19.562698 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fdc8e-2d29-4ee3-8240-81a988d71725 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:19.605494 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-f30b4f14-c7e1-484e-8b70-ab48374788d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9d6bda7a7ac4f01962f2f9ca72fd71b'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:19.606356 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-f30b4f14-c7e1-484e-8b70-ab48374788d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9d6bda7a7ac4f01962f2f9ca72fd71b'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:19.609899 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a31da-a108-4578-8a2f-4e82a34ad13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:19.613484 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a31da-a108-4578-8a2f-4e82a34ad13f admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:19.614022 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a31da-a108-4578-8a2f-4e82a34ad13f admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:19.615562 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a31da-a108-4578-8a2f-4e82a34ad13f admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:19.617108 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a31da-a108-4578-8a2f-4e82a34ad13f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:19.625682 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a31da-a108-4578-8a2f-4e82a34ad13f admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:19.628037 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-f30b4f14-c7e1-484e-8b70-ab48374788d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9d6bda7a7ac4f01962f2f9ca72fd71b'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:19.668568 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-f30b4f14-c7e1-484e-8b70-ab48374788d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9d6bda7a7ac4f01962f2f9ca72fd71b'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:19.679147 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 846/1686] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:19.679324 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-f30b4f14-c7e1-484e-8b70-ab48374788d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9d6bda7a7ac4f01962f2f9ca72fd71b'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:19.679421 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a31da-a108-4578-8a2f-4e82a34ad13f admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:19.683033 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-4d4a31da-a108-4578-8a2f-4e82a34ad13f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:19.722469 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 841/1687] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:09:19 2022] DELETE /identity/v3/users/c9d6bda7a7ac4f01962f2f9ca72fd71b => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:19.724208 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1823f-a49e-4ab9-b6a6-2f322f3dffe6 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:19.724502 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1823f-a49e-4ab9-b6a6-2f322f3dffe6 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:19.724779 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1823f-a49e-4ab9-b6a6-2f322f3dffe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:19.742972 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a31da-a108-4578-8a2f-4e82a34ad13f admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:19.804081 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-1df1823f-a49e-4ab9-b6a6-2f322f3dffe6 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:19.811556 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-1df1823f-a49e-4ab9-b6a6-2f322f3dffe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:19.987092 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c439e-7b63-403e-ae71-e50ed9339b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:19.991158 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c439e-7b63-403e-ae71-e50ed9339b54 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:19.991625 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c439e-7b63-403e-ae71-e50ed9339b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:19.992096 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c439e-7b63-403e-ae71-e50ed9339b54 admin admin] PATH_INFO: `/v3/projects/9f5722ad62c3411d8892c59dd8c2a3c1/users/f4337a25124a441296a07f71dfab92cc/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:20.038375 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c439e-7b63-403e-ae71-e50ed9339b54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f5722ad62c3411d8892c59dd8c2a3c1, user_id=f4337a25124a441296a07f71dfab92cc, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:20.046220 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c439e-7b63-403e-ae71-e50ed9339b54 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:20.056144 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 842/1688] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:20.060001 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0202c1-d59f-4c16-a360-b5fe7e105cd1 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:20.063197 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0202c1-d59f-4c16-a360-b5fe7e105cd1 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:20.063903 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0202c1-d59f-4c16-a360-b5fe7e105cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:20.089258 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 847/1689] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:19 2022] PUT /identity/v3/projects/9f5722ad62c3411d8892c59dd8c2a3c1/users/f4337a25124a441296a07f71dfab92cc/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:20.098551 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c439e-7b63-403e-ae71-e50ed9339b54 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:20.108920 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-3f7c439e-7b63-403e-ae71-e50ed9339b54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:20.176774 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-da0202c1-d59f-4c16-a360-b5fe7e105cd1 None None] MFA Rules not processed for user `af9aa388314f4cfca823c8d13f67a8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:20.178483 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-da0202c1-d59f-4c16-a360-b5fe7e105cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:20.214500 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c439e-7b63-403e-ae71-e50ed9339b54 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:20.228367 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2421b3a-6952-45fa-90e2-0fd85d270400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:20.229111 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2421b3a-6952-45fa-90e2-0fd85d270400 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:20.229387 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2421b3a-6952-45fa-90e2-0fd85d270400 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:20.229572 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2421b3a-6952-45fa-90e2-0fd85d270400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:20.371060 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 843/1690] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:20.372226 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0202c1-d59f-4c16-a360-b5fe7e105cd1 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:20.403010 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2421b3a-6952-45fa-90e2-0fd85d270400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:20.405169 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0202c1-d59f-4c16-a360-b5fe7e105cd1 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:20.405803 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2421b3a-6952-45fa-90e2-0fd85d270400 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:20.420089 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 848/1691] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:20.422895 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45bb4c-6e3a-40d0-85d2-378f4711806f None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:20.423376 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45bb4c-6e3a-40d0-85d2-378f4711806f None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:20.423906 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45bb4c-6e3a-40d0-85d2-378f4711806f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:20.425923 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6828c-727c-4866-9798-57f53a18f3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:20.426543 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6828c-727c-4866-9798-57f53a18f3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:20.426825 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6828c-727c-4866-9798-57f53a18f3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:20.427179 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6828c-727c-4866-9798-57f53a18f3d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:20.427853 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f6828c-727c-4866-9798-57f53a18f3d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:20.429458 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f6828c-727c-4866-9798-57f53a18f3d8 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:20.463669 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 844/1692] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:20.464720 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6828c-727c-4866-9798-57f53a18f3d8 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:20.471266 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-12f6828c-727c-4866-9798-57f53a18f3d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:20.484075 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-0a45bb4c-6e3a-40d0-85d2-378f4711806f None None] MFA Rules not processed for user `7eb560db53cd4af192bb82abdfad3590`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:20.491842 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-0a45bb4c-6e3a-40d0-85d2-378f4711806f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:20.661793 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f6828c-727c-4866-9798-57f53a18f3d8 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:20.672490 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64469a31-7da6-4ebe-88bf-de52f12dc193 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:20.678894 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64469a31-7da6-4ebe-88bf-de52f12dc193 service nova] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:20.679481 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64469a31-7da6-4ebe-88bf-de52f12dc193 service nova] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:20.679974 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64469a31-7da6-4ebe-88bf-de52f12dc193 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:20.704331 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64469a31-7da6-4ebe-88bf-de52f12dc193 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:20.707047 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64469a31-7da6-4ebe-88bf-de52f12dc193 service nova] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:20.711296 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 849/1693] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Mar 10 04:09:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:20.712190 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45bb4c-6e3a-40d0-85d2-378f4711806f None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:20.716125 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-0a45bb4c-6e3a-40d0-85d2-378f4711806f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:20.731559 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 845/1694] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:20.733736 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64469a31-7da6-4ebe-88bf-de52f12dc193 service nova] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:20.743585 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45bb4c-6e3a-40d0-85d2-378f4711806f None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:20.760702 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64469a31-7da6-4ebe-88bf-de52f12dc193 service nova] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:20.760841 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf01189-23cc-4e17-a2ce-98c9d4895401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:20.761706 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf01189-23cc-4e17-a2ce-98c9d4895401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:20.761989 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf01189-23cc-4e17-a2ce-98c9d4895401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:20.762262 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf01189-23cc-4e17-a2ce-98c9d4895401 admin admin] PATH_INFO: `/v3/projects/45df59a4f62e4363a10c0d5751e09e30` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:20.767729 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf01189-23cc-4e17-a2ce-98c9d4895401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45df59a4f62e4363a10c0d5751e09e30)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:20.770571 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf01189-23cc-4e17-a2ce-98c9d4895401 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:20.778899 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a2550-1a56-4da7-9e35-544394f27138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:20.779983 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a2550-1a56-4da7-9e35-544394f27138 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:20.780365 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a2550-1a56-4da7-9e35-544394f27138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:20.781799 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a2550-1a56-4da7-9e35-544394f27138 admin admin] PATH_INFO: `/v3/projects/9f5722ad62c3411d8892c59dd8c2a3c1/users/f4337a25124a441296a07f71dfab92cc/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:20.788087 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a2550-1a56-4da7-9e35-544394f27138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f5722ad62c3411d8892c59dd8c2a3c1, user_id=f4337a25124a441296a07f71dfab92cc, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:20.799235 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a2550-1a56-4da7-9e35-544394f27138 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:20.846941 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 846/1695] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:20 2022] PUT /identity/v3/projects/9f5722ad62c3411d8892c59dd8c2a3c1/users/f4337a25124a441296a07f71dfab92cc/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:20.849233 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6d513-799e-4e07-9ef1-bcc1b698a69f None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:20.849526 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6d513-799e-4e07-9ef1-bcc1b698a69f None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:20.849807 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b6d513-799e-4e07-9ef1-bcc1b698a69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:20.901962 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-7cf01189-23cc-4e17-a2ce-98c9d4895401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45df59a4f62e4363a10c0d5751e09e30', 'request_id': 'req-7cf01189-23cc-4e17-a2ce-98c9d4895401'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:20.916922 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-7cf01189-23cc-4e17-a2ce-98c9d4895401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45df59a4f62e4363a10c0d5751e09e30', 'request_id': 'req-7cf01189-23cc-4e17-a2ce-98c9d4895401'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:20.960809 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-7cf01189-23cc-4e17-a2ce-98c9d4895401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45df59a4f62e4363a10c0d5751e09e30', 'request_id': 'req-7cf01189-23cc-4e17-a2ce-98c9d4895401'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:20.973050 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-12b6d513-799e-4e07-9ef1-bcc1b698a69f None None] MFA Rules not processed for user `b96ee0c3a9e44e14bf62619829b0acd9`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:20.978865 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-12b6d513-799e-4e07-9ef1-bcc1b698a69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:20.981505 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-7cf01189-23cc-4e17-a2ce-98c9d4895401 admin admin] The token cache is being invalidate because project 45df59a4f62e4363a10c0d5751e09e30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:09:20.981792 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-7cf01189-23cc-4e17-a2ce-98c9d4895401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:20.991147 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-7cf01189-23cc-4e17-a2ce-98c9d4895401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:20.994989 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 850/1696] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:09:20 2022] DELETE /identity/v3/projects/45df59a4f62e4363a10c0d5751e09e30 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:20.999737 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1facb-0023-463b-8d83-d00ac78430e4 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:21.000042 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1facb-0023-463b-8d83-d00ac78430e4 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:21.000340 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1facb-0023-463b-8d83-d00ac78430e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:21.050448 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-4ed1facb-0023-463b-8d83-d00ac78430e4 None None] MFA Rules not processed for user `f4337a25124a441296a07f71dfab92cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:21.051657 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-4ed1facb-0023-463b-8d83-d00ac78430e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:21.164900 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 851/1697] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:20 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:21.167173 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a0e17-9790-415e-9e6a-6dd164d4bc16 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:21.167624 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a0e17-9790-415e-9e6a-6dd164d4bc16 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:21.169147 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a0e17-9790-415e-9e6a-6dd164d4bc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:21.203848 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-bd2a0e17-9790-415e-9e6a-6dd164d4bc16 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:21.205611 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-bd2a0e17-9790-415e-9e6a-6dd164d4bc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:21.310047 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 847/1698] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:21.311675 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6d513-799e-4e07-9ef1-bcc1b698a69f None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:21.316937 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-12b6d513-799e-4e07-9ef1-bcc1b698a69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:21.369068 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 852/1699] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:21.377074 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a0e17-9790-415e-9e6a-6dd164d4bc16 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:21.387585 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-bd2a0e17-9790-415e-9e6a-6dd164d4bc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:21.575952 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b6d513-799e-4e07-9ef1-bcc1b698a69f None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:21.577646 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a0e17-9790-415e-9e6a-6dd164d4bc16 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:21.584431 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea492c-a8dd-4065-a0ca-09f0deb9e512 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260f561c676b4d049553eac4626b5502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:21.585164 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea492c-a8dd-4065-a0ca-09f0deb9e512 service swift] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:21.585625 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea492c-a8dd-4065-a0ca-09f0deb9e512 service swift] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:21.585972 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea492c-a8dd-4065-a0ca-09f0deb9e512 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:21.592043 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394a1b1-fcc9-4bac-a035-e4045dd37ec2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:21.592750 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394a1b1-fcc9-4bac-a035-e4045dd37ec2 service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:21.593031 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394a1b1-fcc9-4bac-a035-e4045dd37ec2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:21.593302 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394a1b1-fcc9-4bac-a035-e4045dd37ec2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:21.601791 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-6eea492c-a8dd-4065-a0ca-09f0deb9e512 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:21.631927 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394a1b1-fcc9-4bac-a035-e4045dd37ec2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:21.637229 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394a1b1-fcc9-4bac-a035-e4045dd37ec2 service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:21.651449 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 853/1700] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:21.652894 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e11284-257c-4c2d-b8c5-ab1a099a15cc None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:21.653192 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e11284-257c-4c2d-b8c5-ab1a099a15cc None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:21.653482 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e11284-257c-4c2d-b8c5-ab1a099a15cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:21.720417 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-51e11284-257c-4c2d-b8c5-ab1a099a15cc None None] MFA Rules not processed for user `b96ee0c3a9e44e14bf62619829b0acd9`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:21.721872 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-51e11284-257c-4c2d-b8c5-ab1a099a15cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:21.731502 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 854/1701] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:21.737557 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15304edc-6fbb-4275-ac38-4a098f4c15e6 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:21.739657 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15304edc-6fbb-4275-ac38-4a098f4c15e6 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:21.739804 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15304edc-6fbb-4275-ac38-4a098f4c15e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:21.806069 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-15304edc-6fbb-4275-ac38-4a098f4c15e6 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:21.811550 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-15304edc-6fbb-4275-ac38-4a098f4c15e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:21.848738 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 855/1702] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:21.850071 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15304edc-6fbb-4275-ac38-4a098f4c15e6 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:21.855791 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea492c-a8dd-4065-a0ca-09f0deb9e512 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:21.856830 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-15304edc-6fbb-4275-ac38-4a098f4c15e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:21.862263 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea492c-a8dd-4065-a0ca-09f0deb9e512 service swift] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:21.906439 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 848/1703] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Mar 10 04:09:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 10 04:09:21.910597 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea492c-a8dd-4065-a0ca-09f0deb9e512 service swift] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:21.912650 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-6eea492c-a8dd-4065-a0ca-09f0deb9e512 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:21.915351 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15304edc-6fbb-4275-ac38-4a098f4c15e6 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:21.923633 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e07ff3-8712-4c0e-8130-ecc5b71dfe5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:21.925223 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e07ff3-8712-4c0e-8130-ecc5b71dfe5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:21.925701 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e07ff3-8712-4c0e-8130-ecc5b71dfe5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:21.926110 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e07ff3-8712-4c0e-8130-ecc5b71dfe5b admin admin] PATH_INFO: `/v3/projects/3eca265def914237bde319b10918c2f9` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:21.928059 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e07ff3-8712-4c0e-8130-ecc5b71dfe5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eca265def914237bde319b10918c2f9)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:21.930991 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e07ff3-8712-4c0e-8130-ecc5b71dfe5b admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:22.022261 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-f8e07ff3-8712-4c0e-8130-ecc5b71dfe5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eca265def914237bde319b10918c2f9', 'request_id': 'req-f8e07ff3-8712-4c0e-8130-ecc5b71dfe5b'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:22.034536 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-f8e07ff3-8712-4c0e-8130-ecc5b71dfe5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eca265def914237bde319b10918c2f9', 'request_id': 'req-f8e07ff3-8712-4c0e-8130-ecc5b71dfe5b'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:22.054089 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-f8e07ff3-8712-4c0e-8130-ecc5b71dfe5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eca265def914237bde319b10918c2f9', 'request_id': 'req-f8e07ff3-8712-4c0e-8130-ecc5b71dfe5b'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:22.084100 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-f8e07ff3-8712-4c0e-8130-ecc5b71dfe5b admin admin] The token cache is being invalidate because project 3eca265def914237bde319b10918c2f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:09:22.084100 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-f8e07ff3-8712-4c0e-8130-ecc5b71dfe5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:22.108219 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-f8e07ff3-8712-4c0e-8130-ecc5b71dfe5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:22.120740 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 856/1704] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:09:21 2022] DELETE /identity/v3/projects/3eca265def914237bde319b10918c2f9 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:22.120740 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e07ff3-8712-4c0e-8130-ecc5b71dfe5b admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:22.123043 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-f8e07ff3-8712-4c0e-8130-ecc5b71dfe5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:22.155932 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea492c-a8dd-4065-a0ca-09f0deb9e512 service swift] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:22.294275 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93574a8f-e1b9-4698-9a5a-2448fb3f3f59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:22.295119 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93574a8f-e1b9-4698-9a5a-2448fb3f3f59 service nova] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:22.295574 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93574a8f-e1b9-4698-9a5a-2448fb3f3f59 service nova] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:22.296056 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93574a8f-e1b9-4698-9a5a-2448fb3f3f59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:22.298724 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-93574a8f-e1b9-4698-9a5a-2448fb3f3f59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:22.410982 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e07ff3-8712-4c0e-8130-ecc5b71dfe5b admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:22.424454 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49694a34-ebf7-4abd-8394-459748b14a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:22.425376 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49694a34-ebf7-4abd-8394-459748b14a87 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:22.425761 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49694a34-ebf7-4abd-8394-459748b14a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:22.426181 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49694a34-ebf7-4abd-8394-459748b14a87 admin admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:22.427013 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49694a34-ebf7-4abd-8394-459748b14a87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:09:22.428684 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49694a34-ebf7-4abd-8394-459748b14a87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:22.431522 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49694a34-ebf7-4abd-8394-459748b14a87 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:22.448685 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93574a8f-e1b9-4698-9a5a-2448fb3f3f59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:22.454066 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93574a8f-e1b9-4698-9a5a-2448fb3f3f59 service nova] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:22.464608 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 857/1705] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:09:22.465756 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49694a34-ebf7-4abd-8394-459748b14a87 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:22.470969 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-49694a34-ebf7-4abd-8394-459748b14a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:22.498285 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49694a34-ebf7-4abd-8394-459748b14a87 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:22.501693 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 849/1706] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:22.502679 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93574a8f-e1b9-4698-9a5a-2448fb3f3f59 service nova] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:22.513908 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590036f0-8691-4ca4-8164-3c98817125ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:22.515219 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590036f0-8691-4ca4-8164-3c98817125ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:22.515747 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590036f0-8691-4ca4-8164-3c98817125ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:22.516304 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590036f0-8691-4ca4-8164-3c98817125ff admin admin] PATH_INFO: `/v3/users/e60f4d9b038644efaa7379a6351726c0` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:22.520669 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590036f0-8691-4ca4-8164-3c98817125ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=e60f4d9b038644efaa7379a6351726c0)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:22.524921 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590036f0-8691-4ca4-8164-3c98817125ff admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:22.533685 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93574a8f-e1b9-4698-9a5a-2448fb3f3f59 service nova] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:22.559056 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d751bb9-434f-487e-9253-7b95293b1e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:22.559983 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d751bb9-434f-487e-9253-7b95293b1e42 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:22.560274 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d751bb9-434f-487e-9253-7b95293b1e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:22.560717 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d751bb9-434f-487e-9253-7b95293b1e42 admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:22.561529 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d751bb9-434f-487e-9253-7b95293b1e42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:22.567778 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d751bb9-434f-487e-9253-7b95293b1e42 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:22.683549 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 850/1707] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:09:22 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:22.684855 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d751bb9-434f-487e-9253-7b95293b1e42 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:22.717987 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-590036f0-8691-4ca4-8164-3c98817125ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e60f4d9b038644efaa7379a6351726c0'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:22.747789 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-590036f0-8691-4ca4-8164-3c98817125ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e60f4d9b038644efaa7379a6351726c0'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:22.784984 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-590036f0-8691-4ca4-8164-3c98817125ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e60f4d9b038644efaa7379a6351726c0'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:22.832692 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-590036f0-8691-4ca4-8164-3c98817125ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e60f4d9b038644efaa7379a6351726c0'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:22.834440 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-590036f0-8691-4ca4-8164-3c98817125ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e60f4d9b038644efaa7379a6351726c0'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:22.861452 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 858/1708] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:09:22 2022] DELETE /identity/v3/users/e60f4d9b038644efaa7379a6351726c0 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:22.862391 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590036f0-8691-4ca4-8164-3c98817125ff admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:22.872635 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-590036f0-8691-4ca4-8164-3c98817125ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:22.907236 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d751bb9-434f-487e-9253-7b95293b1e42 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:23.106970 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f656cb0-465f-405d-9b14-7d8309c7724b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:23.107676 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f656cb0-465f-405d-9b14-7d8309c7724b admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:23.117305 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f656cb0-465f-405d-9b14-7d8309c7724b admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:23.117658 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f656cb0-465f-405d-9b14-7d8309c7724b admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:23.122044 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f656cb0-465f-405d-9b14-7d8309c7724b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:23.128388 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f656cb0-465f-405d-9b14-7d8309c7724b admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:23.187936 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 851/1709] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:09:22 2022] POST /identity/v3/users => generated 293 bytes in 504 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:23.190715 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f656cb0-465f-405d-9b14-7d8309c7724b admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:23.194412 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590036f0-8691-4ca4-8164-3c98817125ff admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:23.205027 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-1f656cb0-465f-405d-9b14-7d8309c7724b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:23.214245 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b208d5e-9e38-4792-b6f5-fa471f077a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:23.216846 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b208d5e-9e38-4792-b6f5-fa471f077a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:23.217161 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b208d5e-9e38-4792-b6f5-fa471f077a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:23.217446 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b208d5e-9e38-4792-b6f5-fa471f077a40 admin admin] PATH_INFO: `/v3/users/b7710a417f7c40eb873297e568db1154` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:23.225858 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b208d5e-9e38-4792-b6f5-fa471f077a40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7710a417f7c40eb873297e568db1154)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:23.233553 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b208d5e-9e38-4792-b6f5-fa471f077a40 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:23.237214 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f656cb0-465f-405d-9b14-7d8309c7724b admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:23.257225 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40038900-4a10-4022-9e9f-59276c4b9288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:23.258748 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40038900-4a10-4022-9e9f-59276c4b9288 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:23.259034 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40038900-4a10-4022-9e9f-59276c4b9288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:23.259310 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40038900-4a10-4022-9e9f-59276c4b9288 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:23.260076 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40038900-4a10-4022-9e9f-59276c4b9288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:23.261889 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40038900-4a10-4022-9e9f-59276c4b9288 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:23.328686 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 852/1710] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:23.330918 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40038900-4a10-4022-9e9f-59276c4b9288 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:23.354861 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40038900-4a10-4022-9e9f-59276c4b9288 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:23.373519 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b09dd-f895-4325-bbb0-d0570ad74429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:23.374394 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b09dd-f895-4325-bbb0-d0570ad74429 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:23.374659 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b09dd-f895-4325-bbb0-d0570ad74429 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:23.374985 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b09dd-f895-4325-bbb0-d0570ad74429 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:23.376960 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b09dd-f895-4325-bbb0-d0570ad74429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:23.379225 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b09dd-f895-4325-bbb0-d0570ad74429 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:23.399742 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 853/1711] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:09:23.402979 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b09dd-f895-4325-bbb0-d0570ad74429 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:23.405611 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-0b208d5e-9e38-4792-b6f5-fa471f077a40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7710a417f7c40eb873297e568db1154'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:23.420783 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b09dd-f895-4325-bbb0-d0570ad74429 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:23.429152 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-0b208d5e-9e38-4792-b6f5-fa471f077a40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7710a417f7c40eb873297e568db1154'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:23.453346 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-0b208d5e-9e38-4792-b6f5-fa471f077a40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7710a417f7c40eb873297e568db1154'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:23.464426 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57093e03-7d26-4f18-b392-acecfa6a7cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:23.465409 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57093e03-7d26-4f18-b392-acecfa6a7cc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:23.465691 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57093e03-7d26-4f18-b392-acecfa6a7cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:23.465968 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57093e03-7d26-4f18-b392-acecfa6a7cc5 admin admin] PATH_INFO: `/v3/projects/ab168829d0024e52b70496329d2c8758/users/ea007c262b554631b2d5ab500b3e0879/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:23.490384 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-0b208d5e-9e38-4792-b6f5-fa471f077a40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7710a417f7c40eb873297e568db1154'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:23.494158 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-0b208d5e-9e38-4792-b6f5-fa471f077a40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7710a417f7c40eb873297e568db1154'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:23.503628 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57093e03-7d26-4f18-b392-acecfa6a7cc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab168829d0024e52b70496329d2c8758, user_id=ea007c262b554631b2d5ab500b3e0879, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:23.506820 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57093e03-7d26-4f18-b392-acecfa6a7cc5 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:23.508645 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 859/1712] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:09:22 2022] DELETE /identity/v3/users/b7710a417f7c40eb873297e568db1154 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:23.514936 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a4906-136c-452f-beda-c10980b63861 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:23.515231 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a4906-136c-452f-beda-c10980b63861 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:23.515850 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a4906-136c-452f-beda-c10980b63861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:23.540953 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 854/1713] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:23 2022] PUT /identity/v3/projects/ab168829d0024e52b70496329d2c8758/users/ea007c262b554631b2d5ab500b3e0879/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:09:23.561522 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031def15-07a7-493d-944f-a6fc5c1175c0 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:23.562003 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031def15-07a7-493d-944f-a6fc5c1175c0 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:23.562358 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031def15-07a7-493d-944f-a6fc5c1175c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:23.610968 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-937a4906-136c-452f-beda-c10980b63861 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:23.613026 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-937a4906-136c-452f-beda-c10980b63861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:23.677887 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-031def15-07a7-493d-944f-a6fc5c1175c0 None None] MFA Rules not processed for user `ea007c262b554631b2d5ab500b3e0879`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:23.685738 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-031def15-07a7-493d-944f-a6fc5c1175c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:23.879182 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 855/1714] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:23.888111 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031def15-07a7-493d-944f-a6fc5c1175c0 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:23.898971 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-031def15-07a7-493d-944f-a6fc5c1175c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:23.912660 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 860/1715] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:23.961443 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031def15-07a7-493d-944f-a6fc5c1175c0 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:23.989480 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd831d55-2536-400f-8f78-8f9b62d02c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:23.990327 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd831d55-2536-400f-8f78-8f9b62d02c70 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:23.990734 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd831d55-2536-400f-8f78-8f9b62d02c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:23.992241 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd831d55-2536-400f-8f78-8f9b62d02c70 admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:23.992241 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd831d55-2536-400f-8f78-8f9b62d02c70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:23.996005 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd831d55-2536-400f-8f78-8f9b62d02c70 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:24.055034 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a4906-136c-452f-beda-c10980b63861 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:24.056512 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-937a4906-136c-452f-beda-c10980b63861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:24.129791 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 856/1716] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:09:23 2022] POST /identity/v3/projects => generated 387 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:24.140995 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd831d55-2536-400f-8f78-8f9b62d02c70 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:24.319130 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a4906-136c-452f-beda-c10980b63861 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:24.456132 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd831d55-2536-400f-8f78-8f9b62d02c70 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:24.483820 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0817be-5870-4630-87a0-4a39bafd4cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:24.485052 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0817be-5870-4630-87a0-4a39bafd4cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:24.485616 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0817be-5870-4630-87a0-4a39bafd4cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:24.487908 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0817be-5870-4630-87a0-4a39bafd4cf8 admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:24.488818 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0817be-5870-4630-87a0-4a39bafd4cf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:24.490900 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0817be-5870-4630-87a0-4a39bafd4cf8 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:24.560539 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e52ea-7ffe-40de-acab-545755c60cf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:24.561436 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e52ea-7ffe-40de-acab-545755c60cf9 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:24.562489 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e52ea-7ffe-40de-acab-545755c60cf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:24.562946 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e52ea-7ffe-40de-acab-545755c60cf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:24.575096 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 857/1717] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:09:24 2022] POST /identity/v3/users => generated 300 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:24.588730 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0817be-5870-4630-87a0-4a39bafd4cf8 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:24.609246 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e52ea-7ffe-40de-acab-545755c60cf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:24.611209 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0817be-5870-4630-87a0-4a39bafd4cf8 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:24.613393 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e52ea-7ffe-40de-acab-545755c60cf9 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:24.653382 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb0797-c0b0-490f-b082-0c696e9a7ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:24.654178 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb0797-c0b0-490f-b082-0c696e9a7ebc admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:24.655807 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb0797-c0b0-490f-b082-0c696e9a7ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:24.656297 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb0797-c0b0-490f-b082-0c696e9a7ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:24.658839 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb0797-c0b0-490f-b082-0c696e9a7ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:24.661677 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb0797-c0b0-490f-b082-0c696e9a7ebc admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:24.684775 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 861/1718] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:24.688860 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402d857-50f3-4e71-9f2e-ed707d1a60dd None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:24.691807 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402d857-50f3-4e71-9f2e-ed707d1a60dd None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:24.692276 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402d857-50f3-4e71-9f2e-ed707d1a60dd None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:24.701285 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 862/1719] 10.222.0.15 () {54 vars in 912 bytes} [Thu Mar 10 04:09:24 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:09:24.709142 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca4664-cb6d-4740-8bb0-4a7616a641a4 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:24.709697 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca4664-cb6d-4740-8bb0-4a7616a641a4 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:24.710144 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca4664-cb6d-4740-8bb0-4a7616a641a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:24.713772 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 858/1720] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:24.716406 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb0797-c0b0-490f-b082-0c696e9a7ebc admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:24.761187 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb0797-c0b0-490f-b082-0c696e9a7ebc admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:24.779988 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61b68d-d3a1-40f0-adf3-f8618207351d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:24.780905 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61b68d-d3a1-40f0-adf3-f8618207351d admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:24.784704 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61b68d-d3a1-40f0-adf3-f8618207351d admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:24.785084 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61b68d-d3a1-40f0-adf3-f8618207351d admin admin] PATH_INFO: `/v3/projects/2e00631e3a8c451191942eda4921cd1a/users/0da895c7d53f46f28d7aaacdd702ee97/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:24.793558 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-6cca4664-cb6d-4740-8bb0-4a7616a641a4 None None] MFA Rules not processed for user `2faf262ae9d643c0b8708dcfecd75b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:24.796467 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-6cca4664-cb6d-4740-8bb0-4a7616a641a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:24.813563 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 863/1721] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Mar 10 04:09:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:09:24.843964 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca4664-cb6d-4740-8bb0-4a7616a641a4 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:24.845645 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc61b68d-d3a1-40f0-adf3-f8618207351d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e00631e3a8c451191942eda4921cd1a, user_id=0da895c7d53f46f28d7aaacdd702ee97, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:24.846111 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-6cca4664-cb6d-4740-8bb0-4a7616a641a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:24.853899 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc61b68d-d3a1-40f0-adf3-f8618207351d admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:24.885653 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca4664-cb6d-4740-8bb0-4a7616a641a4 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:24.900651 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63527f3-e926-4fa7-9200-34288dd62e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:24.901535 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63527f3-e926-4fa7-9200-34288dd62e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:24.901830 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63527f3-e926-4fa7-9200-34288dd62e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:24.902198 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63527f3-e926-4fa7-9200-34288dd62e05 admin admin] PATH_INFO: `/v3/projects/1766f5f6f89948d38f6e979b7271536a` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:24.903711 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63527f3-e926-4fa7-9200-34288dd62e05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1766f5f6f89948d38f6e979b7271536a)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:24.908875 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63527f3-e926-4fa7-9200-34288dd62e05 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:24.931423 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 859/1722] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:24 2022] PUT /identity/v3/projects/2e00631e3a8c451191942eda4921cd1a/users/0da895c7d53f46f28d7aaacdd702ee97/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:24.939539 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61b68d-d3a1-40f0-adf3-f8618207351d admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:25.057229 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b63527f3-e926-4fa7-9200-34288dd62e05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1766f5f6f89948d38f6e979b7271536a', 'request_id': 'req-b63527f3-e926-4fa7-9200-34288dd62e05'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:25.070379 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b63527f3-e926-4fa7-9200-34288dd62e05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1766f5f6f89948d38f6e979b7271536a', 'request_id': 'req-b63527f3-e926-4fa7-9200-34288dd62e05'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:25.080694 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b63527f3-e926-4fa7-9200-34288dd62e05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1766f5f6f89948d38f6e979b7271536a', 'request_id': 'req-b63527f3-e926-4fa7-9200-34288dd62e05'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:25.096375 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61b68d-d3a1-40f0-adf3-f8618207351d admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:25.120654 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b63527f3-e926-4fa7-9200-34288dd62e05 admin admin] The token cache is being invalidate because project 1766f5f6f89948d38f6e979b7271536a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:09:25.121699 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b63527f3-e926-4fa7-9200-34288dd62e05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:25.126838 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b63527f3-e926-4fa7-9200-34288dd62e05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:25.146404 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 864/1723] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:09:24 2022] DELETE /identity/v3/projects/1766f5f6f89948d38f6e979b7271536a => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:25.147376 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63527f3-e926-4fa7-9200-34288dd62e05 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:25.149159 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-b63527f3-e926-4fa7-9200-34288dd62e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:25.324588 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63527f3-e926-4fa7-9200-34288dd62e05 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:25.332758 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bcdad0-a42e-4d94-b1a6-51a3ecec4356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:25.333457 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcdad0-a42e-4d94-b1a6-51a3ecec4356 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:25.334022 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fcb07-8986-44ac-b766-79ae6168cefa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:25.334853 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fcb07-8986-44ac-b766-79ae6168cefa service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:25.335747 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fcb07-8986-44ac-b766-79ae6168cefa service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:25.336129 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fcb07-8986-44ac-b766-79ae6168cefa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:25.338686 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcdad0-a42e-4d94-b1a6-51a3ecec4356 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:25.339047 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcdad0-a42e-4d94-b1a6-51a3ecec4356 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:25.342505 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bcdad0-a42e-4d94-b1a6-51a3ecec4356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:25.344193 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bcdad0-a42e-4d94-b1a6-51a3ecec4356 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:25.351317 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-de9fcb07-8986-44ac-b766-79ae6168cefa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:25.411353 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fcb07-8986-44ac-b766-79ae6168cefa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:25.411525 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 860/1724] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 473 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:25.411618 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fcb07-8986-44ac-b766-79ae6168cefa service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:25.415409 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900972b-a8c2-45c8-a6ce-7b4ad9603142 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:25.415774 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900972b-a8c2-45c8-a6ce-7b4ad9603142 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:25.416061 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900972b-a8c2-45c8-a6ce-7b4ad9603142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:25.444502 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 865/1725] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:25.445454 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fcb07-8986-44ac-b766-79ae6168cefa service neutron] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:25.449097 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-de9fcb07-8986-44ac-b766-79ae6168cefa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:25.500851 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fcb07-8986-44ac-b766-79ae6168cefa service neutron] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:25.502814 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-f900972b-a8c2-45c8-a6ce-7b4ad9603142 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:25.508249 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-f900972b-a8c2-45c8-a6ce-7b4ad9603142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:25.510283 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c5103-1003-4b37-89d0-1c010239c36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:25.513168 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c5103-1003-4b37-89d0-1c010239c36f admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:25.513631 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c5103-1003-4b37-89d0-1c010239c36f admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:25.514622 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c5103-1003-4b37-89d0-1c010239c36f admin admin] PATH_INFO: `/v3/projects/2e00631e3a8c451191942eda4921cd1a/users/0da895c7d53f46f28d7aaacdd702ee97/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:25.521137 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c5103-1003-4b37-89d0-1c010239c36f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e00631e3a8c451191942eda4921cd1a, user_id=0da895c7d53f46f28d7aaacdd702ee97, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:25.531762 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c5103-1003-4b37-89d0-1c010239c36f admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:25.544429 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 861/1726] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:25.552702 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362f1d4-9b94-4650-a1d0-3e9ab8aa4c4c None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:25.552997 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362f1d4-9b94-4650-a1d0-3e9ab8aa4c4c None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:25.554379 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362f1d4-9b94-4650-a1d0-3e9ab8aa4c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:25.560503 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 866/1727] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:25 2022] PUT /identity/v3/projects/2e00631e3a8c451191942eda4921cd1a/users/0da895c7d53f46f28d7aaacdd702ee97/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:25.571835 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac1b96-5c80-48c7-941b-bff7e6856c5a None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:25.572359 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac1b96-5c80-48c7-941b-bff7e6856c5a None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:25.572790 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac1b96-5c80-48c7-941b-bff7e6856c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:25.629272 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-a7ac1b96-5c80-48c7-941b-bff7e6856c5a None None] MFA Rules not processed for user `0da895c7d53f46f28d7aaacdd702ee97`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:25.630571 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-a7ac1b96-5c80-48c7-941b-bff7e6856c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:25.649204 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-f362f1d4-9b94-4650-a1d0-3e9ab8aa4c4c None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:25.658442 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-f362f1d4-9b94-4650-a1d0-3e9ab8aa4c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:25.886256 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 867/1728] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:09:25.898058 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac1b96-5c80-48c7-941b-bff7e6856c5a None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:25.899482 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-a7ac1b96-5c80-48c7-941b-bff7e6856c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:26.000817 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac1b96-5c80-48c7-941b-bff7e6856c5a None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:26.022160 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae13f71-c780-422d-8a5b-35a81e828601 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:26.023084 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae13f71-c780-422d-8a5b-35a81e828601 service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:26.023598 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae13f71-c780-422d-8a5b-35a81e828601 service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:26.024103 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae13f71-c780-422d-8a5b-35a81e828601 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:26.035881 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae13f71-c780-422d-8a5b-35a81e828601 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:26.037701 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae13f71-c780-422d-8a5b-35a81e828601 service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:26.049684 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 868/1729] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:26.051744 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 862/1730] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 500 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:26.056597 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae13f71-c780-422d-8a5b-35a81e828601 service cinder] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:26.085812 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae13f71-c780-422d-8a5b-35a81e828601 service cinder] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:26.113256 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306098f-c072-42cd-bf7f-a3643d766e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:26.114177 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306098f-c072-42cd-bf7f-a3643d766e79 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:26.117783 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306098f-c072-42cd-bf7f-a3643d766e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:26.118381 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306098f-c072-42cd-bf7f-a3643d766e79 admin admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:26.120902 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306098f-c072-42cd-bf7f-a3643d766e79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:09:26.121719 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306098f-c072-42cd-bf7f-a3643d766e79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:26.130296 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362f1d4-9b94-4650-a1d0-3e9ab8aa4c4c None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:26.132061 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306098f-c072-42cd-bf7f-a3643d766e79 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:26.150256 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362f1d4-9b94-4650-a1d0-3e9ab8aa4c4c None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:26.163597 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd85994-608d-47e7-8ca3-de55d54a2871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:26.164511 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd85994-608d-47e7-8ca3-de55d54a2871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:26.164799 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd85994-608d-47e7-8ca3-de55d54a2871 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:26.165074 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd85994-608d-47e7-8ca3-de55d54a2871 admin admin] PATH_INFO: `/v3/users/ea007c262b554631b2d5ab500b3e0879` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:26.168808 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd85994-608d-47e7-8ca3-de55d54a2871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea007c262b554631b2d5ab500b3e0879)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:26.171070 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd85994-608d-47e7-8ca3-de55d54a2871 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:26.175894 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 869/1731] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:09:26.179984 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306098f-c072-42cd-bf7f-a3643d766e79 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:26.191579 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306098f-c072-42cd-bf7f-a3643d766e79 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:26.203554 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ad590-594c-4824-a3dc-aa9cfdf0c34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:26.215598 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ad590-594c-4824-a3dc-aa9cfdf0c34c admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:26.217239 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ad590-594c-4824-a3dc-aa9cfdf0c34c admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:26.217746 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ad590-594c-4824-a3dc-aa9cfdf0c34c admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:26.218814 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ad590-594c-4824-a3dc-aa9cfdf0c34c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:26.225365 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ad590-594c-4824-a3dc-aa9cfdf0c34c admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:26.269237 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 870/1732] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:09:26 2022] POST /identity/v3/projects => generated 367 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:09:26.274310 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ad590-594c-4824-a3dc-aa9cfdf0c34c admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:26.301914 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-4fd85994-608d-47e7-8ca3-de55d54a2871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea007c262b554631b2d5ab500b3e0879'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:26.307486 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-4fd85994-608d-47e7-8ca3-de55d54a2871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea007c262b554631b2d5ab500b3e0879'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:26.317719 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-4fd85994-608d-47e7-8ca3-de55d54a2871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea007c262b554631b2d5ab500b3e0879'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:26.347188 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-4fd85994-608d-47e7-8ca3-de55d54a2871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea007c262b554631b2d5ab500b3e0879'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:26.349879 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-4fd85994-608d-47e7-8ca3-de55d54a2871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea007c262b554631b2d5ab500b3e0879'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:26.377627 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 863/1733] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:09:26 2022] DELETE /identity/v3/users/ea007c262b554631b2d5ab500b3e0879 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:09:26.382929 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c56f09-1c08-4eb8-b8c5-75b9fc158112 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:26.383542 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c56f09-1c08-4eb8-b8c5-75b9fc158112 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:26.384060 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c56f09-1c08-4eb8-b8c5-75b9fc158112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:26.416726 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ad590-594c-4824-a3dc-aa9cfdf0c34c admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:26.425174 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-94c56f09-1c08-4eb8-b8c5-75b9fc158112 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:26.426730 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-94c56f09-1c08-4eb8-b8c5-75b9fc158112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:26.531154 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 864/1734] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:26.561601 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011f810-ff3b-43e1-ae62-a98495ea58cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:26.562292 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011f810-ff3b-43e1-ae62-a98495ea58cb admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:26.562810 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011f810-ff3b-43e1-ae62-a98495ea58cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:26.563103 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011f810-ff3b-43e1-ae62-a98495ea58cb admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:26.565697 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1011f810-ff3b-43e1-ae62-a98495ea58cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:26.570508 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1011f810-ff3b-43e1-ae62-a98495ea58cb admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:26.616123 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 871/1735] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:09:26 2022] POST /identity/v3/users => generated 284 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:26.620093 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c56f09-1c08-4eb8-b8c5-75b9fc158112 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:26.621696 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-94c56f09-1c08-4eb8-b8c5-75b9fc158112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:26.631994 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011f810-ff3b-43e1-ae62-a98495ea58cb admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:26.633955 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-1011f810-ff3b-43e1-ae62-a98495ea58cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:26.655465 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c56f09-1c08-4eb8-b8c5-75b9fc158112 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:26.674147 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e52fa3-c68d-4d5e-9b44-e080d4b518de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:26.674870 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e52fa3-c68d-4d5e-9b44-e080d4b518de admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:26.675838 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e52fa3-c68d-4d5e-9b44-e080d4b518de admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:26.676680 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e52fa3-c68d-4d5e-9b44-e080d4b518de admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:26.677317 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e52fa3-c68d-4d5e-9b44-e080d4b518de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:26.679620 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e52fa3-c68d-4d5e-9b44-e080d4b518de admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:26.710331 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 865/1736] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:26.712774 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e52fa3-c68d-4d5e-9b44-e080d4b518de admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:26.755475 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e52fa3-c68d-4d5e-9b44-e080d4b518de admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:26.774242 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74db8f-a197-4d66-867f-9e5860efad2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:26.776611 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74db8f-a197-4d66-867f-9e5860efad2a admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:26.777141 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74db8f-a197-4d66-867f-9e5860efad2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:26.777594 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74db8f-a197-4d66-867f-9e5860efad2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:26.778527 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74db8f-a197-4d66-867f-9e5860efad2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:26.785312 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74db8f-a197-4d66-867f-9e5860efad2a admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:26.811160 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011f810-ff3b-43e1-ae62-a98495ea58cb admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:26.820777 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 866/1737] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:26.824988 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74db8f-a197-4d66-867f-9e5860efad2a admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:26.846072 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74db8f-a197-4d66-867f-9e5860efad2a admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:26.854239 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41327975-8604-40b8-95ea-77215fd13a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:26.858050 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41327975-8604-40b8-95ea-77215fd13a69 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:26.859227 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41327975-8604-40b8-95ea-77215fd13a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:26.859623 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41327975-8604-40b8-95ea-77215fd13a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:26.869203 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff120af-a6d8-406b-8efe-62cd048494c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:26.871624 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff120af-a6d8-406b-8efe-62cd048494c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:26.872187 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff120af-a6d8-406b-8efe-62cd048494c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:26.872812 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff120af-a6d8-406b-8efe-62cd048494c5 admin admin] PATH_INFO: `/v3/projects/c6b23ac16a604e1ca30336960b7feead/users/ff55ef01af224392a4e76207e393ada9/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:26.910158 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff120af-a6d8-406b-8efe-62cd048494c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b23ac16a604e1ca30336960b7feead, user_id=ff55ef01af224392a4e76207e393ada9, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:26.913689 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff120af-a6d8-406b-8efe-62cd048494c5 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:26.925545 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41327975-8604-40b8-95ea-77215fd13a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:26.927078 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41327975-8604-40b8-95ea-77215fd13a69 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:26.964945 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 867/1738] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:26 2022] PUT /identity/v3/projects/c6b23ac16a604e1ca30336960b7feead/users/ff55ef01af224392a4e76207e393ada9/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:26.977016 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04ad59-87bd-4920-a6d2-b329235c3b2b None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:26.978094 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04ad59-87bd-4920-a6d2-b329235c3b2b None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:26.978777 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04ad59-87bd-4920-a6d2-b329235c3b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:26.981777 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 872/1739] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:09:27.019475 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26091d26-00b4-4d3f-9104-2f72238c717c None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:27.019854 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26091d26-00b4-4d3f-9104-2f72238c717c None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:27.020134 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26091d26-00b4-4d3f-9104-2f72238c717c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:27.063798 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-26091d26-00b4-4d3f-9104-2f72238c717c None None] MFA Rules not processed for user `2faf262ae9d643c0b8708dcfecd75b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:27.069316 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-26091d26-00b4-4d3f-9104-2f72238c717c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:27.077005 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-1e04ad59-87bd-4920-a6d2-b329235c3b2b None None] MFA Rules not processed for user `ff55ef01af224392a4e76207e393ada9`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:27.086753 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-1e04ad59-87bd-4920-a6d2-b329235c3b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:27.283772 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 873/1740] 10.222.0.26 () {58 vars in 1015 bytes} [Thu Mar 10 04:09:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:09:27.328026 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 868/1741] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:27.333135 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26091d26-00b4-4d3f-9104-2f72238c717c None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:27.355924 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04ad59-87bd-4920-a6d2-b329235c3b2b None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:27.355924 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-1e04ad59-87bd-4920-a6d2-b329235c3b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:27.390406 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04ad59-87bd-4920-a6d2-b329235c3b2b None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:27.400091 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79b05d-7b98-445a-80b5-01b74a46fb0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:27.401477 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79b05d-7b98-445a-80b5-01b74a46fb0c service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:27.402330 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79b05d-7b98-445a-80b5-01b74a46fb0c service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:27.403479 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79b05d-7b98-445a-80b5-01b74a46fb0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:27.415332 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb79b05d-7b98-445a-80b5-01b74a46fb0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:27.417482 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb79b05d-7b98-445a-80b5-01b74a46fb0c service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:27.442336 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 869/1742] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:27.537484 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26091d26-00b4-4d3f-9104-2f72238c717c None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:27.547126 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54a8cc-734d-4eb7-b78b-4ddb55ba468f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:27.549232 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54a8cc-734d-4eb7-b78b-4ddb55ba468f admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:27.550107 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54a8cc-734d-4eb7-b78b-4ddb55ba468f admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:27.550727 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54a8cc-734d-4eb7-b78b-4ddb55ba468f admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:27.552947 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54a8cc-734d-4eb7-b78b-4ddb55ba468f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:27.564628 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54a8cc-734d-4eb7-b78b-4ddb55ba468f admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:27.651503 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 874/1743] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:09:27 2022] POST /identity/v3/projects => generated 365 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:27.655356 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79b05d-7b98-445a-80b5-01b74a46fb0c service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:27.681690 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79b05d-7b98-445a-80b5-01b74a46fb0c service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:27.900774 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5833f46-91a8-449c-ac69-b97910602e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:27.901561 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5833f46-91a8-449c-ac69-b97910602e3b admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:27.902493 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5833f46-91a8-449c-ac69-b97910602e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:27.902788 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5833f46-91a8-449c-ac69-b97910602e3b admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:27.904903 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5833f46-91a8-449c-ac69-b97910602e3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:27.911324 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5833f46-91a8-449c-ac69-b97910602e3b admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:27.993647 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54a8cc-734d-4eb7-b78b-4ddb55ba468f admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:28.010439 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54a8cc-734d-4eb7-b78b-4ddb55ba468f admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:28.011524 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 870/1744] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:09:27 2022] POST /identity/v3/users => generated 289 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:28.027030 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa889e-a20a-4d59-b773-8aea460bf803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:28.029006 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa889e-a20a-4d59-b773-8aea460bf803 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:28.029607 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa889e-a20a-4d59-b773-8aea460bf803 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:28.030212 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa889e-a20a-4d59-b773-8aea460bf803 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:28.031418 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa889e-a20a-4d59-b773-8aea460bf803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:28.034512 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa889e-a20a-4d59-b773-8aea460bf803 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:28.080116 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 875/1745] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:09:28.081369 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5833f46-91a8-449c-ac69-b97910602e3b admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:28.100787 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5833f46-91a8-449c-ac69-b97910602e3b admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:28.140546 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e905f9-a380-43e9-b313-f95318e3bf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:28.142040 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e905f9-a380-43e9-b313-f95318e3bf45 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:28.142330 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e905f9-a380-43e9-b313-f95318e3bf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:28.147902 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e905f9-a380-43e9-b313-f95318e3bf45 admin admin] PATH_INFO: `/v3/projects/94aef85922ee4210a4709c72c09e6cda/users/d5253c1b56b447a590d584c240e9d658/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:28.216768 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e905f9-a380-43e9-b313-f95318e3bf45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94aef85922ee4210a4709c72c09e6cda, user_id=d5253c1b56b447a590d584c240e9d658, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:28.226392 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e905f9-a380-43e9-b313-f95318e3bf45 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:28.260739 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 871/1746] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:28 2022] PUT /identity/v3/projects/94aef85922ee4210a4709c72c09e6cda/users/d5253c1b56b447a590d584c240e9d658/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:28.263652 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa889e-a20a-4d59-b773-8aea460bf803 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:28.282539 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa889e-a20a-4d59-b773-8aea460bf803 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:28.520711 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5c470-d0c3-4e2f-b20f-80b97eb4d8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:28.538373 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5c470-d0c3-4e2f-b20f-80b97eb4d8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:28.540455 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5c470-d0c3-4e2f-b20f-80b97eb4d8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:28.544368 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5c470-d0c3-4e2f-b20f-80b97eb4d8e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:28.557635 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea5c470-d0c3-4e2f-b20f-80b97eb4d8e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:28.562918 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea5c470-d0c3-4e2f-b20f-80b97eb4d8e7 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:28.628631 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e905f9-a380-43e9-b313-f95318e3bf45 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:28.630911 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 876/1747] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:28.644504 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e905f9-a380-43e9-b313-f95318e3bf45 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:28.679257 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d4812-cf9f-45ee-9c80-ef22455eb931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:28.680226 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d4812-cf9f-45ee-9c80-ef22455eb931 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:28.680512 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d4812-cf9f-45ee-9c80-ef22455eb931 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:28.681108 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d4812-cf9f-45ee-9c80-ef22455eb931 admin admin] PATH_INFO: `/v3/projects/94aef85922ee4210a4709c72c09e6cda/users/d5253c1b56b447a590d584c240e9d658/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:28.695114 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d4812-cf9f-45ee-9c80-ef22455eb931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94aef85922ee4210a4709c72c09e6cda, user_id=d5253c1b56b447a590d584c240e9d658, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:28.711768 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d4812-cf9f-45ee-9c80-ef22455eb931 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:28.759730 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 872/1748] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:28 2022] PUT /identity/v3/projects/94aef85922ee4210a4709c72c09e6cda/users/d5253c1b56b447a590d584c240e9d658/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:09:28.773207 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72ca0e-c909-49c8-b738-8db2b5b55d54 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:28.773207 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72ca0e-c909-49c8-b738-8db2b5b55d54 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:28.773207 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72ca0e-c909-49c8-b738-8db2b5b55d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:28.776090 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e814b-abc0-4743-8bbf-9719fae65d76 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:28.776864 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e814b-abc0-4743-8bbf-9719fae65d76 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:28.777152 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e814b-abc0-4743-8bbf-9719fae65d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:28.852280 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-4f72ca0e-c909-49c8-b738-8db2b5b55d54 None None] MFA Rules not processed for user `382fc34b389c4338b8e9fcae2b4d89e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:28.858457 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-4f72ca0e-c909-49c8-b738-8db2b5b55d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:28.909063 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-9f0e814b-abc0-4743-8bbf-9719fae65d76 None None] MFA Rules not processed for user `d5253c1b56b447a590d584c240e9d658`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:28.913669 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-9f0e814b-abc0-4743-8bbf-9719fae65d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:29.067720 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 877/1749] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:29.069436 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72ca0e-c909-49c8-b738-8db2b5b55d54 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:29.072160 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-4f72ca0e-c909-49c8-b738-8db2b5b55d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:29.180345 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 873/1750] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:28 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:29.195291 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e814b-abc0-4743-8bbf-9719fae65d76 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:29.196874 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-9f0e814b-abc0-4743-8bbf-9719fae65d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:29.257397 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72ca0e-c909-49c8-b738-8db2b5b55d54 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:29.301716 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffff1f2-9cff-4fd6-9d2c-7fda12234e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:29.307724 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffff1f2-9cff-4fd6-9d2c-7fda12234e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:29.308084 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffff1f2-9cff-4fd6-9d2c-7fda12234e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:29.308374 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffff1f2-9cff-4fd6-9d2c-7fda12234e07 admin admin] PATH_INFO: `/v3/projects/509e067b04a84e45b51dfb3cd3e82bbc` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:29.310034 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffff1f2-9cff-4fd6-9d2c-7fda12234e07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=509e067b04a84e45b51dfb3cd3e82bbc)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:29.312732 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffff1f2-9cff-4fd6-9d2c-7fda12234e07 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:29.314902 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e814b-abc0-4743-8bbf-9719fae65d76 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:29.330947 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce9099-ca7f-4a04-a583-bd2e0795e1cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:29.331626 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce9099-ca7f-4a04-a583-bd2e0795e1cb service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:29.331954 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce9099-ca7f-4a04-a583-bd2e0795e1cb service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:29.332234 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce9099-ca7f-4a04-a583-bd2e0795e1cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:29.362066 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce9099-ca7f-4a04-a583-bd2e0795e1cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:29.367227 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce9099-ca7f-4a04-a583-bd2e0795e1cb service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:29.411458 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 874/1751] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:29 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:29.412961 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce9099-ca7f-4a04-a583-bd2e0795e1cb service cinder] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:29.417100 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-dbce9099-ca7f-4a04-a583-bd2e0795e1cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:29.450560 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-dffff1f2-9cff-4fd6-9d2c-7fda12234e07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '509e067b04a84e45b51dfb3cd3e82bbc', 'request_id': 'req-dffff1f2-9cff-4fd6-9d2c-7fda12234e07'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:29.467291 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-dffff1f2-9cff-4fd6-9d2c-7fda12234e07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '509e067b04a84e45b51dfb3cd3e82bbc', 'request_id': 'req-dffff1f2-9cff-4fd6-9d2c-7fda12234e07'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:29.475223 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-dffff1f2-9cff-4fd6-9d2c-7fda12234e07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '509e067b04a84e45b51dfb3cd3e82bbc', 'request_id': 'req-dffff1f2-9cff-4fd6-9d2c-7fda12234e07'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:29.503484 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-dffff1f2-9cff-4fd6-9d2c-7fda12234e07 admin admin] The token cache is being invalidate because project 509e067b04a84e45b51dfb3cd3e82bbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:09:29.503805 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-dffff1f2-9cff-4fd6-9d2c-7fda12234e07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:29.504700 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-dffff1f2-9cff-4fd6-9d2c-7fda12234e07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:29.506670 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 878/1752] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:09:29 2022] DELETE /identity/v3/projects/509e067b04a84e45b51dfb3cd3e82bbc => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:29.510077 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ff365-38dc-4045-b3c4-45861e1e15c3 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:29.510424 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ff365-38dc-4045-b3c4-45861e1e15c3 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:29.510714 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ff365-38dc-4045-b3c4-45861e1e15c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:29.549875 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-fd6ff365-38dc-4045-b3c4-45861e1e15c3 None None] MFA Rules not processed for user `b96ee0c3a9e44e14bf62619829b0acd9`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:29.551578 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-fd6ff365-38dc-4045-b3c4-45861e1e15c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:29.726373 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 879/1753] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:29.729857 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ff365-38dc-4045-b3c4-45861e1e15c3 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:29.736652 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-fd6ff365-38dc-4045-b3c4-45861e1e15c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:29.939851 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce9099-ca7f-4a04-a583-bd2e0795e1cb service cinder] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:29.967986 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ff365-38dc-4045-b3c4-45861e1e15c3 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:29.996065 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92640b77-ee2a-42c2-9eab-67376c33c3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:29.997486 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92640b77-ee2a-42c2-9eab-67376c33c3c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:29.998930 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92640b77-ee2a-42c2-9eab-67376c33c3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:29.999227 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92640b77-ee2a-42c2-9eab-67376c33c3c7 admin admin] PATH_INFO: `/v3/users/f4337a25124a441296a07f71dfab92cc` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:30.001532 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92640b77-ee2a-42c2-9eab-67376c33c3c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4337a25124a441296a07f71dfab92cc)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:30.005753 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92640b77-ee2a-42c2-9eab-67376c33c3c7 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:30.108529 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-92640b77-ee2a-42c2-9eab-67376c33c3c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4337a25124a441296a07f71dfab92cc'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:30.128587 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-92640b77-ee2a-42c2-9eab-67376c33c3c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4337a25124a441296a07f71dfab92cc'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:30.151565 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-92640b77-ee2a-42c2-9eab-67376c33c3c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4337a25124a441296a07f71dfab92cc'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:30.163705 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d8137-65ae-4bfb-a123-efe33ceee48c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:30.166293 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d8137-65ae-4bfb-a123-efe33ceee48c service nova] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:30.167837 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d8137-65ae-4bfb-a123-efe33ceee48c service nova] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:30.168251 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d8137-65ae-4bfb-a123-efe33ceee48c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:30.173317 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-92640b77-ee2a-42c2-9eab-67376c33c3c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4337a25124a441296a07f71dfab92cc'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:30.176257 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-92640b77-ee2a-42c2-9eab-67376c33c3c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4337a25124a441296a07f71dfab92cc'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:30.177298 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-a40d8137-65ae-4bfb-a123-efe33ceee48c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:30.200156 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 880/1754] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:09:29 2022] DELETE /identity/v3/users/f4337a25124a441296a07f71dfab92cc => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:30.209217 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92640b77-ee2a-42c2-9eab-67376c33c3c7 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:30.224884 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-92640b77-ee2a-42c2-9eab-67376c33c3c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:30.400409 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d8137-65ae-4bfb-a123-efe33ceee48c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:30.402205 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d8137-65ae-4bfb-a123-efe33ceee48c service nova] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:30.432903 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 875/1755] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 1021 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:30.437496 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d8137-65ae-4bfb-a123-efe33ceee48c service nova] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:30.447204 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-a40d8137-65ae-4bfb-a123-efe33ceee48c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:30.494150 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d8137-65ae-4bfb-a123-efe33ceee48c service nova] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:30.532975 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92640b77-ee2a-42c2-9eab-67376c33c3c7 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:30.537450 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41a0f1-5efc-4880-8f5d-dfb2a95d427a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:30.538120 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41a0f1-5efc-4880-8f5d-dfb2a95d427a service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:30.538405 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41a0f1-5efc-4880-8f5d-dfb2a95d427a service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:30.538684 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41a0f1-5efc-4880-8f5d-dfb2a95d427a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:30.541243 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-dd41a0f1-5efc-4880-8f5d-dfb2a95d427a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:30.728384 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b479c-48d2-43fd-a462-5673b8bcfee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:30.730629 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b479c-48d2-43fd-a462-5673b8bcfee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:30.731989 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b479c-48d2-43fd-a462-5673b8bcfee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:30.734182 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b479c-48d2-43fd-a462-5673b8bcfee6 admin admin] PATH_INFO: `/v3/projects/ab168829d0024e52b70496329d2c8758` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:30.736291 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b479c-48d2-43fd-a462-5673b8bcfee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab168829d0024e52b70496329d2c8758)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:30.740823 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41a0f1-5efc-4880-8f5d-dfb2a95d427a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:30.742290 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41a0f1-5efc-4880-8f5d-dfb2a95d427a service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:30.744327 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b479c-48d2-43fd-a462-5673b8bcfee6 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:30.806041 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 881/1756] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:30 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:31.008379 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-f33b479c-48d2-43fd-a462-5673b8bcfee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab168829d0024e52b70496329d2c8758', 'request_id': 'req-f33b479c-48d2-43fd-a462-5673b8bcfee6'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:31.029220 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-f33b479c-48d2-43fd-a462-5673b8bcfee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab168829d0024e52b70496329d2c8758', 'request_id': 'req-f33b479c-48d2-43fd-a462-5673b8bcfee6'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:31.056789 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-f33b479c-48d2-43fd-a462-5673b8bcfee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab168829d0024e52b70496329d2c8758', 'request_id': 'req-f33b479c-48d2-43fd-a462-5673b8bcfee6'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:31.129167 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d67295-bc25-4a84-9d2b-456a0702e279 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:31.129458 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d67295-bc25-4a84-9d2b-456a0702e279 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:31.129755 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d67295-bc25-4a84-9d2b-456a0702e279 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:31.131569 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 882/1757] 10.222.0.15 () {54 vars in 921 bytes} [Thu Mar 10 04:09:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:09:31.132885 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-f33b479c-48d2-43fd-a462-5673b8bcfee6 admin admin] The token cache is being invalidate because project ab168829d0024e52b70496329d2c8758 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:09:31.134217 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-f33b479c-48d2-43fd-a462-5673b8bcfee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:31.135971 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-f33b479c-48d2-43fd-a462-5673b8bcfee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:31.140175 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 876/1758] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:09:30 2022] DELETE /identity/v3/projects/ab168829d0024e52b70496329d2c8758 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:31.144553 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d67295-bc25-4a84-9d2b-456a0702e279 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:31.146496 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-f6d67295-bc25-4a84-9d2b-456a0702e279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:31.318232 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b5f0e-6bc4-4801-a5b8-47dd45d91caf None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:31.318527 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b5f0e-6bc4-4801-a5b8-47dd45d91caf None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:31.319354 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b5f0e-6bc4-4801-a5b8-47dd45d91caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:31.323640 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d67295-bc25-4a84-9d2b-456a0702e279 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:31.351915 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e6d98-7738-4f63-9ac4-d848bf68131c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:31.352849 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e6d98-7738-4f63-9ac4-d848bf68131c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:31.353131 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e6d98-7738-4f63-9ac4-d848bf68131c admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:31.353403 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e6d98-7738-4f63-9ac4-d848bf68131c admin admin] PATH_INFO: `/v3/users/0da895c7d53f46f28d7aaacdd702ee97` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:31.365650 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e6d98-7738-4f63-9ac4-d848bf68131c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0da895c7d53f46f28d7aaacdd702ee97)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:31.367665 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e6d98-7738-4f63-9ac4-d848bf68131c admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:31.381654 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-bb9b5f0e-6bc4-4801-a5b8-47dd45d91caf None None] MFA Rules not processed for user `fbd92bd14ed04621af06d68161798fe3`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:31.386910 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-bb9b5f0e-6bc4-4801-a5b8-47dd45d91caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:31.591098 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-9a5e6d98-7738-4f63-9ac4-d848bf68131c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0da895c7d53f46f28d7aaacdd702ee97'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:31.631618 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-9a5e6d98-7738-4f63-9ac4-d848bf68131c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0da895c7d53f46f28d7aaacdd702ee97'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:31.652993 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-9a5e6d98-7738-4f63-9ac4-d848bf68131c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0da895c7d53f46f28d7aaacdd702ee97'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:31.692800 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-9a5e6d98-7738-4f63-9ac4-d848bf68131c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0da895c7d53f46f28d7aaacdd702ee97'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:31.693082 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 877/1759] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Mar 10 04:09:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:31.694412 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-9a5e6d98-7738-4f63-9ac4-d848bf68131c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0da895c7d53f46f28d7aaacdd702ee97'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:31.725678 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 883/1760] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:09:31 2022] DELETE /identity/v3/users/0da895c7d53f46f28d7aaacdd702ee97 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:32.292958 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b5f0e-6bc4-4801-a5b8-47dd45d91caf None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:32.295293 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-bb9b5f0e-6bc4-4801-a5b8-47dd45d91caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:32.336796 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b5f0e-6bc4-4801-a5b8-47dd45d91caf None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:32.539832 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcda797-e858-4a25-b486-e2fa4a145ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:32.540733 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcda797-e858-4a25-b486-e2fa4a145ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:32.541017 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcda797-e858-4a25-b486-e2fa4a145ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:32.541581 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcda797-e858-4a25-b486-e2fa4a145ce8 admin admin] PATH_INFO: `/v3/projects/9f5722ad62c3411d8892c59dd8c2a3c1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:32.552699 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcda797-e858-4a25-b486-e2fa4a145ce8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f5722ad62c3411d8892c59dd8c2a3c1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:32.554679 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcda797-e858-4a25-b486-e2fa4a145ce8 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:32.655202 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-2bcda797-e858-4a25-b486-e2fa4a145ce8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f5722ad62c3411d8892c59dd8c2a3c1', 'request_id': 'req-2bcda797-e858-4a25-b486-e2fa4a145ce8'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:32.672842 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-2bcda797-e858-4a25-b486-e2fa4a145ce8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f5722ad62c3411d8892c59dd8c2a3c1', 'request_id': 'req-2bcda797-e858-4a25-b486-e2fa4a145ce8'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:32.680075 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-2bcda797-e858-4a25-b486-e2fa4a145ce8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f5722ad62c3411d8892c59dd8c2a3c1', 'request_id': 'req-2bcda797-e858-4a25-b486-e2fa4a145ce8'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:32.708164 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-2bcda797-e858-4a25-b486-e2fa4a145ce8 admin admin] The token cache is being invalidate because project 9f5722ad62c3411d8892c59dd8c2a3c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:09:32.708625 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-2bcda797-e858-4a25-b486-e2fa4a145ce8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:32.720803 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-2bcda797-e858-4a25-b486-e2fa4a145ce8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:32.726040 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e6d98-7738-4f63-9ac4-d848bf68131c admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:32.728086 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-9a5e6d98-7738-4f63-9ac4-d848bf68131c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:32.736378 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 878/1761] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:09:32 2022] DELETE /identity/v3/projects/9f5722ad62c3411d8892c59dd8c2a3c1 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:32.737984 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfd64e-60bb-4cbb-a24f-cb2a95419e0b None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:32.743748 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfd64e-60bb-4cbb-a24f-cb2a95419e0b None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:32.744047 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfd64e-60bb-4cbb-a24f-cb2a95419e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:32.808963 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-47bfd64e-60bb-4cbb-a24f-cb2a95419e0b None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:32.810461 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-47bfd64e-60bb-4cbb-a24f-cb2a95419e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:32.991032 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e6d98-7738-4f63-9ac4-d848bf68131c admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:33.043574 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 879/1762] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:09:33.046600 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bc667-44ee-40ac-a377-b4372253b183 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:33.049807 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bc667-44ee-40ac-a377-b4372253b183 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:33.050363 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93bc667-44ee-40ac-a377-b4372253b183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:33.137056 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-f93bc667-44ee-40ac-a377-b4372253b183 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:33.140626 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-f93bc667-44ee-40ac-a377-b4372253b183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:33.185608 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 880/1763] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:33.186709 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93bc667-44ee-40ac-a377-b4372253b183 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:33.221937 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93bc667-44ee-40ac-a377-b4372253b183 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:33.240360 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78bd74-f869-4aae-810b-f1a029ccbd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:33.251907 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78bd74-f869-4aae-810b-f1a029ccbd77 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:33.252561 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78bd74-f869-4aae-810b-f1a029ccbd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:33.253813 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78bd74-f869-4aae-810b-f1a029ccbd77 admin admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:33.254730 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78bd74-f869-4aae-810b-f1a029ccbd77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:09:33.256113 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583dd6d-5ad6-4b0d-a8a7-1259e35dc54d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:33.256575 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78bd74-f869-4aae-810b-f1a029ccbd77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:33.257333 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583dd6d-5ad6-4b0d-a8a7-1259e35dc54d service nova] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:33.257813 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583dd6d-5ad6-4b0d-a8a7-1259e35dc54d service nova] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:33.258488 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583dd6d-5ad6-4b0d-a8a7-1259e35dc54d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:33.261485 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-8583dd6d-5ad6-4b0d-a8a7-1259e35dc54d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:33.268399 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78bd74-f869-4aae-810b-f1a029ccbd77 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:33.282637 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583dd6d-5ad6-4b0d-a8a7-1259e35dc54d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:33.285448 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583dd6d-5ad6-4b0d-a8a7-1259e35dc54d service nova] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:33.315795 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 884/1764] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:09:33.329400 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583dd6d-5ad6-4b0d-a8a7-1259e35dc54d service nova] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:33.330082 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 881/1765] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:09:33.351125 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583dd6d-5ad6-4b0d-a8a7-1259e35dc54d service nova] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:33.366257 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b44524-2cc0-442b-b21a-84a1ad3f42c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:33.368414 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b44524-2cc0-442b-b21a-84a1ad3f42c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:33.370562 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b44524-2cc0-442b-b21a-84a1ad3f42c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:33.371388 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b44524-2cc0-442b-b21a-84a1ad3f42c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:33.374413 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b44524-2cc0-442b-b21a-84a1ad3f42c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:33.396039 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b44524-2cc0-442b-b21a-84a1ad3f42c0 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:33.496810 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 885/1766] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:09:33 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:09:33.501936 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78bd74-f869-4aae-810b-f1a029ccbd77 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:33.531746 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78bd74-f869-4aae-810b-f1a029ccbd77 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:33.541264 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b44524-2cc0-442b-b21a-84a1ad3f42c0 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:33.543269 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-a3b44524-2cc0-442b-b21a-84a1ad3f42c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:33.695182 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b44524-2cc0-442b-b21a-84a1ad3f42c0 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:33.708210 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf31af-50ea-49e4-b0d8-3c3dc4e832ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:33.709788 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf31af-50ea-49e4-b0d8-3c3dc4e832ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:33.710081 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf31af-50ea-49e4-b0d8-3c3dc4e832ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:33.710366 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf31af-50ea-49e4-b0d8-3c3dc4e832ba admin admin] PATH_INFO: `/v3/projects/2e00631e3a8c451191942eda4921cd1a` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:33.713082 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf31af-50ea-49e4-b0d8-3c3dc4e832ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e00631e3a8c451191942eda4921cd1a)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:33.719481 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf31af-50ea-49e4-b0d8-3c3dc4e832ba admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:33.758875 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd0e4a-559c-4c42-b5df-d7c6e3a5a898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:33.760561 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd0e4a-559c-4c42-b5df-d7c6e3a5a898 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:33.762505 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd0e4a-559c-4c42-b5df-d7c6e3a5a898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:33.763405 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd0e4a-559c-4c42-b5df-d7c6e3a5a898 admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:33.765462 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd0e4a-559c-4c42-b5df-d7c6e3a5a898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:33.770543 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd0e4a-559c-4c42-b5df-d7c6e3a5a898 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:33.830568 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-d8cf31af-50ea-49e4-b0d8-3c3dc4e832ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e00631e3a8c451191942eda4921cd1a', 'request_id': 'req-d8cf31af-50ea-49e4-b0d8-3c3dc4e832ba'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:33.843356 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 882/1767] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:09:33 2022] POST /identity/v3/users => generated 290 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:33.843559 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-d8cf31af-50ea-49e4-b0d8-3c3dc4e832ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e00631e3a8c451191942eda4921cd1a', 'request_id': 'req-d8cf31af-50ea-49e4-b0d8-3c3dc4e832ba'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:33.846608 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd0e4a-559c-4c42-b5df-d7c6e3a5a898 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:33.854583 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-d8cf31af-50ea-49e4-b0d8-3c3dc4e832ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e00631e3a8c451191942eda4921cd1a', 'request_id': 'req-d8cf31af-50ea-49e4-b0d8-3c3dc4e832ba'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:33.865999 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd0e4a-559c-4c42-b5df-d7c6e3a5a898 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:33.881934 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-d8cf31af-50ea-49e4-b0d8-3c3dc4e832ba admin admin] The token cache is being invalidate because project 2e00631e3a8c451191942eda4921cd1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:09:33.882288 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-d8cf31af-50ea-49e4-b0d8-3c3dc4e832ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:33.884407 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-d8cf31af-50ea-49e4-b0d8-3c3dc4e832ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:33.891614 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 886/1768] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:09:33 2022] DELETE /identity/v3/projects/2e00631e3a8c451191942eda4921cd1a => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:33.894273 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56052df3-6728-4545-bf36-094347424202 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:33.894570 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56052df3-6728-4545-bf36-094347424202 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:33.894851 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56052df3-6728-4545-bf36-094347424202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:33.958049 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-56052df3-6728-4545-bf36-094347424202 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:33.961426 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-56052df3-6728-4545-bf36-094347424202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:34.001087 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d4005-0b3d-49b4-8540-c431a89e291b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:34.002409 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d4005-0b3d-49b4-8540-c431a89e291b admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:34.002873 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d4005-0b3d-49b4-8540-c431a89e291b admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:34.003165 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d4005-0b3d-49b4-8540-c431a89e291b admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:34.004366 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d4005-0b3d-49b4-8540-c431a89e291b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:34.006760 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d4005-0b3d-49b4-8540-c431a89e291b admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:34.024487 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 883/1769] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:34.024487 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c6246-1156-48f7-89fb-55478ccd9221 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:34.024910 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c6246-1156-48f7-89fb-55478ccd9221 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:34.025159 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c6246-1156-48f7-89fb-55478ccd9221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:34.048125 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-1b4c6246-1156-48f7-89fb-55478ccd9221 None None] MFA Rules not processed for user `af9aa388314f4cfca823c8d13f67a8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:34.049374 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-1b4c6246-1156-48f7-89fb-55478ccd9221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:34.187625 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 884/1770] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:34.191319 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c6246-1156-48f7-89fb-55478ccd9221 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:34.195134 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 887/1771] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:34.196361 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-1b4c6246-1156-48f7-89fb-55478ccd9221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:34.205010 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e1820-87c8-4020-ae87-d71813892aa4 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:34.205766 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e1820-87c8-4020-ae87-d71813892aa4 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:34.206262 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e1820-87c8-4020-ae87-d71813892aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:34.233857 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c6246-1156-48f7-89fb-55478ccd9221 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:34.246512 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9348a799-bdc0-4048-8de5-f111df1e38d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:34.249713 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348a799-bdc0-4048-8de5-f111df1e38d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:34.249713 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348a799-bdc0-4048-8de5-f111df1e38d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:34.250096 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348a799-bdc0-4048-8de5-f111df1e38d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:34.251232 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9348a799-bdc0-4048-8de5-f111df1e38d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:34.254602 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-e55e1820-87c8-4020-ae87-d71813892aa4 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:34.256285 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-e55e1820-87c8-4020-ae87-d71813892aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:34.256487 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9348a799-bdc0-4048-8de5-f111df1e38d6 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:34.284047 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 888/1772] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:09:34.285345 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e1820-87c8-4020-ae87-d71813892aa4 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:34.287701 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 885/1773] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:34.292298 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9348a799-bdc0-4048-8de5-f111df1e38d6 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:34.308487 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e1820-87c8-4020-ae87-d71813892aa4 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:34.320034 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9348a799-bdc0-4048-8de5-f111df1e38d6 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:34.321769 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a48c5-4b53-4dcb-a592-0be1a7355f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:34.322583 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a48c5-4b53-4dcb-a592-0be1a7355f4c admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:34.323023 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a48c5-4b53-4dcb-a592-0be1a7355f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:34.323494 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a48c5-4b53-4dcb-a592-0be1a7355f4c admin admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:34.324573 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a48c5-4b53-4dcb-a592-0be1a7355f4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:09:34.326407 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db85561-ca8e-41f5-95b8-238eae960f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:34.327013 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a48c5-4b53-4dcb-a592-0be1a7355f4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:34.327382 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db85561-ca8e-41f5-95b8-238eae960f88 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:34.327820 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db85561-ca8e-41f5-95b8-238eae960f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:34.328109 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db85561-ca8e-41f5-95b8-238eae960f88 admin admin] PATH_INFO: `/v3/projects/0be1fddabc204b24be75200a24b3ffd7/users/03b6b9afaab54ab893b62c02cb2299e8/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:34.330540 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a48c5-4b53-4dcb-a592-0be1a7355f4c admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:34.355539 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db85561-ca8e-41f5-95b8-238eae960f88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0be1fddabc204b24be75200a24b3ffd7, user_id=03b6b9afaab54ab893b62c02cb2299e8, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:34.359091 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db85561-ca8e-41f5-95b8-238eae960f88 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:34.374392 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 889/1774] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:09:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:09:34.376292 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a48c5-4b53-4dcb-a592-0be1a7355f4c admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:34.377195 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 886/1775] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:34 2022] PUT /identity/v3/projects/0be1fddabc204b24be75200a24b3ffd7/users/03b6b9afaab54ab893b62c02cb2299e8/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:34.388184 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eaecd5-ee56-4d5e-9f5b-8dce671fd247 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:34.388487 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eaecd5-ee56-4d5e-9f5b-8dce671fd247 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:34.388774 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eaecd5-ee56-4d5e-9f5b-8dce671fd247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:34.407440 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a48c5-4b53-4dcb-a592-0be1a7355f4c admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:34.432383 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-e4eaecd5-ee56-4d5e-9f5b-8dce671fd247 None None] MFA Rules not processed for user `03b6b9afaab54ab893b62c02cb2299e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:34.433818 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-e4eaecd5-ee56-4d5e-9f5b-8dce671fd247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:34.500683 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62629d-8780-4a0a-a14c-934dabd86864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:34.501955 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62629d-8780-4a0a-a14c-934dabd86864 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:34.501955 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62629d-8780-4a0a-a14c-934dabd86864 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:34.502223 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62629d-8780-4a0a-a14c-934dabd86864 admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:34.503037 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62629d-8780-4a0a-a14c-934dabd86864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:34.505215 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62629d-8780-4a0a-a14c-934dabd86864 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:34.548978 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 890/1776] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:09:34 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:34.553193 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62629d-8780-4a0a-a14c-934dabd86864 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:34.638867 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 887/1777] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:09:34.644121 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eaecd5-ee56-4d5e-9f5b-8dce671fd247 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:34.689327 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eaecd5-ee56-4d5e-9f5b-8dce671fd247 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:34.752757 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62629d-8780-4a0a-a14c-934dabd86864 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:34.775642 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793a587-c506-47df-90f3-01b455230282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:34.776986 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793a587-c506-47df-90f3-01b455230282 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:34.792623 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793a587-c506-47df-90f3-01b455230282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:34.792623 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793a587-c506-47df-90f3-01b455230282 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:34.794636 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793a587-c506-47df-90f3-01b455230282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:34.801963 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793a587-c506-47df-90f3-01b455230282 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:34.827241 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f3fb7-d8ba-489b-a99c-ec481d401b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:34.828600 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f3fb7-d8ba-489b-a99c-ec481d401b51 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:34.829711 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f3fb7-d8ba-489b-a99c-ec481d401b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:34.830178 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f3fb7-d8ba-489b-a99c-ec481d401b51 admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:34.831117 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f3fb7-d8ba-489b-a99c-ec481d401b51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:34.833902 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f3fb7-d8ba-489b-a99c-ec481d401b51 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:34.856296 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 891/1778] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:09:34 2022] POST /identity/v3/users => generated 293 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:34.859813 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793a587-c506-47df-90f3-01b455230282 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:34.884567 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793a587-c506-47df-90f3-01b455230282 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:34.893106 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 888/1779] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:09:34 2022] POST /identity/v3/projects => generated 379 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:34.895945 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f3fb7-d8ba-489b-a99c-ec481d401b51 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:34.897278 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0929b4-8fef-438c-b0be-b06a159501b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:34.898220 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0929b4-8fef-438c-b0be-b06a159501b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:34.898519 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0929b4-8fef-438c-b0be-b06a159501b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:34.898907 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0929b4-8fef-438c-b0be-b06a159501b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:34.899529 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0929b4-8fef-438c-b0be-b06a159501b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:34.903586 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0929b4-8fef-438c-b0be-b06a159501b8 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:34.943874 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 892/1780] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:34.949086 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0929b4-8fef-438c-b0be-b06a159501b8 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:34.971445 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0929b4-8fef-438c-b0be-b06a159501b8 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:35.153271 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f3fb7-d8ba-489b-a99c-ec481d401b51 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:35.186965 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354eee7-788f-4f84-91da-cf23b99e3cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:35.189529 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354eee7-788f-4f84-91da-cf23b99e3cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:35.196043 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354eee7-788f-4f84-91da-cf23b99e3cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:35.196379 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354eee7-788f-4f84-91da-cf23b99e3cb2 admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:35.201204 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354eee7-788f-4f84-91da-cf23b99e3cb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:35.202039 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5707f9-666a-4264-aad5-863d649f8f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:35.204161 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5707f9-666a-4264-aad5-863d649f8f71 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:35.207922 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5707f9-666a-4264-aad5-863d649f8f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:35.208222 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5707f9-666a-4264-aad5-863d649f8f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:35.211136 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5707f9-666a-4264-aad5-863d649f8f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:35.211545 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354eee7-788f-4f84-91da-cf23b99e3cb2 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:35.217039 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5707f9-666a-4264-aad5-863d649f8f71 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:35.237890 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 893/1781] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:09:35.248412 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5707f9-666a-4264-aad5-863d649f8f71 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:35.293634 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5707f9-666a-4264-aad5-863d649f8f71 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:35.296101 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 889/1782] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:09:34 2022] POST /identity/v3/users => generated 290 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:35.298852 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354eee7-788f-4f84-91da-cf23b99e3cb2 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:35.312515 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195bdd2-fef9-4b9a-96a0-c58254f7e98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:35.313977 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195bdd2-fef9-4b9a-96a0-c58254f7e98a admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:35.315216 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195bdd2-fef9-4b9a-96a0-c58254f7e98a admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:35.316759 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195bdd2-fef9-4b9a-96a0-c58254f7e98a admin admin] PATH_INFO: `/v3/projects/7f17c5d24b5b4c129345cae987eb2c2f/users/54c6feb0da954c0498184877185cf62d/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:35.323138 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354eee7-788f-4f84-91da-cf23b99e3cb2 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:35.360513 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a7875-7b10-4e83-8471-eeb97940d65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:35.360513 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a7875-7b10-4e83-8471-eeb97940d65e admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:35.360513 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a7875-7b10-4e83-8471-eeb97940d65e admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:35.360513 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a7875-7b10-4e83-8471-eeb97940d65e admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:35.369814 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a7875-7b10-4e83-8471-eeb97940d65e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:35.369814 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a7875-7b10-4e83-8471-eeb97940d65e admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:35.369814 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 890/1783] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:35.371538 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a7875-7b10-4e83-8471-eeb97940d65e admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:35.426897 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a7875-7b10-4e83-8471-eeb97940d65e admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:35.428863 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195bdd2-fef9-4b9a-96a0-c58254f7e98a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f17c5d24b5b4c129345cae987eb2c2f, user_id=54c6feb0da954c0498184877185cf62d, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:35.440111 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195bdd2-fef9-4b9a-96a0-c58254f7e98a admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:35.461029 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9c00e-068d-43d3-8d29-d88109c108d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:35.461720 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9c00e-068d-43d3-8d29-d88109c108d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:35.462009 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9c00e-068d-43d3-8d29-d88109c108d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:35.462303 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9c00e-068d-43d3-8d29-d88109c108d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:35.464744 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9c00e-068d-43d3-8d29-d88109c108d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:35.466363 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9c00e-068d-43d3-8d29-d88109c108d1 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:35.512667 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 894/1784] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:35 2022] PUT /identity/v3/projects/7f17c5d24b5b4c129345cae987eb2c2f/users/54c6feb0da954c0498184877185cf62d/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:35.518585 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 891/1785] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:35.520556 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9c00e-068d-43d3-8d29-d88109c108d1 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:35.521660 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1248cbc-6dc1-404c-83e8-dbf58935635a None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:35.523096 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1248cbc-6dc1-404c-83e8-dbf58935635a None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:35.524762 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1248cbc-6dc1-404c-83e8-dbf58935635a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:35.558631 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9c00e-068d-43d3-8d29-d88109c108d1 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:35.627250 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-f1248cbc-6dc1-404c-83e8-dbf58935635a None None] MFA Rules not processed for user `54c6feb0da954c0498184877185cf62d`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:35.631139 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-f1248cbc-6dc1-404c-83e8-dbf58935635a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:35.747105 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfde7c-a82a-4b77-91fb-034b1b3e30a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:35.748074 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfde7c-a82a-4b77-91fb-034b1b3e30a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:35.748358 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfde7c-a82a-4b77-91fb-034b1b3e30a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:35.748636 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfde7c-a82a-4b77-91fb-034b1b3e30a5 admin admin] PATH_INFO: `/v3/projects/ff5c6c52b2174d7abb65e59e2ad42921/users/8250ed491a73421492ce3aae90ffe95a/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:35.809272 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfde7c-a82a-4b77-91fb-034b1b3e30a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff5c6c52b2174d7abb65e59e2ad42921, user_id=8250ed491a73421492ce3aae90ffe95a, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:35.812065 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfde7c-a82a-4b77-91fb-034b1b3e30a5 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:35.839910 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 892/1786] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:35 2022] PUT /identity/v3/projects/ff5c6c52b2174d7abb65e59e2ad42921/users/8250ed491a73421492ce3aae90ffe95a/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:09:35.863101 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed09904-bd96-4bc8-bbbe-704ab35bfc3c None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:35.863505 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed09904-bd96-4bc8-bbbe-704ab35bfc3c None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:35.863755 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed09904-bd96-4bc8-bbbe-704ab35bfc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:35.899822 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 895/1787] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:35.902006 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1248cbc-6dc1-404c-83e8-dbf58935635a None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:35.914596 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1248cbc-6dc1-404c-83e8-dbf58935635a None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:35.947295 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-6ed09904-bd96-4bc8-bbbe-704ab35bfc3c None None] MFA Rules not processed for user `8250ed491a73421492ce3aae90ffe95a`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:35.948609 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-6ed09904-bd96-4bc8-bbbe-704ab35bfc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:36.007019 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51320378-9699-4473-9af7-c882563c57db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:36.008062 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51320378-9699-4473-9af7-c882563c57db admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:36.008575 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51320378-9699-4473-9af7-c882563c57db admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:36.009071 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51320378-9699-4473-9af7-c882563c57db admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:36.009991 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51320378-9699-4473-9af7-c882563c57db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:36.012544 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51320378-9699-4473-9af7-c882563c57db admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:36.134421 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 896/1788] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:09:35 2022] POST /identity/v3/projects => generated 385 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:09:36.138270 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51320378-9699-4473-9af7-c882563c57db admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:36.200728 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 893/1789] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:36.201434 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed09904-bd96-4bc8-bbbe-704ab35bfc3c None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:36.249754 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed09904-bd96-4bc8-bbbe-704ab35bfc3c None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:36.335911 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51320378-9699-4473-9af7-c882563c57db admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:36.366667 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c6e53-726c-4d4b-98c8-7d3a907cef31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:36.368986 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c6e53-726c-4d4b-98c8-7d3a907cef31 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:36.369282 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c6e53-726c-4d4b-98c8-7d3a907cef31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:36.369577 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c6e53-726c-4d4b-98c8-7d3a907cef31 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:36.370377 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c6e53-726c-4d4b-98c8-7d3a907cef31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:36.385177 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c6e53-726c-4d4b-98c8-7d3a907cef31 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:36.427017 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 897/1790] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:09:36 2022] POST /identity/v3/users => generated 293 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:36.430912 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c6e53-726c-4d4b-98c8-7d3a907cef31 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:36.434020 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589f98e-007b-42cd-9524-648d9fbfdc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:36.434755 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589f98e-007b-42cd-9524-648d9fbfdc4b admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:36.435043 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589f98e-007b-42cd-9524-648d9fbfdc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:36.435319 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589f98e-007b-42cd-9524-648d9fbfdc4b admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:36.436114 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589f98e-007b-42cd-9524-648d9fbfdc4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:36.441725 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589f98e-007b-42cd-9524-648d9fbfdc4b admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:36.458078 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c6e53-726c-4d4b-98c8-7d3a907cef31 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:36.468560 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49110caa-cdc9-4c3f-af3e-7764620dcb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:36.470086 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49110caa-cdc9-4c3f-af3e-7764620dcb25 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:36.470551 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49110caa-cdc9-4c3f-af3e-7764620dcb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:36.471019 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49110caa-cdc9-4c3f-af3e-7764620dcb25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:36.476539 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49110caa-cdc9-4c3f-af3e-7764620dcb25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:36.480143 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49110caa-cdc9-4c3f-af3e-7764620dcb25 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:36.512349 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 898/1791] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:36.517022 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49110caa-cdc9-4c3f-af3e-7764620dcb25 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:36.542096 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49110caa-cdc9-4c3f-af3e-7764620dcb25 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:36.548318 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 894/1792] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:09:36 2022] POST /identity/v3/projects => generated 379 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:36.551878 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589f98e-007b-42cd-9524-648d9fbfdc4b admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:36.555526 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037f671-ceff-4fe5-9fa4-5f9c47abd3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:36.556531 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037f671-ceff-4fe5-9fa4-5f9c47abd3ab admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:36.558859 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037f671-ceff-4fe5-9fa4-5f9c47abd3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:36.560443 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037f671-ceff-4fe5-9fa4-5f9c47abd3ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:36.561331 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037f671-ceff-4fe5-9fa4-5f9c47abd3ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:36.570984 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037f671-ceff-4fe5-9fa4-5f9c47abd3ab admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:36.604631 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 899/1793] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:36.615372 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037f671-ceff-4fe5-9fa4-5f9c47abd3ab admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:36.634074 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037f671-ceff-4fe5-9fa4-5f9c47abd3ab admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:36.834576 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589f98e-007b-42cd-9524-648d9fbfdc4b admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:36.851321 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166e68e-04f1-4719-bd8f-8e4d7fa5ebed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:36.854321 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166e68e-04f1-4719-bd8f-8e4d7fa5ebed admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:36.856680 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166e68e-04f1-4719-bd8f-8e4d7fa5ebed admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:36.859327 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166e68e-04f1-4719-bd8f-8e4d7fa5ebed admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:36.860319 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d166e68e-04f1-4719-bd8f-8e4d7fa5ebed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:36.875231 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d166e68e-04f1-4719-bd8f-8e4d7fa5ebed admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:36.891957 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd38f2e-b99f-408d-a203-8305b2e9dc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:36.894485 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd38f2e-b99f-408d-a203-8305b2e9dc84 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:36.897134 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd38f2e-b99f-408d-a203-8305b2e9dc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:36.899444 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd38f2e-b99f-408d-a203-8305b2e9dc84 admin admin] PATH_INFO: `/v3/projects/672a07dbb85c4ab9a75baff8513fae20/users/8dbdfdeaee2d441e9561838a057ed0c3/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:36.945928 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 895/1794] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:09:36 2022] POST /identity/v3/users => generated 296 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:36.949835 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166e68e-04f1-4719-bd8f-8e4d7fa5ebed admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:36.959982 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd38f2e-b99f-408d-a203-8305b2e9dc84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=672a07dbb85c4ab9a75baff8513fae20, user_id=8dbdfdeaee2d441e9561838a057ed0c3, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:36.973470 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd38f2e-b99f-408d-a203-8305b2e9dc84 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:36.992598 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166e68e-04f1-4719-bd8f-8e4d7fa5ebed admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:37.007207 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 900/1795] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:36 2022] PUT /identity/v3/projects/672a07dbb85c4ab9a75baff8513fae20/users/8dbdfdeaee2d441e9561838a057ed0c3/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:09:37.020258 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e328d-f676-4e8b-bb13-3a12c10dcc74 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:37.020807 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e328d-f676-4e8b-bb13-3a12c10dcc74 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:37.021060 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e328d-f676-4e8b-bb13-3a12c10dcc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:37.166595 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-166e328d-f676-4e8b-bb13-3a12c10dcc74 None None] MFA Rules not processed for user `8dbdfdeaee2d441e9561838a057ed0c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:37.172120 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-166e328d-f676-4e8b-bb13-3a12c10dcc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:37.302716 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8b8705-81e9-4a96-b5d2-7bdf1cf9f43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:37.303659 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b8705-81e9-4a96-b5d2-7bdf1cf9f43e admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:37.305754 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b8705-81e9-4a96-b5d2-7bdf1cf9f43e admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:37.306285 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b8705-81e9-4a96-b5d2-7bdf1cf9f43e admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:37.307257 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8b8705-81e9-4a96-b5d2-7bdf1cf9f43e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:37.310184 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8b8705-81e9-4a96-b5d2-7bdf1cf9f43e admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:37.362956 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 896/1796] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:37.364782 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8b8705-81e9-4a96-b5d2-7bdf1cf9f43e admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:37.386587 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8b8705-81e9-4a96-b5d2-7bdf1cf9f43e admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:37.410388 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093e626-bdd0-428d-a8c7-a18866870f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:37.411560 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093e626-bdd0-428d-a8c7-a18866870f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:37.413909 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093e626-bdd0-428d-a8c7-a18866870f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:37.415316 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093e626-bdd0-428d-a8c7-a18866870f63 admin admin] PATH_INFO: `/v3/projects/6082886ab24a4331b30923afb34fefea/users/2a21cb6f34b947cf80562940cadc6717/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:37.469884 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 901/1797] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:09:37.472339 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e328d-f676-4e8b-bb13-3a12c10dcc74 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:37.482180 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093e626-bdd0-428d-a8c7-a18866870f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6082886ab24a4331b30923afb34fefea, user_id=2a21cb6f34b947cf80562940cadc6717, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:37.492622 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093e626-bdd0-428d-a8c7-a18866870f63 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:37.521069 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e328d-f676-4e8b-bb13-3a12c10dcc74 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:37.526498 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 897/1798] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:37 2022] PUT /identity/v3/projects/6082886ab24a4331b30923afb34fefea/users/2a21cb6f34b947cf80562940cadc6717/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:37.548099 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093e626-bdd0-428d-a8c7-a18866870f63 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:37.740434 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affb333-f758-4d54-a839-a6429694dcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:37.742332 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affb333-f758-4d54-a839-a6429694dcaa admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:37.743212 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affb333-f758-4d54-a839-a6429694dcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:37.746016 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affb333-f758-4d54-a839-a6429694dcaa admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:37.746792 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7affb333-f758-4d54-a839-a6429694dcaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:37.756314 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7affb333-f758-4d54-a839-a6429694dcaa admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:37.764357 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093e626-bdd0-428d-a8c7-a18866870f63 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:37.777532 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585dbfb2-e493-4827-b998-57ea894fb15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:37.778233 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585dbfb2-e493-4827-b998-57ea894fb15a admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:37.778525 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585dbfb2-e493-4827-b998-57ea894fb15a admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:37.778809 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585dbfb2-e493-4827-b998-57ea894fb15a admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:37.779813 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585dbfb2-e493-4827-b998-57ea894fb15a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:37.781851 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585dbfb2-e493-4827-b998-57ea894fb15a admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:37.811663 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 898/1799] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:37.816578 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585dbfb2-e493-4827-b998-57ea894fb15a admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:37.901767 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 902/1800] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:09:37 2022] POST /identity/v3/projects => generated 383 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:37.907892 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affb333-f758-4d54-a839-a6429694dcaa admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:37.933140 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585dbfb2-e493-4827-b998-57ea894fb15a admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:38.061866 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacba4e1-8833-4260-8eef-049a623ef075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:38.066572 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacba4e1-8833-4260-8eef-049a623ef075 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:38.067716 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacba4e1-8833-4260-8eef-049a623ef075 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:38.068819 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacba4e1-8833-4260-8eef-049a623ef075 admin admin] PATH_INFO: `/v3/projects/6082886ab24a4331b30923afb34fefea/users/2a21cb6f34b947cf80562940cadc6717/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:38.076115 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacba4e1-8833-4260-8eef-049a623ef075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6082886ab24a4331b30923afb34fefea, user_id=2a21cb6f34b947cf80562940cadc6717, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:38.080073 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacba4e1-8833-4260-8eef-049a623ef075 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:38.098681 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 899/1801] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:37 2022] PUT /identity/v3/projects/6082886ab24a4331b30923afb34fefea/users/2a21cb6f34b947cf80562940cadc6717/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:38.116429 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4e111-42f8-423d-b7e7-85f161175b05 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:38.117351 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4e111-42f8-423d-b7e7-85f161175b05 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:38.118312 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4e111-42f8-423d-b7e7-85f161175b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:38.119289 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affb333-f758-4d54-a839-a6429694dcaa admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:38.182054 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-69f4e111-42f8-423d-b7e7-85f161175b05 None None] MFA Rules not processed for user `2a21cb6f34b947cf80562940cadc6717`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:38.184512 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-69f4e111-42f8-423d-b7e7-85f161175b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:38.283411 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f0a32-70a4-4b1d-8e57-ec11a842210c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:38.285458 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f0a32-70a4-4b1d-8e57-ec11a842210c admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:38.286000 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f0a32-70a4-4b1d-8e57-ec11a842210c admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:38.286489 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f0a32-70a4-4b1d-8e57-ec11a842210c admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:38.287570 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f0a32-70a4-4b1d-8e57-ec11a842210c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:38.292309 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f0a32-70a4-4b1d-8e57-ec11a842210c admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:38.329684 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 903/1802] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:09:37 2022] POST /identity/v3/users => generated 298 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:38.329868 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 900/1803] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:38 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:38.332179 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f0a32-70a4-4b1d-8e57-ec11a842210c admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:38.342252 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4e111-42f8-423d-b7e7-85f161175b05 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:38.344319 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-69f4e111-42f8-423d-b7e7-85f161175b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:38.344739 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f0a32-70a4-4b1d-8e57-ec11a842210c admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:38.350411 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee489ab-66c2-4083-a7ab-cec2466aa6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:38.351588 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee489ab-66c2-4083-a7ab-cec2466aa6ef admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:38.351922 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee489ab-66c2-4083-a7ab-cec2466aa6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:38.352209 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee489ab-66c2-4083-a7ab-cec2466aa6ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:38.353128 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee489ab-66c2-4083-a7ab-cec2466aa6ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:38.354842 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee489ab-66c2-4083-a7ab-cec2466aa6ef admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:38.373579 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 904/1804] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:09:38.387351 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee489ab-66c2-4083-a7ab-cec2466aa6ef admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:38.406418 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee489ab-66c2-4083-a7ab-cec2466aa6ef admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:38.409687 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4e111-42f8-423d-b7e7-85f161175b05 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:38.413161 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4302b9-75e8-4105-8841-ee05580e0011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:38.414538 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4302b9-75e8-4105-8841-ee05580e0011 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:38.414538 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4302b9-75e8-4105-8841-ee05580e0011 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:38.414870 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4302b9-75e8-4105-8841-ee05580e0011 admin admin] PATH_INFO: `/v3/projects/812379f1061243ff80382e8f41e3a3df/users/77c183b02bd24e3caf24c55bae8a8d63/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:38.415139 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b57b89-62f8-4be5-866c-bb8948d225e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:38.416614 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b57b89-62f8-4be5-866c-bb8948d225e9 service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:38.417452 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b57b89-62f8-4be5-866c-bb8948d225e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:38.417910 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b57b89-62f8-4be5-866c-bb8948d225e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:38.430913 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b57b89-62f8-4be5-866c-bb8948d225e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:38.434113 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b57b89-62f8-4be5-866c-bb8948d225e9 service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:38.450539 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 901/1805] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:38 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:09:38.461145 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4302b9-75e8-4105-8841-ee05580e0011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=812379f1061243ff80382e8f41e3a3df, user_id=77c183b02bd24e3caf24c55bae8a8d63, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:38.466956 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4302b9-75e8-4105-8841-ee05580e0011 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:38.499789 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 905/1806] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:38 2022] PUT /identity/v3/projects/812379f1061243ff80382e8f41e3a3df/users/77c183b02bd24e3caf24c55bae8a8d63/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:38.509219 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b57b89-62f8-4be5-866c-bb8948d225e9 service cinder] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:38.520975 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4302b9-75e8-4105-8841-ee05580e0011 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:38.523229 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-0d4302b9-75e8-4105-8841-ee05580e0011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:38.527078 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b57b89-62f8-4be5-866c-bb8948d225e9 service cinder] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:38.614916 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83dd45-f3f7-4e7c-b408-8a95b171729a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:38.616009 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83dd45-f3f7-4e7c-b408-8a95b171729a admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:38.616401 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83dd45-f3f7-4e7c-b408-8a95b171729a admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:38.617525 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4302b9-75e8-4105-8841-ee05580e0011 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:38.617649 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83dd45-f3f7-4e7c-b408-8a95b171729a admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:38.618677 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83dd45-f3f7-4e7c-b408-8a95b171729a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:38.620575 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83dd45-f3f7-4e7c-b408-8a95b171729a admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:38.623150 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b8497-80f9-499a-a9ac-a6315ede8ce5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:38.623866 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b8497-80f9-499a-a9ac-a6315ede8ce5 service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:38.624423 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b8497-80f9-499a-a9ac-a6315ede8ce5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:38.628898 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b8497-80f9-499a-a9ac-a6315ede8ce5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:38.659573 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 902/1807] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:38.660763 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83dd45-f3f7-4e7c-b408-8a95b171729a admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:38.686745 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83dd45-f3f7-4e7c-b408-8a95b171729a admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:38.700394 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868b61e-d94c-4758-ab6a-5a07f761c07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:38.702366 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868b61e-d94c-4758-ab6a-5a07f761c07c admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:38.702885 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868b61e-d94c-4758-ab6a-5a07f761c07c admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:38.703383 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868b61e-d94c-4758-ab6a-5a07f761c07c admin admin] PATH_INFO: `/v3/projects/812379f1061243ff80382e8f41e3a3df/users/77c183b02bd24e3caf24c55bae8a8d63/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:38.709211 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868b61e-d94c-4758-ab6a-5a07f761c07c admin admin] RBAC: Authorizing `identity:create_grant(project_id=812379f1061243ff80382e8f41e3a3df, user_id=77c183b02bd24e3caf24c55bae8a8d63, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:38.715928 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868b61e-d94c-4758-ab6a-5a07f761c07c admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:38.754033 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 903/1808] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:38 2022] PUT /identity/v3/projects/812379f1061243ff80382e8f41e3a3df/users/77c183b02bd24e3caf24c55bae8a8d63/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:38.768988 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b99a6a-5c53-4243-bf05-b5e377b11373 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:38.770972 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b99a6a-5c53-4243-bf05-b5e377b11373 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:38.773868 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b99a6a-5c53-4243-bf05-b5e377b11373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:38.777166 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b8497-80f9-499a-a9ac-a6315ede8ce5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:38.778847 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b8497-80f9-499a-a9ac-a6315ede8ce5 service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:38.822751 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 906/1809] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:09:38.826488 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaba1e1-7bdc-4ef4-b530-50a406c40c48 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:38.827802 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaba1e1-7bdc-4ef4-b530-50a406c40c48 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:38.828104 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaba1e1-7bdc-4ef4-b530-50a406c40c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:38.859244 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-b0b99a6a-5c53-4243-bf05-b5e377b11373 None None] MFA Rules not processed for user `77c183b02bd24e3caf24c55bae8a8d63`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:38.861392 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-b0b99a6a-5c53-4243-bf05-b5e377b11373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:38.865203 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-daaba1e1-7bdc-4ef4-b530-50a406c40c48 None None] MFA Rules not processed for user `382fc34b389c4338b8e9fcae2b4d89e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:38.868837 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-daaba1e1-7bdc-4ef4-b530-50a406c40c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:38.996688 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 907/1810] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:38.996688 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaba1e1-7bdc-4ef4-b530-50a406c40c48 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:39.001915 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-daaba1e1-7bdc-4ef4-b530-50a406c40c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:39.082962 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 904/1811] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:39.102457 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b99a6a-5c53-4243-bf05-b5e377b11373 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:39.204789 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaba1e1-7bdc-4ef4-b530-50a406c40c48 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:39.223578 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724353d-2501-4d7c-8b51-f364e97ca148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:39.229531 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b99a6a-5c53-4243-bf05-b5e377b11373 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:39.229821 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724353d-2501-4d7c-8b51-f364e97ca148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:39.231889 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724353d-2501-4d7c-8b51-f364e97ca148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:39.232187 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724353d-2501-4d7c-8b51-f364e97ca148 admin admin] PATH_INFO: `/v3/users/ff55ef01af224392a4e76207e393ada9` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:39.233967 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0724353d-2501-4d7c-8b51-f364e97ca148 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff55ef01af224392a4e76207e393ada9)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:39.236218 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0724353d-2501-4d7c-8b51-f364e97ca148 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:39.238689 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82141c9-8cb3-4baf-a9c9-26f8ad95da6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:39.239648 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82141c9-8cb3-4baf-a9c9-26f8ad95da6e service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:39.239648 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82141c9-8cb3-4baf-a9c9-26f8ad95da6e service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:39.240019 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82141c9-8cb3-4baf-a9c9-26f8ad95da6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:39.253955 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82141c9-8cb3-4baf-a9c9-26f8ad95da6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:39.256194 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82141c9-8cb3-4baf-a9c9-26f8ad95da6e service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:39.271364 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 905/1812] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:39.305239 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-0724353d-2501-4d7c-8b51-f364e97ca148 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff55ef01af224392a4e76207e393ada9'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:39.314312 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-0724353d-2501-4d7c-8b51-f364e97ca148 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff55ef01af224392a4e76207e393ada9'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:39.324515 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-0724353d-2501-4d7c-8b51-f364e97ca148 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff55ef01af224392a4e76207e393ada9'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:39.339935 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-0724353d-2501-4d7c-8b51-f364e97ca148 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff55ef01af224392a4e76207e393ada9'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:39.341004 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-0724353d-2501-4d7c-8b51-f364e97ca148 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff55ef01af224392a4e76207e393ada9'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:39.351874 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 908/1813] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:09:38 2022] DELETE /identity/v3/users/ff55ef01af224392a4e76207e393ada9 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:39.354710 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54228b2-8db7-4b16-9cc9-d428ec2afbc2 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:39.355281 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54228b2-8db7-4b16-9cc9-d428ec2afbc2 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:39.355281 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54228b2-8db7-4b16-9cc9-d428ec2afbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:39.378510 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-f54228b2-8db7-4b16-9cc9-d428ec2afbc2 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:39.381046 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-f54228b2-8db7-4b16-9cc9-d428ec2afbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:39.487931 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 906/1814] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:09:39.497426 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724353d-2501-4d7c-8b51-f364e97ca148 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:39.498831 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-0724353d-2501-4d7c-8b51-f364e97ca148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:39.562204 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724353d-2501-4d7c-8b51-f364e97ca148 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:39.566367 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57156950-1f48-44bd-817c-2f33414a7756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:39.567010 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57156950-1f48-44bd-817c-2f33414a7756 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:39.567737 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57156950-1f48-44bd-817c-2f33414a7756 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:39.567737 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57156950-1f48-44bd-817c-2f33414a7756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:39.577904 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57156950-1f48-44bd-817c-2f33414a7756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:39.580149 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57156950-1f48-44bd-817c-2f33414a7756 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:39.590409 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 909/1815] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:39.937699 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54228b2-8db7-4b16-9cc9-d428ec2afbc2 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:39.939735 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-f54228b2-8db7-4b16-9cc9-d428ec2afbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:39.996949 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57156950-1f48-44bd-817c-2f33414a7756 service neutron] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:39.998496 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-57156950-1f48-44bd-817c-2f33414a7756 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:40.019352 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57156950-1f48-44bd-817c-2f33414a7756 service neutron] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:40.022726 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54228b2-8db7-4b16-9cc9-d428ec2afbc2 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:40.027194 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768d3c6-7090-4f5f-9298-8be339baca44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:40.028073 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768d3c6-7090-4f5f-9298-8be339baca44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:40.028523 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768d3c6-7090-4f5f-9298-8be339baca44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:40.028748 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768d3c6-7090-4f5f-9298-8be339baca44 admin admin] PATH_INFO: `/v3/projects/c6b23ac16a604e1ca30336960b7feead` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:40.029947 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768d3c6-7090-4f5f-9298-8be339baca44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6b23ac16a604e1ca30336960b7feead)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:40.032625 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768d3c6-7090-4f5f-9298-8be339baca44 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:40.034910 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422113ba-f409-4d04-85b0-ec59b2e7f041 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:40.035782 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422113ba-f409-4d04-85b0-ec59b2e7f041 service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:40.035954 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422113ba-f409-4d04-85b0-ec59b2e7f041 service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:40.036239 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422113ba-f409-4d04-85b0-ec59b2e7f041 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:40.038899 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-422113ba-f409-4d04-85b0-ec59b2e7f041 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:40.099950 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-6768d3c6-7090-4f5f-9298-8be339baca44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6b23ac16a604e1ca30336960b7feead', 'request_id': 'req-6768d3c6-7090-4f5f-9298-8be339baca44'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:40.121808 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422113ba-f409-4d04-85b0-ec59b2e7f041 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:40.123748 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422113ba-f409-4d04-85b0-ec59b2e7f041 service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:40.123862 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-6768d3c6-7090-4f5f-9298-8be339baca44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6b23ac16a604e1ca30336960b7feead', 'request_id': 'req-6768d3c6-7090-4f5f-9298-8be339baca44'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:40.146012 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-6768d3c6-7090-4f5f-9298-8be339baca44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6b23ac16a604e1ca30336960b7feead', 'request_id': 'req-6768d3c6-7090-4f5f-9298-8be339baca44'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:40.148676 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 907/1816] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:40.167729 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-6768d3c6-7090-4f5f-9298-8be339baca44 admin admin] The token cache is being invalidate because project c6b23ac16a604e1ca30336960b7feead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:09:40.168257 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-6768d3c6-7090-4f5f-9298-8be339baca44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:40.169167 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-6768d3c6-7090-4f5f-9298-8be339baca44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:40.171392 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 910/1817] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:09:39 2022] DELETE /identity/v3/projects/c6b23ac16a604e1ca30336960b7feead => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:09:40.176286 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422113ba-f409-4d04-85b0-ec59b2e7f041 service cinder] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:40.189542 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422113ba-f409-4d04-85b0-ec59b2e7f041 service cinder] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:40.272548 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60eb04b-3ab1-4f6c-98b1-0bca8fd01389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:40.273846 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60eb04b-3ab1-4f6c-98b1-0bca8fd01389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:40.274133 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60eb04b-3ab1-4f6c-98b1-0bca8fd01389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:40.274573 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60eb04b-3ab1-4f6c-98b1-0bca8fd01389 admin admin] PATH_INFO: `/v3/users/d5253c1b56b447a590d584c240e9d658` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:40.276278 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60eb04b-3ab1-4f6c-98b1-0bca8fd01389 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5253c1b56b447a590d584c240e9d658)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:40.278298 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60eb04b-3ab1-4f6c-98b1-0bca8fd01389 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:40.337447 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b60eb04b-3ab1-4f6c-98b1-0bca8fd01389 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5253c1b56b447a590d584c240e9d658'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:40.338683 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b60eb04b-3ab1-4f6c-98b1-0bca8fd01389 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5253c1b56b447a590d584c240e9d658'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:40.347404 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b60eb04b-3ab1-4f6c-98b1-0bca8fd01389 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5253c1b56b447a590d584c240e9d658'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:40.374266 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b60eb04b-3ab1-4f6c-98b1-0bca8fd01389 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5253c1b56b447a590d584c240e9d658'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:40.375075 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b60eb04b-3ab1-4f6c-98b1-0bca8fd01389 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5253c1b56b447a590d584c240e9d658'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:40.396478 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 908/1818] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:09:40 2022] DELETE /identity/v3/users/d5253c1b56b447a590d584c240e9d658 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:40.734750 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768d3c6-7090-4f5f-9298-8be339baca44 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:40.736211 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-6768d3c6-7090-4f5f-9298-8be339baca44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:40.749663 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768d3c6-7090-4f5f-9298-8be339baca44 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:40.820886 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e3866-c844-4baf-9ffc-085ce146bec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:40.822344 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e3866-c844-4baf-9ffc-085ce146bec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:40.822638 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e3866-c844-4baf-9ffc-085ce146bec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:40.822917 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e3866-c844-4baf-9ffc-085ce146bec8 admin admin] PATH_INFO: `/v3/projects/94aef85922ee4210a4709c72c09e6cda` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:40.826617 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e3866-c844-4baf-9ffc-085ce146bec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94aef85922ee4210a4709c72c09e6cda)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:40.829199 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e3866-c844-4baf-9ffc-085ce146bec8 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:40.931161 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-fe7e3866-c844-4baf-9ffc-085ce146bec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94aef85922ee4210a4709c72c09e6cda', 'request_id': 'req-fe7e3866-c844-4baf-9ffc-085ce146bec8'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:40.944423 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-fe7e3866-c844-4baf-9ffc-085ce146bec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94aef85922ee4210a4709c72c09e6cda', 'request_id': 'req-fe7e3866-c844-4baf-9ffc-085ce146bec8'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:40.951239 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-fe7e3866-c844-4baf-9ffc-085ce146bec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94aef85922ee4210a4709c72c09e6cda', 'request_id': 'req-fe7e3866-c844-4baf-9ffc-085ce146bec8'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:40.972633 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-fe7e3866-c844-4baf-9ffc-085ce146bec8 admin admin] The token cache is being invalidate because project 94aef85922ee4210a4709c72c09e6cda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:09:40.972966 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-fe7e3866-c844-4baf-9ffc-085ce146bec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:40.973659 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-fe7e3866-c844-4baf-9ffc-085ce146bec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:40.978489 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 911/1819] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:09:40 2022] DELETE /identity/v3/projects/94aef85922ee4210a4709c72c09e6cda => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:40.980691 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5b4bf-9b65-4ccf-a92f-31c587b53b21 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:40.981546 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5b4bf-9b65-4ccf-a92f-31c587b53b21 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:40.982029 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5b4bf-9b65-4ccf-a92f-31c587b53b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:41.005360 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-d8c5b4bf-9b65-4ccf-a92f-31c587b53b21 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:41.006731 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-d8c5b4bf-9b65-4ccf-a92f-31c587b53b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:41.086679 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 909/1820] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:41.094589 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088b5d9-a0b0-4ebc-add9-8f5dec709e67 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:41.095097 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088b5d9-a0b0-4ebc-add9-8f5dec709e67 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:41.095556 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088b5d9-a0b0-4ebc-add9-8f5dec709e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:41.122049 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-d088b5d9-a0b0-4ebc-add9-8f5dec709e67 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:41.123533 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-d088b5d9-a0b0-4ebc-add9-8f5dec709e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:41.138236 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 912/1821] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:41.143008 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5b4bf-9b65-4ccf-a92f-31c587b53b21 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:41.158447 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5b4bf-9b65-4ccf-a92f-31c587b53b21 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:41.177521 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bf52e-24e1-487a-b0ac-0af4f0cf0f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:41.179537 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bf52e-24e1-487a-b0ac-0af4f0cf0f97 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:41.180474 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bf52e-24e1-487a-b0ac-0af4f0cf0f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:41.180474 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bf52e-24e1-487a-b0ac-0af4f0cf0f97 admin admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:41.181310 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bf52e-24e1-487a-b0ac-0af4f0cf0f97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:09:41.181704 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bf52e-24e1-487a-b0ac-0af4f0cf0f97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:41.184058 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bf52e-24e1-487a-b0ac-0af4f0cf0f97 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:41.203193 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 910/1822] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:09:41.206336 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088b5d9-a0b0-4ebc-add9-8f5dec709e67 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:41.216030 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088b5d9-a0b0-4ebc-add9-8f5dec709e67 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:41.221078 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265e168-0182-49cf-8fa4-c2138eed5591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:41.221758 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265e168-0182-49cf-8fa4-c2138eed5591 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:41.222047 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265e168-0182-49cf-8fa4-c2138eed5591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:41.222324 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265e168-0182-49cf-8fa4-c2138eed5591 admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:41.223079 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265e168-0182-49cf-8fa4-c2138eed5591 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:41.225056 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265e168-0182-49cf-8fa4-c2138eed5591 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:41.255719 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 913/1823] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:09:41 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:09:41.257265 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bf52e-24e1-487a-b0ac-0af4f0cf0f97 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:41.267934 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bf52e-24e1-487a-b0ac-0af4f0cf0f97 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:41.327444 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58830f-402e-4216-8026-84544b534ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:41.328148 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58830f-402e-4216-8026-84544b534ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:41.328428 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58830f-402e-4216-8026-84544b534ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:41.328704 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58830f-402e-4216-8026-84544b534ce3 admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:41.329397 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e58830f-402e-4216-8026-84544b534ce3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:41.331305 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e58830f-402e-4216-8026-84544b534ce3 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:41.353532 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 911/1824] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:09:41 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:41.354970 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265e168-0182-49cf-8fa4-c2138eed5591 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:41.373238 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265e168-0182-49cf-8fa4-c2138eed5591 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:41.380766 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155105e-c8ef-4748-9d1a-8eaebba24b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:41.381627 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155105e-c8ef-4748-9d1a-8eaebba24b23 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:41.382064 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155105e-c8ef-4748-9d1a-8eaebba24b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:41.382336 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155105e-c8ef-4748-9d1a-8eaebba24b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:41.383058 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155105e-c8ef-4748-9d1a-8eaebba24b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:41.384697 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155105e-c8ef-4748-9d1a-8eaebba24b23 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:41.396318 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 914/1825] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:41.400551 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58830f-402e-4216-8026-84544b534ce3 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:41.424255 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58830f-402e-4216-8026-84544b534ce3 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:41.431528 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaca699-2507-4f30-b058-0d27694ca584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:41.432365 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaca699-2507-4f30-b058-0d27694ca584 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:41.432670 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaca699-2507-4f30-b058-0d27694ca584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:41.432946 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaca699-2507-4f30-b058-0d27694ca584 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:41.434124 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaca699-2507-4f30-b058-0d27694ca584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:41.436007 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaca699-2507-4f30-b058-0d27694ca584 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:41.455554 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 912/1826] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:41.456810 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155105e-c8ef-4748-9d1a-8eaebba24b23 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:41.470048 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155105e-c8ef-4748-9d1a-8eaebba24b23 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:41.475207 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef31ed6-4833-4082-9a12-0f02425d7f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:41.476697 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef31ed6-4833-4082-9a12-0f02425d7f13 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:41.477093 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef31ed6-4833-4082-9a12-0f02425d7f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:41.477442 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef31ed6-4833-4082-9a12-0f02425d7f13 admin admin] PATH_INFO: `/v3/projects/d683d0501e024e99a9e828cef84d40f6/users/39b0ea594bf243d3a48d4130b8e08419/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:41.502048 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef31ed6-4833-4082-9a12-0f02425d7f13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d683d0501e024e99a9e828cef84d40f6, user_id=39b0ea594bf243d3a48d4130b8e08419, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:41.504757 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef31ed6-4833-4082-9a12-0f02425d7f13 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:41.535286 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 915/1827] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:41 2022] PUT /identity/v3/projects/d683d0501e024e99a9e828cef84d40f6/users/39b0ea594bf243d3a48d4130b8e08419/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:41.537197 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604db4f-36db-426a-94f1-f31701cd6e36 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:41.537774 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604db4f-36db-426a-94f1-f31701cd6e36 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:41.538282 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604db4f-36db-426a-94f1-f31701cd6e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:41.601414 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-7604db4f-36db-426a-94f1-f31701cd6e36 None None] MFA Rules not processed for user `39b0ea594bf243d3a48d4130b8e08419`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:41.601414 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-7604db4f-36db-426a-94f1-f31701cd6e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:41.697131 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 913/1828] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:41.701930 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef31ed6-4833-4082-9a12-0f02425d7f13 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:41.812530 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef31ed6-4833-4082-9a12-0f02425d7f13 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:41.817544 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d363d-9681-47bb-abc1-6dca800b5fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:41.818107 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d363d-9681-47bb-abc1-6dca800b5fc7 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:41.824163 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d363d-9681-47bb-abc1-6dca800b5fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:41.824464 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d363d-9681-47bb-abc1-6dca800b5fc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:41.825237 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d363d-9681-47bb-abc1-6dca800b5fc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:41.827144 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d363d-9681-47bb-abc1-6dca800b5fc7 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:41.868498 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 916/1829] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:09:41 2022] POST /identity/v3/projects => generated 381 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:41.869719 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604db4f-36db-426a-94f1-f31701cd6e36 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:41.885507 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604db4f-36db-426a-94f1-f31701cd6e36 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:41.956868 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d91e82-b6a0-4ba5-92b1-ca73f807591f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:41.957554 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d91e82-b6a0-4ba5-92b1-ca73f807591f admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:41.957839 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d91e82-b6a0-4ba5-92b1-ca73f807591f admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:41.958121 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d91e82-b6a0-4ba5-92b1-ca73f807591f admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:41.958824 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d91e82-b6a0-4ba5-92b1-ca73f807591f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:41.960799 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d91e82-b6a0-4ba5-92b1-ca73f807591f admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:41.990615 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 914/1830] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:09:41 2022] POST /identity/v3/users => generated 297 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:41.991864 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d363d-9681-47bb-abc1-6dca800b5fc7 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:42.005094 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d363d-9681-47bb-abc1-6dca800b5fc7 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:42.010106 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ceac5e-8f06-430e-948d-0d8cadb43472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:42.011414 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ceac5e-8f06-430e-948d-0d8cadb43472 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:42.011802 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ceac5e-8f06-430e-948d-0d8cadb43472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:42.012039 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ceac5e-8f06-430e-948d-0d8cadb43472 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:42.013132 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ceac5e-8f06-430e-948d-0d8cadb43472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:42.015153 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ceac5e-8f06-430e-948d-0d8cadb43472 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:42.027730 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 917/1831] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:42.032440 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d91e82-b6a0-4ba5-92b1-ca73f807591f admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:42.051863 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d91e82-b6a0-4ba5-92b1-ca73f807591f admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:42.057168 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618cb16-a1b3-4e9e-8c82-7184740bbf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:42.057937 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618cb16-a1b3-4e9e-8c82-7184740bbf27 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:42.058280 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618cb16-a1b3-4e9e-8c82-7184740bbf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:42.058539 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618cb16-a1b3-4e9e-8c82-7184740bbf27 admin admin] PATH_INFO: `/v3/projects/86d657a6212645f0bfa4c6dbc306a1c7/users/602aea275b2d48ec9b22db6b7b55b787/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:42.087112 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6618cb16-a1b3-4e9e-8c82-7184740bbf27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86d657a6212645f0bfa4c6dbc306a1c7, user_id=602aea275b2d48ec9b22db6b7b55b787, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:42.093755 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6618cb16-a1b3-4e9e-8c82-7184740bbf27 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:42.105167 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 915/1832] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:42 2022] PUT /identity/v3/projects/86d657a6212645f0bfa4c6dbc306a1c7/users/602aea275b2d48ec9b22db6b7b55b787/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:42.108878 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ceac5e-8f06-430e-948d-0d8cadb43472 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:42.120674 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ceac5e-8f06-430e-948d-0d8cadb43472 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:42.190506 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce189d87-028e-43ab-8a21-1730a448200a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:42.191139 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce189d87-028e-43ab-8a21-1730a448200a admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:42.191421 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce189d87-028e-43ab-8a21-1730a448200a admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:42.191989 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce189d87-028e-43ab-8a21-1730a448200a admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:42.192709 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce189d87-028e-43ab-8a21-1730a448200a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:42.194711 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce189d87-028e-43ab-8a21-1730a448200a admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:42.208650 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 918/1833] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:42.213045 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618cb16-a1b3-4e9e-8c82-7184740bbf27 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:42.225840 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618cb16-a1b3-4e9e-8c82-7184740bbf27 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:42.231059 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ddfa8-ad55-40f7-8aa5-1e231ed5da81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:42.232006 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ddfa8-ad55-40f7-8aa5-1e231ed5da81 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:42.232319 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ddfa8-ad55-40f7-8aa5-1e231ed5da81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:42.232602 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ddfa8-ad55-40f7-8aa5-1e231ed5da81 admin admin] PATH_INFO: `/v3/projects/86d657a6212645f0bfa4c6dbc306a1c7/users/602aea275b2d48ec9b22db6b7b55b787/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:42.234637 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ddfa8-ad55-40f7-8aa5-1e231ed5da81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86d657a6212645f0bfa4c6dbc306a1c7, user_id=602aea275b2d48ec9b22db6b7b55b787, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:42.237744 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ddfa8-ad55-40f7-8aa5-1e231ed5da81 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:42.248790 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 916/1834] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:42 2022] PUT /identity/v3/projects/86d657a6212645f0bfa4c6dbc306a1c7/users/602aea275b2d48ec9b22db6b7b55b787/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:42.259790 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d83cf6-695f-492f-9a8f-9bfc055330d6 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:42.260256 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d83cf6-695f-492f-9a8f-9bfc055330d6 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:42.260540 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d83cf6-695f-492f-9a8f-9bfc055330d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:42.286810 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-d2d83cf6-695f-492f-9a8f-9bfc055330d6 None None] MFA Rules not processed for user `602aea275b2d48ec9b22db6b7b55b787`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:42.288081 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-d2d83cf6-695f-492f-9a8f-9bfc055330d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:42.314286 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029f5be-ce89-4f91-9d17-4bb3a8f7404b None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:42.314609 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029f5be-ce89-4f91-9d17-4bb3a8f7404b None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:42.314856 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029f5be-ce89-4f91-9d17-4bb3a8f7404b None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:42.317035 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 917/1835] 10.222.0.15 () {54 vars in 921 bytes} [Thu Mar 10 04:09:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:09:42.331412 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b758be-cbab-412f-857b-76ef6ac6d3a9 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:42.331744 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b758be-cbab-412f-857b-76ef6ac6d3a9 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:42.332003 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b758be-cbab-412f-857b-76ef6ac6d3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:42.355449 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 919/1836] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:42.361039 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-78b758be-cbab-412f-857b-76ef6ac6d3a9 None None] MFA Rules not processed for user `fbd92bd14ed04621af06d68161798fe3`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:42.362309 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-78b758be-cbab-412f-857b-76ef6ac6d3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:42.378971 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d83cf6-695f-492f-9a8f-9bfc055330d6 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:42.380461 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-d2d83cf6-695f-492f-9a8f-9bfc055330d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:42.430559 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 918/1837] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Mar 10 04:09:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:42.435040 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d83cf6-695f-492f-9a8f-9bfc055330d6 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:42.439471 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6123f75-097c-44f6-a1ac-60053e54f61a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:42.440146 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6123f75-097c-44f6-a1ac-60053e54f61a service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:42.440489 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6123f75-097c-44f6-a1ac-60053e54f61a service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:42.440774 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6123f75-097c-44f6-a1ac-60053e54f61a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:42.443339 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b758be-cbab-412f-857b-76ef6ac6d3a9 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:42.444923 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-78b758be-cbab-412f-857b-76ef6ac6d3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:42.450229 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6123f75-097c-44f6-a1ac-60053e54f61a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:42.451631 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6123f75-097c-44f6-a1ac-60053e54f61a service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:42.459094 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b758be-cbab-412f-857b-76ef6ac6d3a9 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:42.461623 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 920/1838] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:09:42.464479 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db5c65-4894-48d1-bff6-577c957a804b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:42.465118 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db5c65-4894-48d1-bff6-577c957a804b service nova] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:42.465403 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db5c65-4894-48d1-bff6-577c957a804b service nova] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:42.465678 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db5c65-4894-48d1-bff6-577c957a804b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:42.474948 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db5c65-4894-48d1-bff6-577c957a804b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:42.476617 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db5c65-4894-48d1-bff6-577c957a804b service nova] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:42.490327 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 919/1839] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:09:43.005115 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6123f75-097c-44f6-a1ac-60053e54f61a service cinder] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:43.068310 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6123f75-097c-44f6-a1ac-60053e54f61a service cinder] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:43.073428 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1824d-0956-45a3-8c99-e2219d5d1907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:43.074294 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1824d-0956-45a3-8c99-e2219d5d1907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:43.074606 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1824d-0956-45a3-8c99-e2219d5d1907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:43.074880 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1824d-0956-45a3-8c99-e2219d5d1907 admin admin] PATH_INFO: `/v3/users/39b0ea594bf243d3a48d4130b8e08419` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:43.076080 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c1824d-0956-45a3-8c99-e2219d5d1907 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39b0ea594bf243d3a48d4130b8e08419)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:43.077971 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c1824d-0956-45a3-8c99-e2219d5d1907 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:43.127030 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-52c1824d-0956-45a3-8c99-e2219d5d1907 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39b0ea594bf243d3a48d4130b8e08419'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:43.133707 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-52c1824d-0956-45a3-8c99-e2219d5d1907 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39b0ea594bf243d3a48d4130b8e08419'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:43.140962 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-52c1824d-0956-45a3-8c99-e2219d5d1907 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39b0ea594bf243d3a48d4130b8e08419'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:43.152418 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-52c1824d-0956-45a3-8c99-e2219d5d1907 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39b0ea594bf243d3a48d4130b8e08419'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:43.153126 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-52c1824d-0956-45a3-8c99-e2219d5d1907 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39b0ea594bf243d3a48d4130b8e08419'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:43.159400 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 921/1840] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:09:43 2022] DELETE /identity/v3/users/39b0ea594bf243d3a48d4130b8e08419 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:43.163850 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85ddf7-99ec-4c23-a573-f3c08f49779a None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:43.164305 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85ddf7-99ec-4c23-a573-f3c08f49779a None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:43.164415 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85ddf7-99ec-4c23-a573-f3c08f49779a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:43.181756 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-8c85ddf7-99ec-4c23-a573-f3c08f49779a None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:43.182922 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-8c85ddf7-99ec-4c23-a573-f3c08f49779a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:43.239435 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 920/1841] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:09:43.249190 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1824d-0956-45a3-8c99-e2219d5d1907 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:43.250904 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-52c1824d-0956-45a3-8c99-e2219d5d1907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:43.305765 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1824d-0956-45a3-8c99-e2219d5d1907 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:43.309394 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aca177-2b0b-49ca-86ee-3ed67b630d27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:43.310032 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aca177-2b0b-49ca-86ee-3ed67b630d27 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:43.310319 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aca177-2b0b-49ca-86ee-3ed67b630d27 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:43.310601 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aca177-2b0b-49ca-86ee-3ed67b630d27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:43.319793 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aca177-2b0b-49ca-86ee-3ed67b630d27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:43.321215 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aca177-2b0b-49ca-86ee-3ed67b630d27 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:43.330420 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 922/1842] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:43.657979 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85ddf7-99ec-4c23-a573-f3c08f49779a None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:43.659545 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-8c85ddf7-99ec-4c23-a573-f3c08f49779a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:43.673762 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85ddf7-99ec-4c23-a573-f3c08f49779a None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:43.680916 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7782ea3-d524-44c9-b481-58334089803f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:43.681750 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7782ea3-d524-44c9-b481-58334089803f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:43.682072 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7782ea3-d524-44c9-b481-58334089803f admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:43.682414 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7782ea3-d524-44c9-b481-58334089803f admin admin] PATH_INFO: `/v3/projects/d683d0501e024e99a9e828cef84d40f6` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:43.683576 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7782ea3-d524-44c9-b481-58334089803f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d683d0501e024e99a9e828cef84d40f6)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:43.685490 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7782ea3-d524-44c9-b481-58334089803f admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:43.730628 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c7782ea3-d524-44c9-b481-58334089803f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd683d0501e024e99a9e828cef84d40f6', 'request_id': 'req-c7782ea3-d524-44c9-b481-58334089803f'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:43.736009 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c7782ea3-d524-44c9-b481-58334089803f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd683d0501e024e99a9e828cef84d40f6', 'request_id': 'req-c7782ea3-d524-44c9-b481-58334089803f'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:43.742150 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c7782ea3-d524-44c9-b481-58334089803f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd683d0501e024e99a9e828cef84d40f6', 'request_id': 'req-c7782ea3-d524-44c9-b481-58334089803f'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:43.753653 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c7782ea3-d524-44c9-b481-58334089803f admin admin] The token cache is being invalidate because project d683d0501e024e99a9e828cef84d40f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:09:43.753944 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c7782ea3-d524-44c9-b481-58334089803f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:43.754594 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c7782ea3-d524-44c9-b481-58334089803f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:43.756142 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 921/1843] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:09:43 2022] DELETE /identity/v3/projects/d683d0501e024e99a9e828cef84d40f6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:43.760140 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aca177-2b0b-49ca-86ee-3ed67b630d27 service neutron] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:43.769905 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aca177-2b0b-49ca-86ee-3ed67b630d27 service neutron] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:43.822052 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a158f-4263-42b7-b9f4-787aec551a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:43.822916 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a158f-4263-42b7-b9f4-787aec551a8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:43.823201 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a158f-4263-42b7-b9f4-787aec551a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:43.823480 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a158f-4263-42b7-b9f4-787aec551a8a admin admin] PATH_INFO: `/v3/users/602aea275b2d48ec9b22db6b7b55b787` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:43.824679 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a158f-4263-42b7-b9f4-787aec551a8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=602aea275b2d48ec9b22db6b7b55b787)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:43.826596 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a158f-4263-42b7-b9f4-787aec551a8a admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:43.869938 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5f8a158f-4263-42b7-b9f4-787aec551a8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '602aea275b2d48ec9b22db6b7b55b787'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:43.876906 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5f8a158f-4263-42b7-b9f4-787aec551a8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '602aea275b2d48ec9b22db6b7b55b787'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:43.883481 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5f8a158f-4263-42b7-b9f4-787aec551a8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '602aea275b2d48ec9b22db6b7b55b787'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:43.895489 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5f8a158f-4263-42b7-b9f4-787aec551a8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '602aea275b2d48ec9b22db6b7b55b787'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:43.896181 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5f8a158f-4263-42b7-b9f4-787aec551a8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '602aea275b2d48ec9b22db6b7b55b787'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:43.903189 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 923/1844] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:09:43 2022] DELETE /identity/v3/users/602aea275b2d48ec9b22db6b7b55b787 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:09:44.847649 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7782ea3-d524-44c9-b481-58334089803f admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:44.849942 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-c7782ea3-d524-44c9-b481-58334089803f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:44.864146 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7782ea3-d524-44c9-b481-58334089803f admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:45.005657 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3bb2c-71ec-43be-8a23-8cde0bebcb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:45.006546 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3bb2c-71ec-43be-8a23-8cde0bebcb18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:45.006831 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3bb2c-71ec-43be-8a23-8cde0bebcb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:45.007113 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3bb2c-71ec-43be-8a23-8cde0bebcb18 admin admin] PATH_INFO: `/v3/projects/86d657a6212645f0bfa4c6dbc306a1c7` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:45.008337 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf3bb2c-71ec-43be-8a23-8cde0bebcb18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86d657a6212645f0bfa4c6dbc306a1c7)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:45.010246 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf3bb2c-71ec-43be-8a23-8cde0bebcb18 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:45.071533 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-eaf3bb2c-71ec-43be-8a23-8cde0bebcb18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86d657a6212645f0bfa4c6dbc306a1c7', 'request_id': 'req-eaf3bb2c-71ec-43be-8a23-8cde0bebcb18'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:45.079005 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-eaf3bb2c-71ec-43be-8a23-8cde0bebcb18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86d657a6212645f0bfa4c6dbc306a1c7', 'request_id': 'req-eaf3bb2c-71ec-43be-8a23-8cde0bebcb18'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:45.086186 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-eaf3bb2c-71ec-43be-8a23-8cde0bebcb18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86d657a6212645f0bfa4c6dbc306a1c7', 'request_id': 'req-eaf3bb2c-71ec-43be-8a23-8cde0bebcb18'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:45.101645 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-eaf3bb2c-71ec-43be-8a23-8cde0bebcb18 admin admin] The token cache is being invalidate because project 86d657a6212645f0bfa4c6dbc306a1c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:09:45.102279 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-eaf3bb2c-71ec-43be-8a23-8cde0bebcb18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:45.103175 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-eaf3bb2c-71ec-43be-8a23-8cde0bebcb18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:45.105050 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 922/1845] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:09:44 2022] DELETE /identity/v3/projects/86d657a6212645f0bfa4c6dbc306a1c7 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:45.112347 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb41024-1132-437c-a9eb-9969f59b6bf2 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:45.112842 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb41024-1132-437c-a9eb-9969f59b6bf2 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:45.113119 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb41024-1132-437c-a9eb-9969f59b6bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:45.140724 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-2cb41024-1132-437c-a9eb-9969f59b6bf2 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:45.143649 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-2cb41024-1132-437c-a9eb-9969f59b6bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:45.222953 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 924/1846] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:45.239999 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd5538-9184-4baa-bf34-abd4aff6c59b None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:45.239999 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd5538-9184-4baa-bf34-abd4aff6c59b None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:45.239999 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd5538-9184-4baa-bf34-abd4aff6c59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:45.269398 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-6cfd5538-9184-4baa-bf34-abd4aff6c59b None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:45.270797 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-6cfd5538-9184-4baa-bf34-abd4aff6c59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:45.294191 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 923/1847] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:45.299872 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb41024-1132-437c-a9eb-9969f59b6bf2 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:45.324578 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb41024-1132-437c-a9eb-9969f59b6bf2 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:45.332899 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd58d50-9bcd-4f6c-894c-bb5c5a2535e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:45.340324 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd58d50-9bcd-4f6c-894c-bb5c5a2535e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:45.340812 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd58d50-9bcd-4f6c-894c-bb5c5a2535e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:45.341108 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd58d50-9bcd-4f6c-894c-bb5c5a2535e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:45.342030 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd58d50-9bcd-4f6c-894c-bb5c5a2535e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:09:45.342361 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd58d50-9bcd-4f6c-894c-bb5c5a2535e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:45.345526 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd58d50-9bcd-4f6c-894c-bb5c5a2535e9 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:45.362315 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 925/1848] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:09:45.366826 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd5538-9184-4baa-bf34-abd4aff6c59b None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:45.377543 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd5538-9184-4baa-bf34-abd4aff6c59b None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:45.394672 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2fc8b-5bf2-402b-8366-3168ad0630c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:45.395578 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2fc8b-5bf2-402b-8366-3168ad0630c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:45.395895 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2fc8b-5bf2-402b-8366-3168ad0630c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:45.396185 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2fc8b-5bf2-402b-8366-3168ad0630c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:45.396895 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb2fc8b-5bf2-402b-8366-3168ad0630c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:45.399001 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb2fc8b-5bf2-402b-8366-3168ad0630c5 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:45.446003 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 924/1849] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:09:45 2022] POST /identity/v3/projects => generated 377 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:45.448830 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd58d50-9bcd-4f6c-894c-bb5c5a2535e9 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:45.463116 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd58d50-9bcd-4f6c-894c-bb5c5a2535e9 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:45.497018 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2fc8b-5bf2-402b-8366-3168ad0630c5 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:45.498794 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-ffb2fc8b-5bf2-402b-8366-3168ad0630c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:45.630669 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2fc8b-5bf2-402b-8366-3168ad0630c5 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:45.641888 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977ee40-bfaa-4edb-81bf-02661461cac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:45.642893 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977ee40-bfaa-4edb-81bf-02661461cac1 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:45.643409 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977ee40-bfaa-4edb-81bf-02661461cac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:45.643925 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977ee40-bfaa-4edb-81bf-02661461cac1 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:45.645128 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae8e2f-f5c2-4b6b-a206-7ad99933072a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:45.646215 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae8e2f-f5c2-4b6b-a206-7ad99933072a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:45.646657 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae8e2f-f5c2-4b6b-a206-7ad99933072a admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:45.646787 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977ee40-bfaa-4edb-81bf-02661461cac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:45.647380 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae8e2f-f5c2-4b6b-a206-7ad99933072a admin admin] PATH_INFO: `/v3/users/03b6b9afaab54ab893b62c02cb2299e8` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:45.649476 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977ee40-bfaa-4edb-81bf-02661461cac1 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:45.651537 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae8e2f-f5c2-4b6b-a206-7ad99933072a admin admin] RBAC: Authorizing `identity:delete_user(user_id=03b6b9afaab54ab893b62c02cb2299e8)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:45.658335 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae8e2f-f5c2-4b6b-a206-7ad99933072a admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:45.687435 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 926/1850] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:09:45 2022] POST /identity/v3/users => generated 289 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:09:45.691993 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977ee40-bfaa-4edb-81bf-02661461cac1 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:45.706347 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977ee40-bfaa-4edb-81bf-02661461cac1 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:45.713824 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0a601-66fb-4a4e-bb41-b72d5ebd9360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:45.715401 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0a601-66fb-4a4e-bb41-b72d5ebd9360 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:45.715596 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0a601-66fb-4a4e-bb41-b72d5ebd9360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:45.716001 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e0a601-66fb-4a4e-bb41-b72d5ebd9360 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:45.716987 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0a601-66fb-4a4e-bb41-b72d5ebd9360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:45.720633 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e0a601-66fb-4a4e-bb41-b72d5ebd9360 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:45.735990 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 927/1851] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:45.740289 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0a601-66fb-4a4e-bb41-b72d5ebd9360 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:45.746807 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-e3ae8e2f-f5c2-4b6b-a206-7ad99933072a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03b6b9afaab54ab893b62c02cb2299e8'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:45.747512 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-e3ae8e2f-f5c2-4b6b-a206-7ad99933072a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03b6b9afaab54ab893b62c02cb2299e8'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:45.754325 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e0a601-66fb-4a4e-bb41-b72d5ebd9360 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:45.757307 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-e3ae8e2f-f5c2-4b6b-a206-7ad99933072a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03b6b9afaab54ab893b62c02cb2299e8'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:45.770139 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a3512-f04d-45a9-bc3b-f6c16738a615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:45.771155 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-e3ae8e2f-f5c2-4b6b-a206-7ad99933072a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03b6b9afaab54ab893b62c02cb2299e8'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:45.772065 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-e3ae8e2f-f5c2-4b6b-a206-7ad99933072a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03b6b9afaab54ab893b62c02cb2299e8'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:45.774611 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a3512-f04d-45a9-bc3b-f6c16738a615 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:45.774864 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a3512-f04d-45a9-bc3b-f6c16738a615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:45.776098 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a3512-f04d-45a9-bc3b-f6c16738a615 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:45.778371 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a3512-f04d-45a9-bc3b-f6c16738a615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:45.781873 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a3512-f04d-45a9-bc3b-f6c16738a615 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:45.790079 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 925/1852] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:09:45 2022] DELETE /identity/v3/users/03b6b9afaab54ab893b62c02cb2299e8 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:45.796602 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689d699-fea4-4c79-9b1d-40448714a3bc None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:45.796842 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689d699-fea4-4c79-9b1d-40448714a3bc None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:45.797705 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689d699-fea4-4c79-9b1d-40448714a3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:45.815322 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 928/1853] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:45.816220 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a3512-f04d-45a9-bc3b-f6c16738a615 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:45.818153 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-8689d699-fea4-4c79-9b1d-40448714a3bc None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:45.820088 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-8689d699-fea4-4c79-9b1d-40448714a3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:45.823712 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-341a3512-f04d-45a9-bc3b-f6c16738a615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:45.839922 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a3512-f04d-45a9-bc3b-f6c16738a615 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:45.904230 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 926/1854] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:09:45.924827 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accf24e-aef9-44a0-8ae9-5d3ff0918242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:45.925768 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accf24e-aef9-44a0-8ae9-5d3ff0918242 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:45.926088 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accf24e-aef9-44a0-8ae9-5d3ff0918242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:45.926309 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accf24e-aef9-44a0-8ae9-5d3ff0918242 admin admin] PATH_INFO: `/v3/projects/956d77945cd74846bee181d8a89a9944/users/1cdf38df494644f4b3aac491e0ef3c23/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:45.936320 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689d699-fea4-4c79-9b1d-40448714a3bc None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:45.939044 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-8689d699-fea4-4c79-9b1d-40448714a3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:45.950182 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accf24e-aef9-44a0-8ae9-5d3ff0918242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=956d77945cd74846bee181d8a89a9944, user_id=1cdf38df494644f4b3aac491e0ef3c23, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:45.954116 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accf24e-aef9-44a0-8ae9-5d3ff0918242 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:45.980733 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 929/1855] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:45 2022] PUT /identity/v3/projects/956d77945cd74846bee181d8a89a9944/users/1cdf38df494644f4b3aac491e0ef3c23/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:45.997088 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb758fa-7e73-4a9f-9777-8c519acc57f5 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:45.997572 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb758fa-7e73-4a9f-9777-8c519acc57f5 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:45.998124 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb758fa-7e73-4a9f-9777-8c519acc57f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:46.046069 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-ecb758fa-7e73-4a9f-9777-8c519acc57f5 None None] MFA Rules not processed for user `1cdf38df494644f4b3aac491e0ef3c23`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:46.048921 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-ecb758fa-7e73-4a9f-9777-8c519acc57f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:46.056679 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689d699-fea4-4c79-9b1d-40448714a3bc None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:46.144618 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55681c51-572f-4015-a694-f8b13d19d7d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:46.145555 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55681c51-572f-4015-a694-f8b13d19d7d5 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:46.145840 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55681c51-572f-4015-a694-f8b13d19d7d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:46.146400 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55681c51-572f-4015-a694-f8b13d19d7d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:46.171401 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 930/1856] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:09:46.185620 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb758fa-7e73-4a9f-9777-8c519acc57f5 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:46.187389 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-ecb758fa-7e73-4a9f-9777-8c519acc57f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:46.255026 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55681c51-572f-4015-a694-f8b13d19d7d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:46.256607 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55681c51-572f-4015-a694-f8b13d19d7d5 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:46.268692 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb758fa-7e73-4a9f-9777-8c519acc57f5 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:46.275500 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdbd97-7fb1-445d-8f70-ebb64a56262f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:46.276588 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdbd97-7fb1-445d-8f70-ebb64a56262f service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:46.277097 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdbd97-7fb1-445d-8f70-ebb64a56262f service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:46.278077 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdbd97-7fb1-445d-8f70-ebb64a56262f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:46.288973 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 927/1857] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:09:46.297946 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cdbd97-7fb1-445d-8f70-ebb64a56262f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:46.299485 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cdbd97-7fb1-445d-8f70-ebb64a56262f service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:46.310511 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 931/1858] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:46.993367 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55681c51-572f-4015-a694-f8b13d19d7d5 service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:46.994919 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-55681c51-572f-4015-a694-f8b13d19d7d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:47.014768 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55681c51-572f-4015-a694-f8b13d19d7d5 service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:47.025863 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10238f4e-b21b-4599-aff9-c596b9e5aa74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:47.026624 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10238f4e-b21b-4599-aff9-c596b9e5aa74 service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:47.026988 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10238f4e-b21b-4599-aff9-c596b9e5aa74 service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:47.027341 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10238f4e-b21b-4599-aff9-c596b9e5aa74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:47.031096 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-10238f4e-b21b-4599-aff9-c596b9e5aa74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:47.221603 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10238f4e-b21b-4599-aff9-c596b9e5aa74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:47.226083 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10238f4e-b21b-4599-aff9-c596b9e5aa74 service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:47.256956 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 928/1859] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:47.872202 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdbd97-7fb1-445d-8f70-ebb64a56262f service cinder] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:47.873942 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-12cdbd97-7fb1-445d-8f70-ebb64a56262f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:47.891422 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdbd97-7fb1-445d-8f70-ebb64a56262f service cinder] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:47.898091 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631288a-e147-4338-a2cd-800ccaae9c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:47.899318 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631288a-e147-4338-a2cd-800ccaae9c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:47.899894 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631288a-e147-4338-a2cd-800ccaae9c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:47.900358 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631288a-e147-4338-a2cd-800ccaae9c2a admin admin] PATH_INFO: `/v3/projects/0be1fddabc204b24be75200a24b3ffd7` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:47.902045 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631288a-e147-4338-a2cd-800ccaae9c2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0be1fddabc204b24be75200a24b3ffd7)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:47.904357 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631288a-e147-4338-a2cd-800ccaae9c2a admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:47.969644 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-f631288a-e147-4338-a2cd-800ccaae9c2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0be1fddabc204b24be75200a24b3ffd7', 'request_id': 'req-f631288a-e147-4338-a2cd-800ccaae9c2a'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:47.976619 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-f631288a-e147-4338-a2cd-800ccaae9c2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0be1fddabc204b24be75200a24b3ffd7', 'request_id': 'req-f631288a-e147-4338-a2cd-800ccaae9c2a'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:47.983955 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-f631288a-e147-4338-a2cd-800ccaae9c2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0be1fddabc204b24be75200a24b3ffd7', 'request_id': 'req-f631288a-e147-4338-a2cd-800ccaae9c2a'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:48.007395 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-f631288a-e147-4338-a2cd-800ccaae9c2a admin admin] The token cache is being invalidate because project 0be1fddabc204b24be75200a24b3ffd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:09:48.007869 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-f631288a-e147-4338-a2cd-800ccaae9c2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:48.008785 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-f631288a-e147-4338-a2cd-800ccaae9c2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:48.015423 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10238f4e-b21b-4599-aff9-c596b9e5aa74 service cinder] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:48.030147 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 932/1860] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:09:47 2022] DELETE /identity/v3/projects/0be1fddabc204b24be75200a24b3ffd7 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:48.035120 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10238f4e-b21b-4599-aff9-c596b9e5aa74 service cinder] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:48.253785 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7a566-1927-4d48-a65a-3805f64aaa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:48.254671 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7a566-1927-4d48-a65a-3805f64aaa0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:48.255279 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7a566-1927-4d48-a65a-3805f64aaa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:48.255484 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7a566-1927-4d48-a65a-3805f64aaa0c admin admin] PATH_INFO: `/v3/users/8250ed491a73421492ce3aae90ffe95a` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:48.257440 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b7a566-1927-4d48-a65a-3805f64aaa0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8250ed491a73421492ce3aae90ffe95a)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:48.259373 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b7a566-1927-4d48-a65a-3805f64aaa0c admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:48.389641 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-26b7a566-1927-4d48-a65a-3805f64aaa0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8250ed491a73421492ce3aae90ffe95a'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:48.391853 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-26b7a566-1927-4d48-a65a-3805f64aaa0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8250ed491a73421492ce3aae90ffe95a'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:48.403155 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-26b7a566-1927-4d48-a65a-3805f64aaa0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8250ed491a73421492ce3aae90ffe95a'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:48.419281 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-26b7a566-1927-4d48-a65a-3805f64aaa0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8250ed491a73421492ce3aae90ffe95a'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:48.420101 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-26b7a566-1927-4d48-a65a-3805f64aaa0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8250ed491a73421492ce3aae90ffe95a'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:48.459715 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 929/1861] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:09:48 2022] DELETE /identity/v3/users/8250ed491a73421492ce3aae90ffe95a => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:48.892797 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631288a-e147-4338-a2cd-800ccaae9c2a admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:48.895114 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-f631288a-e147-4338-a2cd-800ccaae9c2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:48.918566 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631288a-e147-4338-a2cd-800ccaae9c2a admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:48.983880 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa40cd-6c6b-4c7b-8d25-a38c587de722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:48.985742 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa40cd-6c6b-4c7b-8d25-a38c587de722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:48.986030 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa40cd-6c6b-4c7b-8d25-a38c587de722 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:48.986365 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa40cd-6c6b-4c7b-8d25-a38c587de722 admin admin] PATH_INFO: `/v3/projects/ff5c6c52b2174d7abb65e59e2ad42921` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:48.988912 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa40cd-6c6b-4c7b-8d25-a38c587de722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff5c6c52b2174d7abb65e59e2ad42921)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:48.990923 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa40cd-6c6b-4c7b-8d25-a38c587de722 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:49.036639 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-93fa40cd-6c6b-4c7b-8d25-a38c587de722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff5c6c52b2174d7abb65e59e2ad42921', 'request_id': 'req-93fa40cd-6c6b-4c7b-8d25-a38c587de722'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:49.042165 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-93fa40cd-6c6b-4c7b-8d25-a38c587de722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff5c6c52b2174d7abb65e59e2ad42921', 'request_id': 'req-93fa40cd-6c6b-4c7b-8d25-a38c587de722'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:49.048856 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-93fa40cd-6c6b-4c7b-8d25-a38c587de722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff5c6c52b2174d7abb65e59e2ad42921', 'request_id': 'req-93fa40cd-6c6b-4c7b-8d25-a38c587de722'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:49.069231 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-93fa40cd-6c6b-4c7b-8d25-a38c587de722 admin admin] The token cache is being invalidate because project ff5c6c52b2174d7abb65e59e2ad42921 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:09:49.069507 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-93fa40cd-6c6b-4c7b-8d25-a38c587de722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:49.070141 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-93fa40cd-6c6b-4c7b-8d25-a38c587de722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:49.071809 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 933/1862] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:09:48 2022] DELETE /identity/v3/projects/ff5c6c52b2174d7abb65e59e2ad42921 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:49.077048 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7a566-1927-4d48-a65a-3805f64aaa0c admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:49.078554 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-26b7a566-1927-4d48-a65a-3805f64aaa0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:49.091015 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7a566-1927-4d48-a65a-3805f64aaa0c admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:49.144019 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a3ba6-8b95-48fd-862a-cc86d9fb6aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:49.144918 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a3ba6-8b95-48fd-862a-cc86d9fb6aef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:49.145196 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a3ba6-8b95-48fd-862a-cc86d9fb6aef admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:49.145470 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a3ba6-8b95-48fd-862a-cc86d9fb6aef admin admin] PATH_INFO: `/v3/users/2a21cb6f34b947cf80562940cadc6717` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:49.146642 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193a3ba6-8b95-48fd-862a-cc86d9fb6aef admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a21cb6f34b947cf80562940cadc6717)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:49.148621 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193a3ba6-8b95-48fd-862a-cc86d9fb6aef admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:49.191156 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-193a3ba6-8b95-48fd-862a-cc86d9fb6aef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a21cb6f34b947cf80562940cadc6717'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:49.191818 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-193a3ba6-8b95-48fd-862a-cc86d9fb6aef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a21cb6f34b947cf80562940cadc6717'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:49.198571 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-193a3ba6-8b95-48fd-862a-cc86d9fb6aef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a21cb6f34b947cf80562940cadc6717'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:49.209507 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-193a3ba6-8b95-48fd-862a-cc86d9fb6aef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a21cb6f34b947cf80562940cadc6717'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:49.210127 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-193a3ba6-8b95-48fd-862a-cc86d9fb6aef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a21cb6f34b947cf80562940cadc6717'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:49.222774 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 930/1863] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:09:49 2022] DELETE /identity/v3/users/2a21cb6f34b947cf80562940cadc6717 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:09:49.511599 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa40cd-6c6b-4c7b-8d25-a38c587de722 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:49.513352 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-93fa40cd-6c6b-4c7b-8d25-a38c587de722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:49.534784 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa40cd-6c6b-4c7b-8d25-a38c587de722 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:49.602531 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa53a2c-4358-4562-a0fb-8321c3917ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:49.603390 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa53a2c-4358-4562-a0fb-8321c3917ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:49.603673 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa53a2c-4358-4562-a0fb-8321c3917ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:49.603979 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa53a2c-4358-4562-a0fb-8321c3917ac8 admin admin] PATH_INFO: `/v3/projects/6082886ab24a4331b30923afb34fefea` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:49.605156 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa53a2c-4358-4562-a0fb-8321c3917ac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6082886ab24a4331b30923afb34fefea)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:49.607044 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa53a2c-4358-4562-a0fb-8321c3917ac8 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:49.650851 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-6fa53a2c-4358-4562-a0fb-8321c3917ac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6082886ab24a4331b30923afb34fefea', 'request_id': 'req-6fa53a2c-4358-4562-a0fb-8321c3917ac8'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:49.656157 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-6fa53a2c-4358-4562-a0fb-8321c3917ac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6082886ab24a4331b30923afb34fefea', 'request_id': 'req-6fa53a2c-4358-4562-a0fb-8321c3917ac8'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:49.662928 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-6fa53a2c-4358-4562-a0fb-8321c3917ac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6082886ab24a4331b30923afb34fefea', 'request_id': 'req-6fa53a2c-4358-4562-a0fb-8321c3917ac8'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:49.674827 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-6fa53a2c-4358-4562-a0fb-8321c3917ac8 admin admin] The token cache is being invalidate because project 6082886ab24a4331b30923afb34fefea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:09:49.675150 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-6fa53a2c-4358-4562-a0fb-8321c3917ac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:49.675766 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-6fa53a2c-4358-4562-a0fb-8321c3917ac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:49.677293 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 934/1864] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:09:49 2022] DELETE /identity/v3/projects/6082886ab24a4331b30923afb34fefea => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:49.686699 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a6dfa-a074-49ae-bf6d-73d98d708dec None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:49.687235 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a6dfa-a074-49ae-bf6d-73d98d708dec None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:49.687545 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a6dfa-a074-49ae-bf6d-73d98d708dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:49.706595 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-843a6dfa-a074-49ae-bf6d-73d98d708dec None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:49.708178 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-843a6dfa-a074-49ae-bf6d-73d98d708dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:49.766287 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 931/1865] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:49.774249 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119e3b1-be39-42f2-9587-e39dfe628526 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:49.774630 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119e3b1-be39-42f2-9587-e39dfe628526 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:49.774978 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119e3b1-be39-42f2-9587-e39dfe628526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:49.793370 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-a119e3b1-be39-42f2-9587-e39dfe628526 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:49.794699 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-a119e3b1-be39-42f2-9587-e39dfe628526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:49.802549 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 935/1866] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:09:49.806907 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a6dfa-a074-49ae-bf6d-73d98d708dec None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:49.816256 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a6dfa-a074-49ae-bf6d-73d98d708dec None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:49.821108 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6529520-76a5-4e16-a0cb-5818e8ed4127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:49.821757 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6529520-76a5-4e16-a0cb-5818e8ed4127 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:49.822036 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6529520-76a5-4e16-a0cb-5818e8ed4127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:49.822510 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6529520-76a5-4e16-a0cb-5818e8ed4127 admin admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:49.823226 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6529520-76a5-4e16-a0cb-5818e8ed4127 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:09:49.823716 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6529520-76a5-4e16-a0cb-5818e8ed4127 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:49.825367 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6529520-76a5-4e16-a0cb-5818e8ed4127 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:49.837553 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 932/1867] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:09:49.841696 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119e3b1-be39-42f2-9587-e39dfe628526 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:49.851263 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119e3b1-be39-42f2-9587-e39dfe628526 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:49.855873 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ede2c1-c8f2-4a38-a586-0223b743e5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:49.856512 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ede2c1-c8f2-4a38-a586-0223b743e5f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:49.856793 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ede2c1-c8f2-4a38-a586-0223b743e5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:49.857072 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ede2c1-c8f2-4a38-a586-0223b743e5f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:49.857788 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ede2c1-c8f2-4a38-a586-0223b743e5f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:49.859717 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ede2c1-c8f2-4a38-a586-0223b743e5f4 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:49.883406 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 936/1868] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:09:49 2022] POST /identity/v3/projects => generated 385 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:09:49.887330 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6529520-76a5-4e16-a0cb-5818e8ed4127 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:49.897603 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6529520-76a5-4e16-a0cb-5818e8ed4127 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:49.950281 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72454e09-4323-418f-9c37-e3006896a36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:49.950943 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72454e09-4323-418f-9c37-e3006896a36b admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:49.951225 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72454e09-4323-418f-9c37-e3006896a36b admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:49.951497 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72454e09-4323-418f-9c37-e3006896a36b admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:49.952207 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72454e09-4323-418f-9c37-e3006896a36b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:49.954715 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72454e09-4323-418f-9c37-e3006896a36b admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:49.977892 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 933/1869] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:09:49 2022] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:49.979069 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ede2c1-c8f2-4a38-a586-0223b743e5f4 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:49.989014 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ede2c1-c8f2-4a38-a586-0223b743e5f4 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:49.994167 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2b473-e022-4b9b-89fb-81d975746481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:49.994322 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2b473-e022-4b9b-89fb-81d975746481 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:49.994486 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2b473-e022-4b9b-89fb-81d975746481 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:49.994759 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2b473-e022-4b9b-89fb-81d975746481 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:49.995475 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2b473-e022-4b9b-89fb-81d975746481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:49.997086 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2b473-e022-4b9b-89fb-81d975746481 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:50.010493 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 937/1870] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:09:50.011658 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72454e09-4323-418f-9c37-e3006896a36b admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:50.022058 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72454e09-4323-418f-9c37-e3006896a36b admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:50.027034 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c2bd2-ad3a-4e7d-84d1-41f615c2bb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:50.027717 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c2bd2-ad3a-4e7d-84d1-41f615c2bb84 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:50.028021 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c2bd2-ad3a-4e7d-84d1-41f615c2bb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:50.028295 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c2bd2-ad3a-4e7d-84d1-41f615c2bb84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:50.029014 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c2bd2-ad3a-4e7d-84d1-41f615c2bb84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:50.030597 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c2bd2-ad3a-4e7d-84d1-41f615c2bb84 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:50.040841 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 934/1871] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:50.045034 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2b473-e022-4b9b-89fb-81d975746481 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:50.055794 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2b473-e022-4b9b-89fb-81d975746481 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:50.060719 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e81082-f161-453b-b639-66646f99c394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:50.061659 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e81082-f161-453b-b639-66646f99c394 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:50.061964 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e81082-f161-453b-b639-66646f99c394 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:50.062216 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e81082-f161-453b-b639-66646f99c394 admin admin] PATH_INFO: `/v3/projects/3ab6ea4815a2409592f0cd180c455ccf/users/d9b8233f16f04c55ba80b9a79c2e265a/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:50.077410 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e81082-f161-453b-b639-66646f99c394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ab6ea4815a2409592f0cd180c455ccf, user_id=d9b8233f16f04c55ba80b9a79c2e265a, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:50.080686 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e81082-f161-453b-b639-66646f99c394 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:50.093461 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 938/1872] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:50 2022] PUT /identity/v3/projects/3ab6ea4815a2409592f0cd180c455ccf/users/d9b8233f16f04c55ba80b9a79c2e265a/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:09:50.104764 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f21f50-eb64-46bf-94a1-a6180711e4a6 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:50.105249 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f21f50-eb64-46bf-94a1-a6180711e4a6 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:50.105335 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f21f50-eb64-46bf-94a1-a6180711e4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:50.132262 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-f7f21f50-eb64-46bf-94a1-a6180711e4a6 None None] MFA Rules not processed for user `d9b8233f16f04c55ba80b9a79c2e265a`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:50.133493 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-f7f21f50-eb64-46bf-94a1-a6180711e4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:50.217208 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 935/1873] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:09:50.221778 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e81082-f161-453b-b639-66646f99c394 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:50.289596 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e81082-f161-453b-b639-66646f99c394 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:50.294862 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3148e0-2e17-471f-a6c5-69fca7f7404c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:50.295524 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3148e0-2e17-471f-a6c5-69fca7f7404c admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:50.295844 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3148e0-2e17-471f-a6c5-69fca7f7404c admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:50.296120 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3148e0-2e17-471f-a6c5-69fca7f7404c admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:50.297339 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3148e0-2e17-471f-a6c5-69fca7f7404c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:50.299419 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3148e0-2e17-471f-a6c5-69fca7f7404c admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:50.328077 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 939/1874] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:09:50 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:09:50.332124 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f21f50-eb64-46bf-94a1-a6180711e4a6 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:50.343241 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f21f50-eb64-46bf-94a1-a6180711e4a6 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:50.397308 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2930590-5587-4fd7-9216-709bbff6ae43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:50.398007 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2930590-5587-4fd7-9216-709bbff6ae43 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:50.398293 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2930590-5587-4fd7-9216-709bbff6ae43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:50.398581 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2930590-5587-4fd7-9216-709bbff6ae43 admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:50.399277 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2930590-5587-4fd7-9216-709bbff6ae43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:50.401237 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2930590-5587-4fd7-9216-709bbff6ae43 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:50.423970 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 936/1875] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:09:50 2022] POST /identity/v3/users => generated 299 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:50.425408 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3148e0-2e17-471f-a6c5-69fca7f7404c admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:50.435348 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3148e0-2e17-471f-a6c5-69fca7f7404c admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:50.440585 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24006ad8-18f7-4e64-8603-1fee89c741e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:50.441242 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24006ad8-18f7-4e64-8603-1fee89c741e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:50.441524 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24006ad8-18f7-4e64-8603-1fee89c741e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:50.441799 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24006ad8-18f7-4e64-8603-1fee89c741e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:50.442516 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24006ad8-18f7-4e64-8603-1fee89c741e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:50.444434 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24006ad8-18f7-4e64-8603-1fee89c741e0 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:50.454951 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 940/1876] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:09:50.459103 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2930590-5587-4fd7-9216-709bbff6ae43 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:50.469426 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2930590-5587-4fd7-9216-709bbff6ae43 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:50.474210 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da2091-86ff-4534-b124-1f4bffc9f7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:50.475098 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da2091-86ff-4534-b124-1f4bffc9f7c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:50.475383 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da2091-86ff-4534-b124-1f4bffc9f7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:50.475660 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da2091-86ff-4534-b124-1f4bffc9f7c1 admin admin] PATH_INFO: `/v3/projects/e88241d1c6e140f396284325ce518820/users/f3746975c09244538c3649868d3b8fdd/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:50.492526 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da2091-86ff-4534-b124-1f4bffc9f7c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e88241d1c6e140f396284325ce518820, user_id=f3746975c09244538c3649868d3b8fdd, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:50.495178 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da2091-86ff-4534-b124-1f4bffc9f7c1 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:50.509268 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 937/1877] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:50 2022] PUT /identity/v3/projects/e88241d1c6e140f396284325ce518820/users/f3746975c09244538c3649868d3b8fdd/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:09:50.513280 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24006ad8-18f7-4e64-8603-1fee89c741e0 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:50.522986 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24006ad8-18f7-4e64-8603-1fee89c741e0 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:50.578494 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c430d-a4eb-4c3b-b834-a10e352b34a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:50.579079 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c430d-a4eb-4c3b-b834-a10e352b34a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:50.579359 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c430d-a4eb-4c3b-b834-a10e352b34a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:50.579634 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c430d-a4eb-4c3b-b834-a10e352b34a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:50.580385 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c430d-a4eb-4c3b-b834-a10e352b34a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:50.581954 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c430d-a4eb-4c3b-b834-a10e352b34a9 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:50.591598 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 941/1878] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:50.595859 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da2091-86ff-4534-b124-1f4bffc9f7c1 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:50.606761 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da2091-86ff-4534-b124-1f4bffc9f7c1 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:50.612716 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0414b-a472-4870-93cf-6026cb185521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:50.613479 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0414b-a472-4870-93cf-6026cb185521 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:50.613712 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0414b-a472-4870-93cf-6026cb185521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:50.613993 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0414b-a472-4870-93cf-6026cb185521 admin admin] PATH_INFO: `/v3/projects/e88241d1c6e140f396284325ce518820/users/f3746975c09244538c3649868d3b8fdd/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:50.616425 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e0414b-a472-4870-93cf-6026cb185521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e88241d1c6e140f396284325ce518820, user_id=f3746975c09244538c3649868d3b8fdd, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:50.618847 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e0414b-a472-4870-93cf-6026cb185521 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:50.631137 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 938/1879] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:50 2022] PUT /identity/v3/projects/e88241d1c6e140f396284325ce518820/users/f3746975c09244538c3649868d3b8fdd/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:50.641903 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff30600-b676-4efd-86f1-9eebbe0a6dd4 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:50.642192 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff30600-b676-4efd-86f1-9eebbe0a6dd4 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:50.642468 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff30600-b676-4efd-86f1-9eebbe0a6dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:50.669553 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-aff30600-b676-4efd-86f1-9eebbe0a6dd4 None None] MFA Rules not processed for user `f3746975c09244538c3649868d3b8fdd`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:50.670749 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-aff30600-b676-4efd-86f1-9eebbe0a6dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:50.749459 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 942/1880] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:09:50.761283 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0414b-a472-4870-93cf-6026cb185521 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:50.763089 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-c7e0414b-a472-4870-93cf-6026cb185521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:50.819901 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0414b-a472-4870-93cf-6026cb185521 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:50.823492 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cde2ee-cb03-4563-81cf-c2abab34be2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:50.824167 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cde2ee-cb03-4563-81cf-c2abab34be2b service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:50.824453 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cde2ee-cb03-4563-81cf-c2abab34be2b service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:50.824730 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cde2ee-cb03-4563-81cf-c2abab34be2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:50.883380 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cde2ee-cb03-4563-81cf-c2abab34be2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:50.885095 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cde2ee-cb03-4563-81cf-c2abab34be2b service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:50.896618 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 939/1881] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:09:52.208651 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff30600-b676-4efd-86f1-9eebbe0a6dd4 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:52.210188 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-aff30600-b676-4efd-86f1-9eebbe0a6dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:52.272626 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff30600-b676-4efd-86f1-9eebbe0a6dd4 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:52.277105 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5886a5-4424-4784-a73f-3ebcd5c634d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:52.277973 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5886a5-4424-4784-a73f-3ebcd5c634d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:52.278251 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5886a5-4424-4784-a73f-3ebcd5c634d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:52.278521 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5886a5-4424-4784-a73f-3ebcd5c634d3 admin admin] PATH_INFO: `/v3/users/54c6feb0da954c0498184877185cf62d` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:52.279700 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5886a5-4424-4784-a73f-3ebcd5c634d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54c6feb0da954c0498184877185cf62d)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:52.282175 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5886a5-4424-4784-a73f-3ebcd5c634d3 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:52.327332 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5b5886a5-4424-4784-a73f-3ebcd5c634d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54c6feb0da954c0498184877185cf62d'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:52.333649 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5b5886a5-4424-4784-a73f-3ebcd5c634d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54c6feb0da954c0498184877185cf62d'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:52.340261 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5b5886a5-4424-4784-a73f-3ebcd5c634d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54c6feb0da954c0498184877185cf62d'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:52.351530 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5b5886a5-4424-4784-a73f-3ebcd5c634d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54c6feb0da954c0498184877185cf62d'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:52.352186 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5b5886a5-4424-4784-a73f-3ebcd5c634d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54c6feb0da954c0498184877185cf62d'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:52.357810 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 943/1882] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:09:52 2022] DELETE /identity/v3/users/54c6feb0da954c0498184877185cf62d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:52.363409 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd53a45-f548-4e4a-bd2b-a5a9aa80f361 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:52.363970 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd53a45-f548-4e4a-bd2b-a5a9aa80f361 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:52.363970 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd53a45-f548-4e4a-bd2b-a5a9aa80f361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:52.380497 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-abd53a45-f548-4e4a-bd2b-a5a9aa80f361 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:52.381680 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-abd53a45-f548-4e4a-bd2b-a5a9aa80f361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:52.439183 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 940/1883] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:52.449482 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5886a5-4424-4784-a73f-3ebcd5c634d3 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:52.451024 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-5b5886a5-4424-4784-a73f-3ebcd5c634d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:52.508355 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5886a5-4424-4784-a73f-3ebcd5c634d3 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:52.512033 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe05b66-4f5a-4eb3-a1aa-e15128caba08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:52.512680 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe05b66-4f5a-4eb3-a1aa-e15128caba08 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:52.512966 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe05b66-4f5a-4eb3-a1aa-e15128caba08 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:52.513248 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe05b66-4f5a-4eb3-a1aa-e15128caba08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:52.522607 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe05b66-4f5a-4eb3-a1aa-e15128caba08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:52.524064 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe05b66-4f5a-4eb3-a1aa-e15128caba08 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:52.533824 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 944/1884] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:52.815202 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd53a45-f548-4e4a-bd2b-a5a9aa80f361 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:52.816718 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-abd53a45-f548-4e4a-bd2b-a5a9aa80f361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:52.830544 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd53a45-f548-4e4a-bd2b-a5a9aa80f361 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:52.836783 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b9067-379d-49a6-80c9-267032d4674d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:52.837874 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b9067-379d-49a6-80c9-267032d4674d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:52.838331 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b9067-379d-49a6-80c9-267032d4674d admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:52.838613 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b9067-379d-49a6-80c9-267032d4674d admin admin] PATH_INFO: `/v3/projects/7f17c5d24b5b4c129345cae987eb2c2f` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:52.839942 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b9067-379d-49a6-80c9-267032d4674d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f17c5d24b5b4c129345cae987eb2c2f)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:52.842170 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b9067-379d-49a6-80c9-267032d4674d admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:52.896852 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-158b9067-379d-49a6-80c9-267032d4674d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f17c5d24b5b4c129345cae987eb2c2f', 'request_id': 'req-158b9067-379d-49a6-80c9-267032d4674d'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:52.902884 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-158b9067-379d-49a6-80c9-267032d4674d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f17c5d24b5b4c129345cae987eb2c2f', 'request_id': 'req-158b9067-379d-49a6-80c9-267032d4674d'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:52.911481 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-158b9067-379d-49a6-80c9-267032d4674d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f17c5d24b5b4c129345cae987eb2c2f', 'request_id': 'req-158b9067-379d-49a6-80c9-267032d4674d'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:52.925219 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-158b9067-379d-49a6-80c9-267032d4674d admin admin] The token cache is being invalidate because project 7f17c5d24b5b4c129345cae987eb2c2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:09:52.925574 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-158b9067-379d-49a6-80c9-267032d4674d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:52.926334 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-158b9067-379d-49a6-80c9-267032d4674d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:52.928499 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 941/1885] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:09:52 2022] DELETE /identity/v3/projects/7f17c5d24b5b4c129345cae987eb2c2f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:52.932543 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe05b66-4f5a-4eb3-a1aa-e15128caba08 service neutron] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:52.942891 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe05b66-4f5a-4eb3-a1aa-e15128caba08 service neutron] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:53.011949 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861de6bd-16af-4994-bd49-d660ecbcf6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:53.012832 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861de6bd-16af-4994-bd49-d660ecbcf6bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:53.013114 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861de6bd-16af-4994-bd49-d660ecbcf6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:53.013389 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861de6bd-16af-4994-bd49-d660ecbcf6bf admin admin] PATH_INFO: `/v3/users/8dbdfdeaee2d441e9561838a057ed0c3` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:53.014581 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861de6bd-16af-4994-bd49-d660ecbcf6bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dbdfdeaee2d441e9561838a057ed0c3)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:53.017176 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861de6bd-16af-4994-bd49-d660ecbcf6bf admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:53.070371 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-861de6bd-16af-4994-bd49-d660ecbcf6bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dbdfdeaee2d441e9561838a057ed0c3'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:53.077022 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-861de6bd-16af-4994-bd49-d660ecbcf6bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dbdfdeaee2d441e9561838a057ed0c3'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:53.085788 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-861de6bd-16af-4994-bd49-d660ecbcf6bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dbdfdeaee2d441e9561838a057ed0c3'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:53.096974 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-861de6bd-16af-4994-bd49-d660ecbcf6bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dbdfdeaee2d441e9561838a057ed0c3'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:53.097620 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-861de6bd-16af-4994-bd49-d660ecbcf6bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dbdfdeaee2d441e9561838a057ed0c3'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:53.103343 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 945/1886] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:09:52 2022] DELETE /identity/v3/users/8dbdfdeaee2d441e9561838a057ed0c3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:53.637813 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b9067-379d-49a6-80c9-267032d4674d admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:53.640130 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-158b9067-379d-49a6-80c9-267032d4674d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:53.655863 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b9067-379d-49a6-80c9-267032d4674d admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:53.717686 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e6b33-0dd1-454b-9886-b9ce43ad94dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:53.719554 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e6b33-0dd1-454b-9886-b9ce43ad94dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:53.719977 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e6b33-0dd1-454b-9886-b9ce43ad94dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:53.720368 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e6b33-0dd1-454b-9886-b9ce43ad94dd admin admin] PATH_INFO: `/v3/projects/672a07dbb85c4ab9a75baff8513fae20` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:53.721869 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e6b33-0dd1-454b-9886-b9ce43ad94dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=672a07dbb85c4ab9a75baff8513fae20)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:53.724517 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e6b33-0dd1-454b-9886-b9ce43ad94dd admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:53.784176 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-5f0e6b33-0dd1-454b-9886-b9ce43ad94dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '672a07dbb85c4ab9a75baff8513fae20', 'request_id': 'req-5f0e6b33-0dd1-454b-9886-b9ce43ad94dd'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:53.789394 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-5f0e6b33-0dd1-454b-9886-b9ce43ad94dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '672a07dbb85c4ab9a75baff8513fae20', 'request_id': 'req-5f0e6b33-0dd1-454b-9886-b9ce43ad94dd'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:53.795522 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-5f0e6b33-0dd1-454b-9886-b9ce43ad94dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '672a07dbb85c4ab9a75baff8513fae20', 'request_id': 'req-5f0e6b33-0dd1-454b-9886-b9ce43ad94dd'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:53.808525 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-5f0e6b33-0dd1-454b-9886-b9ce43ad94dd admin admin] The token cache is being invalidate because project 672a07dbb85c4ab9a75baff8513fae20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:09:53.808875 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-5f0e6b33-0dd1-454b-9886-b9ce43ad94dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:53.809524 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-5f0e6b33-0dd1-454b-9886-b9ce43ad94dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:53.811157 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 942/1887] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:09:53 2022] DELETE /identity/v3/projects/672a07dbb85c4ab9a75baff8513fae20 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:53.815827 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861de6bd-16af-4994-bd49-d660ecbcf6bf admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:53.817849 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-861de6bd-16af-4994-bd49-d660ecbcf6bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:53.831232 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861de6bd-16af-4994-bd49-d660ecbcf6bf admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:53.884265 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f493b7a-0f5f-4fee-bd45-571fbcbe9d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:53.885136 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f493b7a-0f5f-4fee-bd45-571fbcbe9d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:53.885421 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f493b7a-0f5f-4fee-bd45-571fbcbe9d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:53.885716 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f493b7a-0f5f-4fee-bd45-571fbcbe9d7b admin admin] PATH_INFO: `/v3/users/77c183b02bd24e3caf24c55bae8a8d63` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:53.886970 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f493b7a-0f5f-4fee-bd45-571fbcbe9d7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=77c183b02bd24e3caf24c55bae8a8d63)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:53.888892 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f493b7a-0f5f-4fee-bd45-571fbcbe9d7b admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:53.932019 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-9f493b7a-0f5f-4fee-bd45-571fbcbe9d7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77c183b02bd24e3caf24c55bae8a8d63'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:53.938908 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-9f493b7a-0f5f-4fee-bd45-571fbcbe9d7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77c183b02bd24e3caf24c55bae8a8d63'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:53.946338 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-9f493b7a-0f5f-4fee-bd45-571fbcbe9d7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77c183b02bd24e3caf24c55bae8a8d63'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:53.958189 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-9f493b7a-0f5f-4fee-bd45-571fbcbe9d7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77c183b02bd24e3caf24c55bae8a8d63'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:53.958872 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-9f493b7a-0f5f-4fee-bd45-571fbcbe9d7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77c183b02bd24e3caf24c55bae8a8d63'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:53.965049 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 946/1888] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:09:53 2022] DELETE /identity/v3/users/77c183b02bd24e3caf24c55bae8a8d63 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:54.274849 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e6b33-0dd1-454b-9886-b9ce43ad94dd admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:54.276283 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-5f0e6b33-0dd1-454b-9886-b9ce43ad94dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:54.288530 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e6b33-0dd1-454b-9886-b9ce43ad94dd admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:54.343124 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c894e1-af21-40d6-a556-d84355f8e22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:54.344007 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c894e1-af21-40d6-a556-d84355f8e22d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:54.344289 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c894e1-af21-40d6-a556-d84355f8e22d admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:54.344565 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c894e1-af21-40d6-a556-d84355f8e22d admin admin] PATH_INFO: `/v3/projects/812379f1061243ff80382e8f41e3a3df` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:54.345714 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c894e1-af21-40d6-a556-d84355f8e22d admin admin] RBAC: Authorizing `identity:delete_project(project_id=812379f1061243ff80382e8f41e3a3df)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:54.347593 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c894e1-af21-40d6-a556-d84355f8e22d admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:54.391415 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-87c894e1-af21-40d6-a556-d84355f8e22d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '812379f1061243ff80382e8f41e3a3df', 'request_id': 'req-87c894e1-af21-40d6-a556-d84355f8e22d'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:54.396608 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-87c894e1-af21-40d6-a556-d84355f8e22d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '812379f1061243ff80382e8f41e3a3df', 'request_id': 'req-87c894e1-af21-40d6-a556-d84355f8e22d'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:54.402261 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-87c894e1-af21-40d6-a556-d84355f8e22d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '812379f1061243ff80382e8f41e3a3df', 'request_id': 'req-87c894e1-af21-40d6-a556-d84355f8e22d'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:54.414155 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-87c894e1-af21-40d6-a556-d84355f8e22d admin admin] The token cache is being invalidate because project 812379f1061243ff80382e8f41e3a3df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:09:54.414440 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-87c894e1-af21-40d6-a556-d84355f8e22d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:54.415155 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-87c894e1-af21-40d6-a556-d84355f8e22d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:54.416670 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 943/1889] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:09:54 2022] DELETE /identity/v3/projects/812379f1061243ff80382e8f41e3a3df => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:09:54.423262 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a10eca-3f66-49e6-ae9c-896b099bc3d3 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:54.423580 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a10eca-3f66-49e6-ae9c-896b099bc3d3 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:54.423892 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a10eca-3f66-49e6-ae9c-896b099bc3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:54.440746 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-e5a10eca-3f66-49e6-ae9c-896b099bc3d3 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:54.442073 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-e5a10eca-3f66-49e6-ae9c-896b099bc3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:54.497354 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 947/1890] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:54.507024 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89ea80-8184-4dd9-bdb6-7d86a7eedf36 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:54.507320 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89ea80-8184-4dd9-bdb6-7d86a7eedf36 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:54.507600 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89ea80-8184-4dd9-bdb6-7d86a7eedf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:54.525929 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-3c89ea80-8184-4dd9-bdb6-7d86a7eedf36 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:54.527058 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-3c89ea80-8184-4dd9-bdb6-7d86a7eedf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:54.534948 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 944/1891] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:54.538944 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a10eca-3f66-49e6-ae9c-896b099bc3d3 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:54.548260 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a10eca-3f66-49e6-ae9c-896b099bc3d3 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:54.552782 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2506bdd-d297-44d1-a826-a54a020fc0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:54.553423 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2506bdd-d297-44d1-a826-a54a020fc0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:54.553706 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2506bdd-d297-44d1-a826-a54a020fc0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:54.553983 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2506bdd-d297-44d1-a826-a54a020fc0a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:54.554697 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2506bdd-d297-44d1-a826-a54a020fc0a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:09:54.555001 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2506bdd-d297-44d1-a826-a54a020fc0a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:54.556609 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2506bdd-d297-44d1-a826-a54a020fc0a1 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:54.568135 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 948/1892] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:09:54.572503 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89ea80-8184-4dd9-bdb6-7d86a7eedf36 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:54.582261 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89ea80-8184-4dd9-bdb6-7d86a7eedf36 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:54.586801 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7c5db-3a29-47f3-b9a6-acd51dbd984a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:54.587449 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7c5db-3a29-47f3-b9a6-acd51dbd984a admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:54.587767 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7c5db-3a29-47f3-b9a6-acd51dbd984a admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:54.588050 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7c5db-3a29-47f3-b9a6-acd51dbd984a admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:54.588743 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a7c5db-3a29-47f3-b9a6-acd51dbd984a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:54.590633 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a7c5db-3a29-47f3-b9a6-acd51dbd984a admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:54.619181 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 945/1893] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:09:54 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:54.623459 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2506bdd-d297-44d1-a826-a54a020fc0a1 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:54.634019 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2506bdd-d297-44d1-a826-a54a020fc0a1 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:54.691076 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c59d5-aa57-4ef9-ad72-4de8742649b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:54.691783 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c59d5-aa57-4ef9-ad72-4de8742649b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:54.692075 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c59d5-aa57-4ef9-ad72-4de8742649b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:54.692366 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c59d5-aa57-4ef9-ad72-4de8742649b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:54.693067 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c59d5-aa57-4ef9-ad72-4de8742649b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:54.695292 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c59d5-aa57-4ef9-ad72-4de8742649b6 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:54.729309 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 949/1894] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:09:54 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:54.733818 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7c5db-3a29-47f3-b9a6-acd51dbd984a admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:54.749304 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7c5db-3a29-47f3-b9a6-acd51dbd984a admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:54.755775 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657e0ff-d84a-4b77-998d-0b3bf6a1faee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:54.756755 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657e0ff-d84a-4b77-998d-0b3bf6a1faee admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:54.760427 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657e0ff-d84a-4b77-998d-0b3bf6a1faee admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:54.760718 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657e0ff-d84a-4b77-998d-0b3bf6a1faee admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:54.761627 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657e0ff-d84a-4b77-998d-0b3bf6a1faee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:54.763628 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657e0ff-d84a-4b77-998d-0b3bf6a1faee admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:54.779792 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 946/1895] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:54.783180 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c59d5-aa57-4ef9-ad72-4de8742649b6 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:54.798019 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c59d5-aa57-4ef9-ad72-4de8742649b6 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:54.804538 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f2d821-0a89-4763-aaa5-50024d5e4aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:54.805853 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2d821-0a89-4763-aaa5-50024d5e4aea admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:54.806143 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2d821-0a89-4763-aaa5-50024d5e4aea admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:54.806854 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2d821-0a89-4763-aaa5-50024d5e4aea admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:54.807371 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f2d821-0a89-4763-aaa5-50024d5e4aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:54.809619 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f2d821-0a89-4763-aaa5-50024d5e4aea admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:54.827966 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 950/1896] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:54.831797 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657e0ff-d84a-4b77-998d-0b3bf6a1faee admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:54.854308 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657e0ff-d84a-4b77-998d-0b3bf6a1faee admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:54.861189 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c4def-250e-42a4-bf29-2ff727460b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:54.862389 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c4def-250e-42a4-bf29-2ff727460b36 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:54.862665 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c4def-250e-42a4-bf29-2ff727460b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:54.862948 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c4def-250e-42a4-bf29-2ff727460b36 admin admin] PATH_INFO: `/v3/projects/53969c7ebd8340b4a092e1d658738777/users/299411f825d947ac97f9b005f7051f7f/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:54.892916 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c4def-250e-42a4-bf29-2ff727460b36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53969c7ebd8340b4a092e1d658738777, user_id=299411f825d947ac97f9b005f7051f7f, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:54.896711 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c4def-250e-42a4-bf29-2ff727460b36 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:54.916045 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 947/1897] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:54 2022] PUT /identity/v3/projects/53969c7ebd8340b4a092e1d658738777/users/299411f825d947ac97f9b005f7051f7f/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:09:54.926049 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673670d-3512-4bea-afa1-fea6df467beb None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:54.926556 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673670d-3512-4bea-afa1-fea6df467beb None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:54.926908 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673670d-3512-4bea-afa1-fea6df467beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:54.961937 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-c673670d-3512-4bea-afa1-fea6df467beb None None] MFA Rules not processed for user `299411f825d947ac97f9b005f7051f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:54.963163 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-c673670d-3512-4bea-afa1-fea6df467beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:55.033975 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 951/1898] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:55.034703 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c4def-250e-42a4-bf29-2ff727460b36 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:55.106481 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c4def-250e-42a4-bf29-2ff727460b36 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:55.116412 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b24c88-a309-4f4d-8fb6-6bebea89dcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:55.117179 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b24c88-a309-4f4d-8fb6-6bebea89dcdb admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:55.117353 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b24c88-a309-4f4d-8fb6-6bebea89dcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:55.117635 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b24c88-a309-4f4d-8fb6-6bebea89dcdb admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:55.118345 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b24c88-a309-4f4d-8fb6-6bebea89dcdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:55.120288 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b24c88-a309-4f4d-8fb6-6bebea89dcdb admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:55.145736 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 948/1899] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:09:55 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:09:55.149894 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673670d-3512-4bea-afa1-fea6df467beb None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:55.157413 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b55fd-3293-4698-b8e4-fe68a112c868 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:55.157707 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b55fd-3293-4698-b8e4-fe68a112c868 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:55.157990 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b55fd-3293-4698-b8e4-fe68a112c868 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:55.160059 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 949/1900] 10.222.0.15 () {54 vars in 921 bytes} [Thu Mar 10 04:09:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:09:55.165896 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673670d-3512-4bea-afa1-fea6df467beb None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:55.174970 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b68aee-174f-447c-9f7b-ecbdac07428c None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:55.175340 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b68aee-174f-447c-9f7b-ecbdac07428c None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:55.175629 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b68aee-174f-447c-9f7b-ecbdac07428c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:55.195765 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-43b68aee-174f-447c-9f7b-ecbdac07428c None None] MFA Rules not processed for user `fbd92bd14ed04621af06d68161798fe3`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:55.197000 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-43b68aee-174f-447c-9f7b-ecbdac07428c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:55.228432 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4d883-ab4c-4d12-a7a9-8ca60e050707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:55.229178 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4d883-ab4c-4d12-a7a9-8ca60e050707 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:55.229460 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4d883-ab4c-4d12-a7a9-8ca60e050707 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:55.229904 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4d883-ab4c-4d12-a7a9-8ca60e050707 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:55.230607 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4d883-ab4c-4d12-a7a9-8ca60e050707 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:55.232894 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4d883-ab4c-4d12-a7a9-8ca60e050707 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:55.268240 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 952/1901] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:09:55 2022] POST /identity/v3/users => generated 300 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:09:55.269515 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4d883-ab4c-4d12-a7a9-8ca60e050707 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:55.284627 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 950/1902] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Mar 10 04:09:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:55.284818 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4d883-ab4c-4d12-a7a9-8ca60e050707 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:55.289354 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2d00a-0a6d-443f-b49c-489274d3584c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:55.290107 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2d00a-0a6d-443f-b49c-489274d3584c admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:55.290454 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2d00a-0a6d-443f-b49c-489274d3584c admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:55.297374 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2d00a-0a6d-443f-b49c-489274d3584c admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:55.298228 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2d00a-0a6d-443f-b49c-489274d3584c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:55.299051 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b68aee-174f-447c-9f7b-ecbdac07428c None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:55.300141 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2d00a-0a6d-443f-b49c-489274d3584c admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:55.300971 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-43b68aee-174f-447c-9f7b-ecbdac07428c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:55.313697 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 953/1903] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:55.317743 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2d00a-0a6d-443f-b49c-489274d3584c admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:55.321367 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b68aee-174f-447c-9f7b-ecbdac07428c None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:55.332625 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2d00a-0a6d-443f-b49c-489274d3584c admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:55.336593 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd172f-59d7-4d1e-bddc-36e7d77cb577 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:55.337581 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd172f-59d7-4d1e-bddc-36e7d77cb577 service nova] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:55.337704 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb78baf-1d5d-4816-8416-4d2052ce2909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:55.338333 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd172f-59d7-4d1e-bddc-36e7d77cb577 service nova] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:55.338698 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb78baf-1d5d-4816-8416-4d2052ce2909 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:55.339069 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb78baf-1d5d-4816-8416-4d2052ce2909 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:55.339789 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb78baf-1d5d-4816-8416-4d2052ce2909 admin admin] PATH_INFO: `/v3/projects/22f961e9ce2043219df19e578cf64a51/users/e41f33f687054c128aacf4720f7bd985/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:55.340239 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd172f-59d7-4d1e-bddc-36e7d77cb577 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:55.353603 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd172f-59d7-4d1e-bddc-36e7d77cb577 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:55.355339 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd172f-59d7-4d1e-bddc-36e7d77cb577 service nova] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:55.370728 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb78baf-1d5d-4816-8416-4d2052ce2909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f961e9ce2043219df19e578cf64a51, user_id=e41f33f687054c128aacf4720f7bd985, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:55.374811 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb78baf-1d5d-4816-8416-4d2052ce2909 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:55.384060 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 951/1904] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:55.396158 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 954/1905] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:55 2022] PUT /identity/v3/projects/22f961e9ce2043219df19e578cf64a51/users/e41f33f687054c128aacf4720f7bd985/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:55.399971 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd172f-59d7-4d1e-bddc-36e7d77cb577 service nova] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:55.411284 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd172f-59d7-4d1e-bddc-36e7d77cb577 service nova] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:55.477467 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21792cff-707a-4511-bc55-cb21aa408a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:55.478233 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21792cff-707a-4511-bc55-cb21aa408a10 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:55.478581 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21792cff-707a-4511-bc55-cb21aa408a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:55.478947 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21792cff-707a-4511-bc55-cb21aa408a10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:55.479780 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21792cff-707a-4511-bc55-cb21aa408a10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:55.481453 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21792cff-707a-4511-bc55-cb21aa408a10 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:55.492109 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 952/1906] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:55.496175 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb78baf-1d5d-4816-8416-4d2052ce2909 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:55.507396 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb78baf-1d5d-4816-8416-4d2052ce2909 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:55.513929 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce35974-b952-438a-b508-14da1eca9939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:55.514862 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce35974-b952-438a-b508-14da1eca9939 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:55.515149 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce35974-b952-438a-b508-14da1eca9939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:55.515976 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce35974-b952-438a-b508-14da1eca9939 admin admin] PATH_INFO: `/v3/projects/22f961e9ce2043219df19e578cf64a51/users/e41f33f687054c128aacf4720f7bd985/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:55.517947 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce35974-b952-438a-b508-14da1eca9939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f961e9ce2043219df19e578cf64a51, user_id=e41f33f687054c128aacf4720f7bd985, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:55.520621 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce35974-b952-438a-b508-14da1eca9939 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:55.530637 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 955/1907] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:55 2022] PUT /identity/v3/projects/22f961e9ce2043219df19e578cf64a51/users/e41f33f687054c128aacf4720f7bd985/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:09:55.541330 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb26af2-ccf6-4749-8de1-23c4046982bf None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:55.541624 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb26af2-ccf6-4749-8de1-23c4046982bf None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:55.541907 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb26af2-ccf6-4749-8de1-23c4046982bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:55.566986 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-8fb26af2-ccf6-4749-8de1-23c4046982bf None None] MFA Rules not processed for user `e41f33f687054c128aacf4720f7bd985`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:55.568212 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-8fb26af2-ccf6-4749-8de1-23c4046982bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:55.635054 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 953/1908] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:55.646399 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce35974-b952-438a-b508-14da1eca9939 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:55.648120 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-fce35974-b952-438a-b508-14da1eca9939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:55.702090 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce35974-b952-438a-b508-14da1eca9939 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:55.706328 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd8e27-3041-4c1e-84bb-7a66d8b8dfdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:55.706963 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd8e27-3041-4c1e-84bb-7a66d8b8dfdc service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:55.707246 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd8e27-3041-4c1e-84bb-7a66d8b8dfdc service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:55.707541 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd8e27-3041-4c1e-84bb-7a66d8b8dfdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:55.716245 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd8e27-3041-4c1e-84bb-7a66d8b8dfdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:55.717661 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd8e27-3041-4c1e-84bb-7a66d8b8dfdc service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:55.727322 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 956/1909] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:56.305213 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb26af2-ccf6-4749-8de1-23c4046982bf None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:56.363436 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb26af2-ccf6-4749-8de1-23c4046982bf None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:56.368177 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5cdba-14d5-4c38-a3aa-ebe5379a440d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:56.369043 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5cdba-14d5-4c38-a3aa-ebe5379a440d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:56.369331 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5cdba-14d5-4c38-a3aa-ebe5379a440d admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:56.369611 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5cdba-14d5-4c38-a3aa-ebe5379a440d admin admin] PATH_INFO: `/v3/users/299411f825d947ac97f9b005f7051f7f` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:56.370829 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5cdba-14d5-4c38-a3aa-ebe5379a440d admin admin] RBAC: Authorizing `identity:delete_user(user_id=299411f825d947ac97f9b005f7051f7f)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:56.372801 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5cdba-14d5-4c38-a3aa-ebe5379a440d admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:56.415214 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c8d5cdba-14d5-4c38-a3aa-ebe5379a440d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '299411f825d947ac97f9b005f7051f7f'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:56.415887 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c8d5cdba-14d5-4c38-a3aa-ebe5379a440d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '299411f825d947ac97f9b005f7051f7f'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:56.422895 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c8d5cdba-14d5-4c38-a3aa-ebe5379a440d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '299411f825d947ac97f9b005f7051f7f'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:56.433989 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c8d5cdba-14d5-4c38-a3aa-ebe5379a440d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '299411f825d947ac97f9b005f7051f7f'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:56.434676 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c8d5cdba-14d5-4c38-a3aa-ebe5379a440d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '299411f825d947ac97f9b005f7051f7f'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:56.447390 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 954/1910] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:09:56 2022] DELETE /identity/v3/users/299411f825d947ac97f9b005f7051f7f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:56.451872 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc28b3f-7315-40ae-9de5-4ef0d55c1d41 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:56.452311 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc28b3f-7315-40ae-9de5-4ef0d55c1d41 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:56.452417 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc28b3f-7315-40ae-9de5-4ef0d55c1d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:56.471470 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-ecc28b3f-7315-40ae-9de5-4ef0d55c1d41 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:56.472757 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-ecc28b3f-7315-40ae-9de5-4ef0d55c1d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:56.529923 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 957/1911] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:09:56.539023 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5cdba-14d5-4c38-a3aa-ebe5379a440d admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:56.540427 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-c8d5cdba-14d5-4c38-a3aa-ebe5379a440d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:56.596712 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5cdba-14d5-4c38-a3aa-ebe5379a440d admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:56.600346 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53153c-a8ae-4da2-bdb0-06bd2e84f5da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:56.600991 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53153c-a8ae-4da2-bdb0-06bd2e84f5da service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:56.601276 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53153c-a8ae-4da2-bdb0-06bd2e84f5da service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:56.601554 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53153c-a8ae-4da2-bdb0-06bd2e84f5da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:56.610935 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f53153c-a8ae-4da2-bdb0-06bd2e84f5da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:56.612397 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f53153c-a8ae-4da2-bdb0-06bd2e84f5da service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:56.622782 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 955/1912] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:56.874660 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc28b3f-7315-40ae-9de5-4ef0d55c1d41 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:56.876361 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-ecc28b3f-7315-40ae-9de5-4ef0d55c1d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:56.890959 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc28b3f-7315-40ae-9de5-4ef0d55c1d41 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:56.902691 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ee9fb-9de2-4c58-9985-2d0f8b8bbc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:56.903615 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ee9fb-9de2-4c58-9985-2d0f8b8bbc4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:56.903928 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ee9fb-9de2-4c58-9985-2d0f8b8bbc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:56.904202 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ee9fb-9de2-4c58-9985-2d0f8b8bbc4d admin admin] PATH_INFO: `/v3/projects/53969c7ebd8340b4a092e1d658738777` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:56.905395 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ee9fb-9de2-4c58-9985-2d0f8b8bbc4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=53969c7ebd8340b4a092e1d658738777)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:56.907883 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ee9fb-9de2-4c58-9985-2d0f8b8bbc4d admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:56.952406 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-e44ee9fb-9de2-4c58-9985-2d0f8b8bbc4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53969c7ebd8340b4a092e1d658738777', 'request_id': 'req-e44ee9fb-9de2-4c58-9985-2d0f8b8bbc4d'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:56.957513 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-e44ee9fb-9de2-4c58-9985-2d0f8b8bbc4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53969c7ebd8340b4a092e1d658738777', 'request_id': 'req-e44ee9fb-9de2-4c58-9985-2d0f8b8bbc4d'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:56.963475 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-e44ee9fb-9de2-4c58-9985-2d0f8b8bbc4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53969c7ebd8340b4a092e1d658738777', 'request_id': 'req-e44ee9fb-9de2-4c58-9985-2d0f8b8bbc4d'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:56.976000 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-e44ee9fb-9de2-4c58-9985-2d0f8b8bbc4d admin admin] The token cache is being invalidate because project 53969c7ebd8340b4a092e1d658738777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:09:56.976307 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-e44ee9fb-9de2-4c58-9985-2d0f8b8bbc4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:56.976943 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-e44ee9fb-9de2-4c58-9985-2d0f8b8bbc4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:56.978440 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 958/1913] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:09:56 2022] DELETE /identity/v3/projects/53969c7ebd8340b4a092e1d658738777 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:56.982299 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53153c-a8ae-4da2-bdb0-06bd2e84f5da service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:56.992508 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53153c-a8ae-4da2-bdb0-06bd2e84f5da service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:57.046762 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2a3f0-cbad-4489-b692-6f87150e19de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:57.047629 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2a3f0-cbad-4489-b692-6f87150e19de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:57.047941 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2a3f0-cbad-4489-b692-6f87150e19de admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:57.048219 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2a3f0-cbad-4489-b692-6f87150e19de admin admin] PATH_INFO: `/v3/users/e41f33f687054c128aacf4720f7bd985` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:57.049379 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2a3f0-cbad-4489-b692-6f87150e19de admin admin] RBAC: Authorizing `identity:delete_user(user_id=e41f33f687054c128aacf4720f7bd985)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:57.051268 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2a3f0-cbad-4489-b692-6f87150e19de admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:57.098969 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-93f2a3f0-cbad-4489-b692-6f87150e19de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e41f33f687054c128aacf4720f7bd985'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:57.099627 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-93f2a3f0-cbad-4489-b692-6f87150e19de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e41f33f687054c128aacf4720f7bd985'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:57.106266 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-93f2a3f0-cbad-4489-b692-6f87150e19de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e41f33f687054c128aacf4720f7bd985'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:57.117832 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-93f2a3f0-cbad-4489-b692-6f87150e19de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e41f33f687054c128aacf4720f7bd985'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:57.118366 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-93f2a3f0-cbad-4489-b692-6f87150e19de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e41f33f687054c128aacf4720f7bd985'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:57.130713 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 956/1914] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:09:56 2022] DELETE /identity/v3/users/e41f33f687054c128aacf4720f7bd985 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:57.414676 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ee9fb-9de2-4c58-9985-2d0f8b8bbc4d admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:57.415847 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-e44ee9fb-9de2-4c58-9985-2d0f8b8bbc4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:57.431302 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ee9fb-9de2-4c58-9985-2d0f8b8bbc4d admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:57.503550 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9cb16-a8ed-424f-961a-813a73521296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:57.504446 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9cb16-a8ed-424f-961a-813a73521296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:57.504748 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9cb16-a8ed-424f-961a-813a73521296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:57.505003 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9cb16-a8ed-424f-961a-813a73521296 admin admin] PATH_INFO: `/v3/projects/22f961e9ce2043219df19e578cf64a51` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:57.506171 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9cb16-a8ed-424f-961a-813a73521296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22f961e9ce2043219df19e578cf64a51)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:57.508122 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9cb16-a8ed-424f-961a-813a73521296 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:57.551662 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-12d9cb16-a8ed-424f-961a-813a73521296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22f961e9ce2043219df19e578cf64a51', 'request_id': 'req-12d9cb16-a8ed-424f-961a-813a73521296'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:57.557027 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-12d9cb16-a8ed-424f-961a-813a73521296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22f961e9ce2043219df19e578cf64a51', 'request_id': 'req-12d9cb16-a8ed-424f-961a-813a73521296'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:57.563513 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-12d9cb16-a8ed-424f-961a-813a73521296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22f961e9ce2043219df19e578cf64a51', 'request_id': 'req-12d9cb16-a8ed-424f-961a-813a73521296'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:57.575786 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-12d9cb16-a8ed-424f-961a-813a73521296 admin admin] The token cache is being invalidate because project 22f961e9ce2043219df19e578cf64a51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:09:57.576179 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-12d9cb16-a8ed-424f-961a-813a73521296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:57.576800 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-12d9cb16-a8ed-424f-961a-813a73521296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:57.578987 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 959/1915] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:09:57 2022] DELETE /identity/v3/projects/22f961e9ce2043219df19e578cf64a51 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:57.584542 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed891f-a4b8-4bf2-be65-0922fc81dbbb None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:57.585033 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed891f-a4b8-4bf2-be65-0922fc81dbbb None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:57.585120 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed891f-a4b8-4bf2-be65-0922fc81dbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:57.602907 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-f9ed891f-a4b8-4bf2-be65-0922fc81dbbb None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:57.604132 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-f9ed891f-a4b8-4bf2-be65-0922fc81dbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:57.697596 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 957/1916] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:57.707307 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e8950-7f52-4e4b-b53f-4a5e784e11f4 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:57.707588 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e8950-7f52-4e4b-b53f-4a5e784e11f4 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:57.707911 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e8950-7f52-4e4b-b53f-4a5e784e11f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:57.743401 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-867e8950-7f52-4e4b-b53f-4a5e784e11f4 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:57.745337 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-867e8950-7f52-4e4b-b53f-4a5e784e11f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:57.768377 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 960/1917] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:57.773036 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed891f-a4b8-4bf2-be65-0922fc81dbbb None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:57.784724 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed891f-a4b8-4bf2-be65-0922fc81dbbb None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:57.789637 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ab787-1efa-4c3c-a868-8edeb2158b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:57.790300 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ab787-1efa-4c3c-a868-8edeb2158b4f admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:57.790580 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ab787-1efa-4c3c-a868-8edeb2158b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:57.790854 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ab787-1efa-4c3c-a868-8edeb2158b4f admin admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:57.791584 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ab787-1efa-4c3c-a868-8edeb2158b4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:09:57.791917 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ab787-1efa-4c3c-a868-8edeb2158b4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:57.793867 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ab787-1efa-4c3c-a868-8edeb2158b4f admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:57.806875 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 958/1918] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:09:57.811084 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e8950-7f52-4e4b-b53f-4a5e784e11f4 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:57.824348 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e8950-7f52-4e4b-b53f-4a5e784e11f4 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:57.832817 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11eb8ac-75f6-42af-aa86-5cb827d1fbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:57.834031 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11eb8ac-75f6-42af-aa86-5cb827d1fbc8 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:57.834501 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11eb8ac-75f6-42af-aa86-5cb827d1fbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:57.834922 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11eb8ac-75f6-42af-aa86-5cb827d1fbc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:57.836244 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11eb8ac-75f6-42af-aa86-5cb827d1fbc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:57.838626 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11eb8ac-75f6-42af-aa86-5cb827d1fbc8 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:57.876416 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 961/1919] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:09:57 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:57.882066 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ab787-1efa-4c3c-a868-8edeb2158b4f admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:57.897382 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ab787-1efa-4c3c-a868-8edeb2158b4f admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:58.008345 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249530c-21ae-4e36-994b-edd17fd4c420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:58.009326 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249530c-21ae-4e36-994b-edd17fd4c420 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:58.009708 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249530c-21ae-4e36-994b-edd17fd4c420 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:58.010082 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249530c-21ae-4e36-994b-edd17fd4c420 admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:58.010845 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f249530c-21ae-4e36-994b-edd17fd4c420 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:58.013021 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f249530c-21ae-4e36-994b-edd17fd4c420 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:58.047059 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 959/1920] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:09:57 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:58.047910 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11eb8ac-75f6-42af-aa86-5cb827d1fbc8 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:58.061374 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11eb8ac-75f6-42af-aa86-5cb827d1fbc8 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:58.077389 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625cb26-9e61-465b-8495-4069c7791ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:58.078539 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625cb26-9e61-465b-8495-4069c7791ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:58.078830 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625cb26-9e61-465b-8495-4069c7791ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:58.079125 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625cb26-9e61-465b-8495-4069c7791ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:58.081039 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625cb26-9e61-465b-8495-4069c7791ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:58.083497 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625cb26-9e61-465b-8495-4069c7791ba1 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:58.099562 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 962/1921] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:58.103637 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249530c-21ae-4e36-994b-edd17fd4c420 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:58.122795 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249530c-21ae-4e36-994b-edd17fd4c420 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:58.134108 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68c724-711d-4c27-a28f-c93d3ab5bc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:58.135797 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68c724-711d-4c27-a28f-c93d3ab5bc43 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:58.136988 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68c724-711d-4c27-a28f-c93d3ab5bc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:58.137260 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68c724-711d-4c27-a28f-c93d3ab5bc43 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:58.138671 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68c724-711d-4c27-a28f-c93d3ab5bc43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:58.142966 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68c724-711d-4c27-a28f-c93d3ab5bc43 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:58.171010 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625cb26-9e61-465b-8495-4069c7791ba1 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:58.171433 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 960/1922] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:58.184772 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625cb26-9e61-465b-8495-4069c7791ba1 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:58.191256 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd69cc-a41a-4d3f-8557-7c2c2521d650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:58.192298 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd69cc-a41a-4d3f-8557-7c2c2521d650 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:58.192705 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd69cc-a41a-4d3f-8557-7c2c2521d650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:58.193071 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd69cc-a41a-4d3f-8557-7c2c2521d650 admin admin] PATH_INFO: `/v3/projects/004648d2397842b0971b63e6c3a31365/users/f32722790f8b45a5bd861233d47e2e3e/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:58.214306 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd69cc-a41a-4d3f-8557-7c2c2521d650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=004648d2397842b0971b63e6c3a31365, user_id=f32722790f8b45a5bd861233d47e2e3e, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:58.218054 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd69cc-a41a-4d3f-8557-7c2c2521d650 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:58.233724 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 963/1923] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:58 2022] PUT /identity/v3/projects/004648d2397842b0971b63e6c3a31365/users/f32722790f8b45a5bd861233d47e2e3e/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:58.244687 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bfe7a-8732-4b43-8723-3294e1c990cb None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:58.244976 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bfe7a-8732-4b43-8723-3294e1c990cb None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:58.245255 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bfe7a-8732-4b43-8723-3294e1c990cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:58.278452 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-d51bfe7a-8732-4b43-8723-3294e1c990cb None None] MFA Rules not processed for user `f32722790f8b45a5bd861233d47e2e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:58.279847 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-d51bfe7a-8732-4b43-8723-3294e1c990cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:58.356074 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 961/1924] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:58.408510 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd69cc-a41a-4d3f-8557-7c2c2521d650 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:58.411049 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-40cd69cc-a41a-4d3f-8557-7c2c2521d650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:58.549999 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd69cc-a41a-4d3f-8557-7c2c2521d650 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:58.555651 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123026f6-2fec-4c03-8b1e-776cf10f2f09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:58.556576 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123026f6-2fec-4c03-8b1e-776cf10f2f09 service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:58.556929 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123026f6-2fec-4c03-8b1e-776cf10f2f09 service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:58.557498 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123026f6-2fec-4c03-8b1e-776cf10f2f09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:58.567085 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123026f6-2fec-4c03-8b1e-776cf10f2f09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:58.568814 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123026f6-2fec-4c03-8b1e-776cf10f2f09 service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:58.578986 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 964/1925] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:09:58.600361 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51bfe7a-8732-4b43-8723-3294e1c990cb None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:58.665326 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51bfe7a-8732-4b43-8723-3294e1c990cb None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:58.670095 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98a8ab-f04e-442e-96b0-57af697961b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:58.671189 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98a8ab-f04e-442e-96b0-57af697961b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:58.671591 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98a8ab-f04e-442e-96b0-57af697961b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:58.672016 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98a8ab-f04e-442e-96b0-57af697961b1 admin admin] PATH_INFO: `/v3/users/f32722790f8b45a5bd861233d47e2e3e` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:58.673300 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98a8ab-f04e-442e-96b0-57af697961b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f32722790f8b45a5bd861233d47e2e3e)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:58.675440 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98a8ab-f04e-442e-96b0-57af697961b1 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:58.729900 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-0c98a8ab-f04e-442e-96b0-57af697961b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f32722790f8b45a5bd861233d47e2e3e'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:58.730828 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-0c98a8ab-f04e-442e-96b0-57af697961b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f32722790f8b45a5bd861233d47e2e3e'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:58.740107 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-0c98a8ab-f04e-442e-96b0-57af697961b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f32722790f8b45a5bd861233d47e2e3e'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:58.753950 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-0c98a8ab-f04e-442e-96b0-57af697961b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f32722790f8b45a5bd861233d47e2e3e'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:58.754672 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-0c98a8ab-f04e-442e-96b0-57af697961b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f32722790f8b45a5bd861233d47e2e3e'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:58.776361 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 962/1926] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:09:58 2022] DELETE /identity/v3/users/f32722790f8b45a5bd861233d47e2e3e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:58.783930 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42692533-dfeb-4b5b-aa1a-4ec0b40de6a1 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:58.784464 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42692533-dfeb-4b5b-aa1a-4ec0b40de6a1 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:58.784944 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42692533-dfeb-4b5b-aa1a-4ec0b40de6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:58.804134 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-42692533-dfeb-4b5b-aa1a-4ec0b40de6a1 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:58.805474 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-42692533-dfeb-4b5b-aa1a-4ec0b40de6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:58.862799 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 965/1927] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:58.872920 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98a8ab-f04e-442e-96b0-57af697961b1 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:58.875090 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-0c98a8ab-f04e-442e-96b0-57af697961b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:58.930842 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98a8ab-f04e-442e-96b0-57af697961b1 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:58.934567 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094890f2-8637-4229-80c8-4c7185bfdf0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:58.935211 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094890f2-8637-4229-80c8-4c7185bfdf0c service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:58.935497 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094890f2-8637-4229-80c8-4c7185bfdf0c service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:58.935810 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094890f2-8637-4229-80c8-4c7185bfdf0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:58.945611 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094890f2-8637-4229-80c8-4c7185bfdf0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:58.947043 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094890f2-8637-4229-80c8-4c7185bfdf0c service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:58.957212 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 963/1928] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:59.215666 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42692533-dfeb-4b5b-aa1a-4ec0b40de6a1 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:59.217202 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-42692533-dfeb-4b5b-aa1a-4ec0b40de6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:59.246996 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42692533-dfeb-4b5b-aa1a-4ec0b40de6a1 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:59.252733 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337bc13-61c3-4676-9bc8-3907bfcf9257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:59.253595 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337bc13-61c3-4676-9bc8-3907bfcf9257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:59.253873 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337bc13-61c3-4676-9bc8-3907bfcf9257 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:59.254149 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337bc13-61c3-4676-9bc8-3907bfcf9257 admin admin] PATH_INFO: `/v3/projects/004648d2397842b0971b63e6c3a31365` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:59.255317 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337bc13-61c3-4676-9bc8-3907bfcf9257 admin admin] RBAC: Authorizing `identity:delete_project(project_id=004648d2397842b0971b63e6c3a31365)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:59.257259 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337bc13-61c3-4676-9bc8-3907bfcf9257 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:59.303083 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-6337bc13-61c3-4676-9bc8-3907bfcf9257 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '004648d2397842b0971b63e6c3a31365', 'request_id': 'req-6337bc13-61c3-4676-9bc8-3907bfcf9257'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:59.308518 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-6337bc13-61c3-4676-9bc8-3907bfcf9257 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '004648d2397842b0971b63e6c3a31365', 'request_id': 'req-6337bc13-61c3-4676-9bc8-3907bfcf9257'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:59.315014 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-6337bc13-61c3-4676-9bc8-3907bfcf9257 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '004648d2397842b0971b63e6c3a31365', 'request_id': 'req-6337bc13-61c3-4676-9bc8-3907bfcf9257'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:59.327484 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-6337bc13-61c3-4676-9bc8-3907bfcf9257 admin admin] The token cache is being invalidate because project 004648d2397842b0971b63e6c3a31365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:09:59.327901 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-6337bc13-61c3-4676-9bc8-3907bfcf9257 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:59.328521 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-6337bc13-61c3-4676-9bc8-3907bfcf9257 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:09:59.330040 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 966/1929] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:09:59 2022] DELETE /identity/v3/projects/004648d2397842b0971b63e6c3a31365 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:09:59.334941 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f679a79-003c-461f-8405-17d1f74711ff None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:59.335233 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f679a79-003c-461f-8405-17d1f74711ff None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:59.335533 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f679a79-003c-461f-8405-17d1f74711ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:59.354051 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-6f679a79-003c-461f-8405-17d1f74711ff None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:59.355257 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-6f679a79-003c-461f-8405-17d1f74711ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:59.417001 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 964/1930] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:09:59.424958 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89500e0a-3232-4552-b6d5-49fec47f43e8 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:59.425272 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89500e0a-3232-4552-b6d5-49fec47f43e8 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:59.425518 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89500e0a-3232-4552-b6d5-49fec47f43e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:59.463441 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-89500e0a-3232-4552-b6d5-49fec47f43e8 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:59.464992 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-89500e0a-3232-4552-b6d5-49fec47f43e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:59.474256 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 967/1931] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:09:59.478470 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f679a79-003c-461f-8405-17d1f74711ff None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:59.488253 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f679a79-003c-461f-8405-17d1f74711ff None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:59.492986 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febcf2dc-513a-4705-9f0e-05535e047b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:59.493718 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcf2dc-513a-4705-9f0e-05535e047b80 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:59.494128 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcf2dc-513a-4705-9f0e-05535e047b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:59.494450 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcf2dc-513a-4705-9f0e-05535e047b80 admin admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:59.495730 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febcf2dc-513a-4705-9f0e-05535e047b80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:09:59.495730 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febcf2dc-513a-4705-9f0e-05535e047b80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:59.506911 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febcf2dc-513a-4705-9f0e-05535e047b80 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:59.521322 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 965/1932] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:09:59.526118 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89500e0a-3232-4552-b6d5-49fec47f43e8 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:59.537236 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89500e0a-3232-4552-b6d5-49fec47f43e8 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:59.544420 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742a43d-d1c1-45f0-8e32-3ee24476c9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:59.545150 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742a43d-d1c1-45f0-8e32-3ee24476c9ea admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:59.545450 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742a43d-d1c1-45f0-8e32-3ee24476c9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:59.545854 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742a43d-d1c1-45f0-8e32-3ee24476c9ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:59.546629 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742a43d-d1c1-45f0-8e32-3ee24476c9ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:59.548756 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742a43d-d1c1-45f0-8e32-3ee24476c9ea admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:59.588424 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 968/1933] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:09:59 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:59.592794 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febcf2dc-513a-4705-9f0e-05535e047b80 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:59.607860 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febcf2dc-513a-4705-9f0e-05535e047b80 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:59.646670 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742a43d-d1c1-45f0-8e32-3ee24476c9ea admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:59.648899 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-5742a43d-d1c1-45f0-8e32-3ee24476c9ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:59.696029 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43b047-32bd-4f3b-a493-f8a45a81deeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:59.698494 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43b047-32bd-4f3b-a493-f8a45a81deeb admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:59.698978 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43b047-32bd-4f3b-a493-f8a45a81deeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:59.700102 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43b047-32bd-4f3b-a493-f8a45a81deeb admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:59.700983 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be43b047-32bd-4f3b-a493-f8a45a81deeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:59.703666 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be43b047-32bd-4f3b-a493-f8a45a81deeb admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:59.723402 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742a43d-d1c1-45f0-8e32-3ee24476c9ea admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:59.730451 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcaca8-582f-472b-82ff-93c76a42ad2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:59.731294 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcaca8-582f-472b-82ff-93c76a42ad2b service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:59.731748 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcaca8-582f-472b-82ff-93c76a42ad2b service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:59.732190 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcaca8-582f-472b-82ff-93c76a42ad2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:59.734232 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-24fcaca8-582f-472b-82ff-93c76a42ad2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:09:59.735857 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 966/1934] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:09:59 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:09:59.737419 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43b047-32bd-4f3b-a493-f8a45a81deeb admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:59.748862 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43b047-32bd-4f3b-a493-f8a45a81deeb admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:59.757658 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec585ee1-e9f1-455b-838e-27597da2d069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:59.758954 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec585ee1-e9f1-455b-838e-27597da2d069 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:59.759473 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec585ee1-e9f1-455b-838e-27597da2d069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:59.759948 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec585ee1-e9f1-455b-838e-27597da2d069 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:59.760765 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec585ee1-e9f1-455b-838e-27597da2d069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:59.763096 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec585ee1-e9f1-455b-838e-27597da2d069 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:59.779235 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 967/1935] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:09:59.780575 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec585ee1-e9f1-455b-838e-27597da2d069 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:59.801287 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec585ee1-e9f1-455b-838e-27597da2d069 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:59.815602 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02155a-a180-4bfe-ad9c-c81d0bb06fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:59.816734 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02155a-a180-4bfe-ad9c-c81d0bb06fba admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:59.817030 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02155a-a180-4bfe-ad9c-c81d0bb06fba admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:59.817341 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02155a-a180-4bfe-ad9c-c81d0bb06fba admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:59.818594 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02155a-a180-4bfe-ad9c-c81d0bb06fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:59.820242 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02155a-a180-4bfe-ad9c-c81d0bb06fba admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:59.837056 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 968/1936] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:09:59.841349 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02155a-a180-4bfe-ad9c-c81d0bb06fba admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:09:59.851769 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02155a-a180-4bfe-ad9c-c81d0bb06fba admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:09:59.859379 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee07bd-fa43-481d-880f-fd570a640f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:09:59.861368 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee07bd-fa43-481d-880f-fd570a640f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:59.862136 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee07bd-fa43-481d-880f-fd570a640f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:59.862631 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee07bd-fa43-481d-880f-fd570a640f62 admin admin] PATH_INFO: `/v3/projects/1559010e4014411da826e0b2506ddd52/users/4a6b2735191b4e78b2e95a15d99dc445/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:59.869319 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcaca8-582f-472b-82ff-93c76a42ad2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:59.871326 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcaca8-582f-472b-82ff-93c76a42ad2b service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:59.884900 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee07bd-fa43-481d-880f-fd570a640f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1559010e4014411da826e0b2506ddd52, user_id=4a6b2735191b4e78b2e95a15d99dc445, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:09:59.888049 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 969/1937] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:09:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:09:59.888676 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee07bd-fa43-481d-880f-fd570a640f62 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:09:59.907958 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 969/1938] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:09:59 2022] PUT /identity/v3/projects/1559010e4014411da826e0b2506ddd52/users/4a6b2735191b4e78b2e95a15d99dc445/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:09:59.917939 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ed4bb-04b2-45b8-a9fc-cc408dc29833 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:09:59.918333 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ed4bb-04b2-45b8-a9fc-cc408dc29833 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:09:59.918563 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ed4bb-04b2-45b8-a9fc-cc408dc29833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:09:59.962784 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-461ed4bb-04b2-45b8-a9fc-cc408dc29833 None None] MFA Rules not processed for user `4a6b2735191b4e78b2e95a15d99dc445`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:09:59.964294 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-461ed4bb-04b2-45b8-a9fc-cc408dc29833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:00.034360 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 970/1939] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:09:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:00.039674 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee07bd-fa43-481d-880f-fd570a640f62 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:00.138271 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee07bd-fa43-481d-880f-fd570a640f62 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:00.160709 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622a2f4-6cda-4baa-af7d-963965d4a840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:00.161565 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622a2f4-6cda-4baa-af7d-963965d4a840 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:00.161951 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622a2f4-6cda-4baa-af7d-963965d4a840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:00.162300 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622a2f4-6cda-4baa-af7d-963965d4a840 admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:00.163619 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9622a2f4-6cda-4baa-af7d-963965d4a840 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:00.165914 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9622a2f4-6cda-4baa-af7d-963965d4a840 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:00.225901 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 970/1940] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:10:00 2022] POST /identity/v3/projects => generated 377 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:10:00.231630 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ed4bb-04b2-45b8-a9fc-cc408dc29833 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:00.258319 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ed4bb-04b2-45b8-a9fc-cc408dc29833 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:00.324465 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230cbed-7eaa-4495-8004-62f429ca101d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:00.325680 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230cbed-7eaa-4495-8004-62f429ca101d admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:00.325680 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230cbed-7eaa-4495-8004-62f429ca101d admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:00.325874 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230cbed-7eaa-4495-8004-62f429ca101d admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:00.326436 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230cbed-7eaa-4495-8004-62f429ca101d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:00.328603 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230cbed-7eaa-4495-8004-62f429ca101d admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:00.368356 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 971/1941] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:10:00 2022] POST /identity/v3/users => generated 289 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:10:00.373759 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622a2f4-6cda-4baa-af7d-963965d4a840 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:00.390295 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622a2f4-6cda-4baa-af7d-963965d4a840 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:00.397054 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688dbd99-4a60-4e54-a243-bea1c42da637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:00.397793 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688dbd99-4a60-4e54-a243-bea1c42da637 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:00.398093 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688dbd99-4a60-4e54-a243-bea1c42da637 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:00.398543 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688dbd99-4a60-4e54-a243-bea1c42da637 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:00.399297 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688dbd99-4a60-4e54-a243-bea1c42da637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:00.408481 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688dbd99-4a60-4e54-a243-bea1c42da637 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:00.421366 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 971/1942] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:10:00.426001 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230cbed-7eaa-4495-8004-62f429ca101d admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:00.437301 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230cbed-7eaa-4495-8004-62f429ca101d admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:00.441312 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c889c-72fa-4aec-a3c9-6901b4878609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:00.441977 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c889c-72fa-4aec-a3c9-6901b4878609 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:00.442261 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c889c-72fa-4aec-a3c9-6901b4878609 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:00.442556 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c889c-72fa-4aec-a3c9-6901b4878609 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:00.443664 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c889c-72fa-4aec-a3c9-6901b4878609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:00.445283 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c889c-72fa-4aec-a3c9-6901b4878609 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:00.455336 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 972/1943] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:10:00.460175 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688dbd99-4a60-4e54-a243-bea1c42da637 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:00.470749 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688dbd99-4a60-4e54-a243-bea1c42da637 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:00.475895 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c10fb-1501-49bf-8933-38c6fe8cee9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:00.476920 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c10fb-1501-49bf-8933-38c6fe8cee9f admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:00.477247 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c10fb-1501-49bf-8933-38c6fe8cee9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:00.477525 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c10fb-1501-49bf-8933-38c6fe8cee9f admin admin] PATH_INFO: `/v3/projects/865cb38861634823bb850af8a0b1d0e0/users/1c8cf990f192481b9828e13c6bd59438/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:00.495203 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c10fb-1501-49bf-8933-38c6fe8cee9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=865cb38861634823bb850af8a0b1d0e0, user_id=1c8cf990f192481b9828e13c6bd59438, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:00.497827 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c10fb-1501-49bf-8933-38c6fe8cee9f admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:00.519887 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 972/1944] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:10:00 2022] PUT /identity/v3/projects/865cb38861634823bb850af8a0b1d0e0/users/1c8cf990f192481b9828e13c6bd59438/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:00.521642 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8794a-ec5c-42f1-9c5d-b22fb96eb6ab None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:00.521935 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8794a-ec5c-42f1-9c5d-b22fb96eb6ab None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:00.522217 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8794a-ec5c-42f1-9c5d-b22fb96eb6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:00.558906 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-76a8794a-ec5c-42f1-9c5d-b22fb96eb6ab None None] MFA Rules not processed for user `1c8cf990f192481b9828e13c6bd59438`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:00.560257 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-76a8794a-ec5c-42f1-9c5d-b22fb96eb6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:00.632266 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 973/1945] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:10:00.636910 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c10fb-1501-49bf-8933-38c6fe8cee9f admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:00.726805 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c10fb-1501-49bf-8933-38c6fe8cee9f admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:00.731631 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad969b-0ec8-4379-a6a9-30198c7af839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:00.732325 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad969b-0ec8-4379-a6a9-30198c7af839 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:00.732610 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad969b-0ec8-4379-a6a9-30198c7af839 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:00.732891 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad969b-0ec8-4379-a6a9-30198c7af839 admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:00.733583 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad969b-0ec8-4379-a6a9-30198c7af839 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:00.736076 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad969b-0ec8-4379-a6a9-30198c7af839 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:00.761592 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 973/1946] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:10:00 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:10:00.766225 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8794a-ec5c-42f1-9c5d-b22fb96eb6ab None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:00.778193 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8794a-ec5c-42f1-9c5d-b22fb96eb6ab None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:00.833545 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491747d-9f39-4019-a352-5a455ea58719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:00.834375 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491747d-9f39-4019-a352-5a455ea58719 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:00.834554 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491747d-9f39-4019-a352-5a455ea58719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:00.834824 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491747d-9f39-4019-a352-5a455ea58719 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:00.835523 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491747d-9f39-4019-a352-5a455ea58719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:00.837470 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491747d-9f39-4019-a352-5a455ea58719 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:00.858260 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 974/1947] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:10:00 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:10:00.861974 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad969b-0ec8-4379-a6a9-30198c7af839 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:00.872191 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad969b-0ec8-4379-a6a9-30198c7af839 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:00.877072 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb60ec-f6d3-4bfd-9ad9-599e48046923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:00.877733 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb60ec-f6d3-4bfd-9ad9-599e48046923 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:00.878017 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb60ec-f6d3-4bfd-9ad9-599e48046923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:00.878294 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb60ec-f6d3-4bfd-9ad9-599e48046923 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:00.879012 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb60ec-f6d3-4bfd-9ad9-599e48046923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:00.880627 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb60ec-f6d3-4bfd-9ad9-599e48046923 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:00.891782 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 974/1948] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:10:00.896028 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491747d-9f39-4019-a352-5a455ea58719 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:00.906543 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491747d-9f39-4019-a352-5a455ea58719 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:00.911288 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ef004-1a07-41d2-989d-a343b46ad693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:00.912205 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ef004-1a07-41d2-989d-a343b46ad693 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:00.912485 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ef004-1a07-41d2-989d-a343b46ad693 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:00.912760 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ef004-1a07-41d2-989d-a343b46ad693 admin admin] PATH_INFO: `/v3/projects/701a22654b85485db205c89d62fc9657/users/8d5fe42cc3434232bfc93766df2320fa/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:00.926832 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ef004-1a07-41d2-989d-a343b46ad693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=701a22654b85485db205c89d62fc9657, user_id=8d5fe42cc3434232bfc93766df2320fa, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:00.929496 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ef004-1a07-41d2-989d-a343b46ad693 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:00.942408 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 975/1949] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:10:00 2022] PUT /identity/v3/projects/701a22654b85485db205c89d62fc9657/users/8d5fe42cc3434232bfc93766df2320fa/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:10:00.946588 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb60ec-f6d3-4bfd-9ad9-599e48046923 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:00.957081 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb60ec-f6d3-4bfd-9ad9-599e48046923 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:01.026399 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066738c-eb32-4992-946d-a685c27474ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:01.027073 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066738c-eb32-4992-946d-a685c27474ae admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:01.027354 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066738c-eb32-4992-946d-a685c27474ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:01.028301 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066738c-eb32-4992-946d-a685c27474ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:01.028409 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066738c-eb32-4992-946d-a685c27474ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:01.029980 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066738c-eb32-4992-946d-a685c27474ae admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:01.042788 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 975/1950] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:10:01.047538 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ef004-1a07-41d2-989d-a343b46ad693 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:01.063249 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ef004-1a07-41d2-989d-a343b46ad693 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:01.078361 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eea609-a2ba-48f5-891b-d68254962d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:01.079620 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eea609-a2ba-48f5-891b-d68254962d6c admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:01.080099 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eea609-a2ba-48f5-891b-d68254962d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:01.080520 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eea609-a2ba-48f5-891b-d68254962d6c admin admin] PATH_INFO: `/v3/projects/701a22654b85485db205c89d62fc9657/users/8d5fe42cc3434232bfc93766df2320fa/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:01.086391 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eea609-a2ba-48f5-891b-d68254962d6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=701a22654b85485db205c89d62fc9657, user_id=8d5fe42cc3434232bfc93766df2320fa, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:01.089134 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eea609-a2ba-48f5-891b-d68254962d6c admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:01.104238 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 976/1951] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:10:01 2022] PUT /identity/v3/projects/701a22654b85485db205c89d62fc9657/users/8d5fe42cc3434232bfc93766df2320fa/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:01.115270 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970950c-1dad-456b-b1f5-c4ca01181c78 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:01.115610 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970950c-1dad-456b-b1f5-c4ca01181c78 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:01.115898 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970950c-1dad-456b-b1f5-c4ca01181c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:01.150302 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-c970950c-1dad-456b-b1f5-c4ca01181c78 None None] MFA Rules not processed for user `8d5fe42cc3434232bfc93766df2320fa`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:01.151600 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-c970950c-1dad-456b-b1f5-c4ca01181c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:01.227790 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 976/1952] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:01.238949 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eea609-a2ba-48f5-891b-d68254962d6c admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:01.240860 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-e7eea609-a2ba-48f5-891b-d68254962d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:01.316530 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eea609-a2ba-48f5-891b-d68254962d6c admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:01.321281 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0122b6c-66ad-4829-8312-9fcf00285c37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:01.321914 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0122b6c-66ad-4829-8312-9fcf00285c37 service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:01.322271 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0122b6c-66ad-4829-8312-9fcf00285c37 service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:01.322466 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0122b6c-66ad-4829-8312-9fcf00285c37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:01.448162 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0122b6c-66ad-4829-8312-9fcf00285c37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:01.450298 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0122b6c-66ad-4829-8312-9fcf00285c37 service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:01.467785 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 977/1953] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:10:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:10:01.976682 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970950c-1dad-456b-b1f5-c4ca01181c78 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:01.978432 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-c970950c-1dad-456b-b1f5-c4ca01181c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:02.054329 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970950c-1dad-456b-b1f5-c4ca01181c78 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:02.058898 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492464ae-efe6-4254-9f84-209a3cd68339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:02.059802 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492464ae-efe6-4254-9f84-209a3cd68339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:02.060089 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492464ae-efe6-4254-9f84-209a3cd68339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:02.060364 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492464ae-efe6-4254-9f84-209a3cd68339 admin admin] PATH_INFO: `/v3/users/ea310fa8f701448da87eca14f0c66be1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:02.061586 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492464ae-efe6-4254-9f84-209a3cd68339 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea310fa8f701448da87eca14f0c66be1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:02.063517 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492464ae-efe6-4254-9f84-209a3cd68339 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:02.109830 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-492464ae-efe6-4254-9f84-209a3cd68339 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea310fa8f701448da87eca14f0c66be1'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:02.110493 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-492464ae-efe6-4254-9f84-209a3cd68339 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea310fa8f701448da87eca14f0c66be1'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:02.117101 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-492464ae-efe6-4254-9f84-209a3cd68339 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea310fa8f701448da87eca14f0c66be1'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:02.128270 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-492464ae-efe6-4254-9f84-209a3cd68339 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea310fa8f701448da87eca14f0c66be1'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:02.128929 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-492464ae-efe6-4254-9f84-209a3cd68339 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea310fa8f701448da87eca14f0c66be1'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:02.140764 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 977/1954] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:10:01 2022] DELETE /identity/v3/users/ea310fa8f701448da87eca14f0c66be1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:02.145816 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112b879-2571-4206-a36b-ccc2afe5bc70 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:02.146257 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112b879-2571-4206-a36b-ccc2afe5bc70 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:02.146439 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112b879-2571-4206-a36b-ccc2afe5bc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:02.164072 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-3112b879-2571-4206-a36b-ccc2afe5bc70 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:02.165270 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-3112b879-2571-4206-a36b-ccc2afe5bc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:02.221341 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 978/1955] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:02.230812 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492464ae-efe6-4254-9f84-209a3cd68339 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:02.232241 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-492464ae-efe6-4254-9f84-209a3cd68339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:02.286397 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492464ae-efe6-4254-9f84-209a3cd68339 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:02.289933 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd963a6-328c-4a14-baf7-e215877a962e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:02.290564 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd963a6-328c-4a14-baf7-e215877a962e service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:02.290846 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd963a6-328c-4a14-baf7-e215877a962e service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:02.291122 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd963a6-328c-4a14-baf7-e215877a962e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:02.299864 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd963a6-328c-4a14-baf7-e215877a962e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:02.301204 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd963a6-328c-4a14-baf7-e215877a962e service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:02.310239 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 978/1956] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:10:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:10:02.614877 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112b879-2571-4206-a36b-ccc2afe5bc70 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:02.616781 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-3112b879-2571-4206-a36b-ccc2afe5bc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:02.630174 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112b879-2571-4206-a36b-ccc2afe5bc70 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:02.634729 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0db36f-9d24-4029-9e68-d5cbb54107f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:02.635611 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0db36f-9d24-4029-9e68-d5cbb54107f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:02.635927 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0db36f-9d24-4029-9e68-d5cbb54107f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:02.636195 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0db36f-9d24-4029-9e68-d5cbb54107f6 admin admin] PATH_INFO: `/v3/projects/41f196a6d1a94fd6909466025650e596` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:02.637709 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0db36f-9d24-4029-9e68-d5cbb54107f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41f196a6d1a94fd6909466025650e596)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:02.639255 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0db36f-9d24-4029-9e68-d5cbb54107f6 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:02.686176 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-ef0db36f-9d24-4029-9e68-d5cbb54107f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41f196a6d1a94fd6909466025650e596', 'request_id': 'req-ef0db36f-9d24-4029-9e68-d5cbb54107f6'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:02.692387 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-ef0db36f-9d24-4029-9e68-d5cbb54107f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41f196a6d1a94fd6909466025650e596', 'request_id': 'req-ef0db36f-9d24-4029-9e68-d5cbb54107f6'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:02.698596 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-ef0db36f-9d24-4029-9e68-d5cbb54107f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41f196a6d1a94fd6909466025650e596', 'request_id': 'req-ef0db36f-9d24-4029-9e68-d5cbb54107f6'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:02.711483 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-ef0db36f-9d24-4029-9e68-d5cbb54107f6 admin admin] The token cache is being invalidate because project 41f196a6d1a94fd6909466025650e596 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:10:02.711824 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-ef0db36f-9d24-4029-9e68-d5cbb54107f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:02.712434 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-ef0db36f-9d24-4029-9e68-d5cbb54107f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:02.713981 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 979/1957] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:10:02 2022] DELETE /identity/v3/projects/41f196a6d1a94fd6909466025650e596 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:02.717992 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd963a6-328c-4a14-baf7-e215877a962e service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:02.727756 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd963a6-328c-4a14-baf7-e215877a962e service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:02.785095 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0767e-182d-4ac0-8a98-a43ae741f222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:02.785978 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0767e-182d-4ac0-8a98-a43ae741f222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:02.786260 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0767e-182d-4ac0-8a98-a43ae741f222 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:02.786535 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0767e-182d-4ac0-8a98-a43ae741f222 admin admin] PATH_INFO: `/v3/users/ed91bf71e98f48a0a20b46517b8005e9` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:02.787774 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0767e-182d-4ac0-8a98-a43ae741f222 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed91bf71e98f48a0a20b46517b8005e9)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:02.789690 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0767e-182d-4ac0-8a98-a43ae741f222 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:02.837055 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c2d0767e-182d-4ac0-8a98-a43ae741f222 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed91bf71e98f48a0a20b46517b8005e9'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:02.837721 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c2d0767e-182d-4ac0-8a98-a43ae741f222 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed91bf71e98f48a0a20b46517b8005e9'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:02.844558 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c2d0767e-182d-4ac0-8a98-a43ae741f222 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed91bf71e98f48a0a20b46517b8005e9'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:02.856211 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c2d0767e-182d-4ac0-8a98-a43ae741f222 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed91bf71e98f48a0a20b46517b8005e9'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:02.856896 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c2d0767e-182d-4ac0-8a98-a43ae741f222 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed91bf71e98f48a0a20b46517b8005e9'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:02.869534 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 979/1958] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:10:02 2022] DELETE /identity/v3/users/ed91bf71e98f48a0a20b46517b8005e9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:10:03.138288 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0db36f-9d24-4029-9e68-d5cbb54107f6 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:03.139974 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-ef0db36f-9d24-4029-9e68-d5cbb54107f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:03.157375 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0db36f-9d24-4029-9e68-d5cbb54107f6 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:03.223199 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407b0c3-2e12-4e60-828b-fcf14dc6ce6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:03.224101 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407b0c3-2e12-4e60-828b-fcf14dc6ce6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:03.224381 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407b0c3-2e12-4e60-828b-fcf14dc6ce6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:03.224657 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407b0c3-2e12-4e60-828b-fcf14dc6ce6b admin admin] PATH_INFO: `/v3/projects/ffe4fe85e7f94a55ac41e20783d9f996` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:03.225823 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407b0c3-2e12-4e60-828b-fcf14dc6ce6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffe4fe85e7f94a55ac41e20783d9f996)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:03.227857 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407b0c3-2e12-4e60-828b-fcf14dc6ce6b admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:03.271824 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5407b0c3-2e12-4e60-828b-fcf14dc6ce6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffe4fe85e7f94a55ac41e20783d9f996', 'request_id': 'req-5407b0c3-2e12-4e60-828b-fcf14dc6ce6b'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:03.277068 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5407b0c3-2e12-4e60-828b-fcf14dc6ce6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffe4fe85e7f94a55ac41e20783d9f996', 'request_id': 'req-5407b0c3-2e12-4e60-828b-fcf14dc6ce6b'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:03.283134 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5407b0c3-2e12-4e60-828b-fcf14dc6ce6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffe4fe85e7f94a55ac41e20783d9f996', 'request_id': 'req-5407b0c3-2e12-4e60-828b-fcf14dc6ce6b'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:03.294844 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5407b0c3-2e12-4e60-828b-fcf14dc6ce6b admin admin] The token cache is being invalidate because project ffe4fe85e7f94a55ac41e20783d9f996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:10:03.295132 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5407b0c3-2e12-4e60-828b-fcf14dc6ce6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:03.295782 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5407b0c3-2e12-4e60-828b-fcf14dc6ce6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:03.297813 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 980/1959] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:10:03 2022] DELETE /identity/v3/projects/ffe4fe85e7f94a55ac41e20783d9f996 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:03.303076 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da354474-1254-44f8-8bc0-ad1af6eeea35 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:03.303529 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da354474-1254-44f8-8bc0-ad1af6eeea35 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:03.303640 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da354474-1254-44f8-8bc0-ad1af6eeea35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:03.323300 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-da354474-1254-44f8-8bc0-ad1af6eeea35 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:03.324616 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-da354474-1254-44f8-8bc0-ad1af6eeea35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:03.379360 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 980/1960] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:10:03.386976 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ae3a1-01b2-436a-9526-0dd9323a3399 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:03.387267 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ae3a1-01b2-436a-9526-0dd9323a3399 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:03.387545 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ae3a1-01b2-436a-9526-0dd9323a3399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:03.407061 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-be2ae3a1-01b2-436a-9526-0dd9323a3399 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:03.408333 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-be2ae3a1-01b2-436a-9526-0dd9323a3399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:03.416377 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 981/1961] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:03.420805 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da354474-1254-44f8-8bc0-ad1af6eeea35 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:03.430856 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da354474-1254-44f8-8bc0-ad1af6eeea35 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:03.435388 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c17342-2438-4421-970c-94f46fc6dea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:03.436069 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c17342-2438-4421-970c-94f46fc6dea6 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:03.436357 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c17342-2438-4421-970c-94f46fc6dea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:03.436636 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c17342-2438-4421-970c-94f46fc6dea6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:03.437352 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c17342-2438-4421-970c-94f46fc6dea6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:10:03.437656 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c17342-2438-4421-970c-94f46fc6dea6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:03.439245 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c17342-2438-4421-970c-94f46fc6dea6 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:03.450640 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 981/1962] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:10:03.454998 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ae3a1-01b2-436a-9526-0dd9323a3399 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:03.464013 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ae3a1-01b2-436a-9526-0dd9323a3399 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:03.469139 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb1737-e5c6-4bea-bd82-ee8fb2dc1de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:03.469781 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb1737-e5c6-4bea-bd82-ee8fb2dc1de4 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:03.470064 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb1737-e5c6-4bea-bd82-ee8fb2dc1de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:03.470339 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb1737-e5c6-4bea-bd82-ee8fb2dc1de4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:03.471021 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb1737-e5c6-4bea-bd82-ee8fb2dc1de4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:03.472945 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb1737-e5c6-4bea-bd82-ee8fb2dc1de4 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:03.498486 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 982/1963] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:10:03 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:10:03.502721 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c17342-2438-4421-970c-94f46fc6dea6 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:03.512553 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c17342-2438-4421-970c-94f46fc6dea6 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:03.568933 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51aafcd-97c2-43eb-8e42-ceda8db9ca85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:03.569620 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51aafcd-97c2-43eb-8e42-ceda8db9ca85 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:03.569934 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51aafcd-97c2-43eb-8e42-ceda8db9ca85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:03.570241 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51aafcd-97c2-43eb-8e42-ceda8db9ca85 admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:03.570969 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51aafcd-97c2-43eb-8e42-ceda8db9ca85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:03.573046 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51aafcd-97c2-43eb-8e42-ceda8db9ca85 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:03.596012 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 982/1964] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:10:03 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:10:03.597251 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb1737-e5c6-4bea-bd82-ee8fb2dc1de4 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:03.609523 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb1737-e5c6-4bea-bd82-ee8fb2dc1de4 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:03.632018 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575c59c-0b9a-4ad2-8c2e-def019827e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:03.632649 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575c59c-0b9a-4ad2-8c2e-def019827e54 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:03.632933 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575c59c-0b9a-4ad2-8c2e-def019827e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:03.633470 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575c59c-0b9a-4ad2-8c2e-def019827e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:03.634497 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575c59c-0b9a-4ad2-8c2e-def019827e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:03.635938 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575c59c-0b9a-4ad2-8c2e-def019827e54 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:03.649633 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 983/1965] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:10:03.653595 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51aafcd-97c2-43eb-8e42-ceda8db9ca85 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:03.667914 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51aafcd-97c2-43eb-8e42-ceda8db9ca85 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:03.676000 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe906e-11e5-4f76-a323-e7d86e723d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:03.676992 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe906e-11e5-4f76-a323-e7d86e723d94 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:03.677290 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe906e-11e5-4f76-a323-e7d86e723d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:03.677591 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe906e-11e5-4f76-a323-e7d86e723d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:03.678365 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe906e-11e5-4f76-a323-e7d86e723d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:03.680112 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe906e-11e5-4f76-a323-e7d86e723d94 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:03.691310 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 983/1966] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:10:03.695826 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575c59c-0b9a-4ad2-8c2e-def019827e54 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:03.711956 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575c59c-0b9a-4ad2-8c2e-def019827e54 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:03.719478 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c403bfa-0f96-4bb7-8a3f-adc1aaa33082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:03.720496 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c403bfa-0f96-4bb7-8a3f-adc1aaa33082 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:03.720849 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c403bfa-0f96-4bb7-8a3f-adc1aaa33082 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:03.721135 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c403bfa-0f96-4bb7-8a3f-adc1aaa33082 admin admin] PATH_INFO: `/v3/projects/b3dab337c7c54c09a3d452f76a345e73/users/9b4851901f254a5ab66a739141ad42d5/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:03.738578 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c403bfa-0f96-4bb7-8a3f-adc1aaa33082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3dab337c7c54c09a3d452f76a345e73, user_id=9b4851901f254a5ab66a739141ad42d5, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:03.744962 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c403bfa-0f96-4bb7-8a3f-adc1aaa33082 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:03.759653 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 984/1967] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:10:03 2022] PUT /identity/v3/projects/b3dab337c7c54c09a3d452f76a345e73/users/9b4851901f254a5ab66a739141ad42d5/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:10:03.772208 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3b2d7-3e0c-486d-a82d-cd9f1b947696 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:03.772504 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3b2d7-3e0c-486d-a82d-cd9f1b947696 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:03.772808 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3b2d7-3e0c-486d-a82d-cd9f1b947696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:03.807272 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-f6c3b2d7-3e0c-486d-a82d-cd9f1b947696 None None] MFA Rules not processed for user `9b4851901f254a5ab66a739141ad42d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:03.808824 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-f6c3b2d7-3e0c-486d-a82d-cd9f1b947696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:03.902967 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 984/1968] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:03.908688 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c403bfa-0f96-4bb7-8a3f-adc1aaa33082 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:03.975963 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c403bfa-0f96-4bb7-8a3f-adc1aaa33082 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:03.986960 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92e984-24c2-4988-a0bc-6b36791f9cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:03.987648 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92e984-24c2-4988-a0bc-6b36791f9cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:03.988152 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92e984-24c2-4988-a0bc-6b36791f9cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:03.989179 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92e984-24c2-4988-a0bc-6b36791f9cb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:03.989902 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a92e984-24c2-4988-a0bc-6b36791f9cb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:03.992817 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a92e984-24c2-4988-a0bc-6b36791f9cb3 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:04.035375 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 985/1969] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:10:03 2022] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:10:04.036637 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3b2d7-3e0c-486d-a82d-cd9f1b947696 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:04.048175 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3b2d7-3e0c-486d-a82d-cd9f1b947696 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:04.117011 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ea78d-09f8-4a57-95d3-1eef818e7c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:04.118035 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ea78d-09f8-4a57-95d3-1eef818e7c02 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:04.118035 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ea78d-09f8-4a57-95d3-1eef818e7c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:04.118247 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ea78d-09f8-4a57-95d3-1eef818e7c02 admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:04.118943 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ea78d-09f8-4a57-95d3-1eef818e7c02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:04.120911 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ea78d-09f8-4a57-95d3-1eef818e7c02 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:04.147155 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 985/1970] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:10:04 2022] POST /identity/v3/users => generated 297 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:10:04.151176 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92e984-24c2-4988-a0bc-6b36791f9cb3 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:04.161356 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92e984-24c2-4988-a0bc-6b36791f9cb3 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:04.166737 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ad9e0-ad15-4baa-ad47-69ad236c78a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:04.167288 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ad9e0-ad15-4baa-ad47-69ad236c78a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:04.167567 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ad9e0-ad15-4baa-ad47-69ad236c78a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:04.167883 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ad9e0-ad15-4baa-ad47-69ad236c78a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:04.168705 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ad9e0-ad15-4baa-ad47-69ad236c78a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:04.170396 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ad9e0-ad15-4baa-ad47-69ad236c78a9 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:04.182822 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 986/1971] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:10:04.188090 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ea78d-09f8-4a57-95d3-1eef818e7c02 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:04.200349 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ea78d-09f8-4a57-95d3-1eef818e7c02 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:04.205890 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67594cb9-e613-4588-a756-7a2049b5e0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:04.206773 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67594cb9-e613-4588-a756-7a2049b5e0df admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:04.207053 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67594cb9-e613-4588-a756-7a2049b5e0df admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:04.207351 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67594cb9-e613-4588-a756-7a2049b5e0df admin admin] PATH_INFO: `/v3/projects/98df40ff4b50428ba390e87b7eb5a216/users/caea5d7a3c1c451ba0bdd6f7d5d3f4fe/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:04.222435 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67594cb9-e613-4588-a756-7a2049b5e0df admin admin] RBAC: Authorizing `identity:create_grant(project_id=98df40ff4b50428ba390e87b7eb5a216, user_id=caea5d7a3c1c451ba0bdd6f7d5d3f4fe, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:04.225498 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67594cb9-e613-4588-a756-7a2049b5e0df admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:04.238111 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 986/1972] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:10:04 2022] PUT /identity/v3/projects/98df40ff4b50428ba390e87b7eb5a216/users/caea5d7a3c1c451ba0bdd6f7d5d3f4fe/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:04.243870 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ad9e0-ad15-4baa-ad47-69ad236c78a9 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:04.256318 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ad9e0-ad15-4baa-ad47-69ad236c78a9 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:04.313717 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbdc30-ead7-4487-96fb-aab00e95fd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:04.314400 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbdc30-ead7-4487-96fb-aab00e95fd86 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:04.314685 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbdc30-ead7-4487-96fb-aab00e95fd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:04.314965 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbdc30-ead7-4487-96fb-aab00e95fd86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:04.315739 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cbdc30-ead7-4487-96fb-aab00e95fd86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:04.317317 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cbdc30-ead7-4487-96fb-aab00e95fd86 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:04.331705 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 987/1973] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:10:04.333019 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67594cb9-e613-4588-a756-7a2049b5e0df admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:04.344187 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67594cb9-e613-4588-a756-7a2049b5e0df admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:04.349089 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd6322-86ef-4f1d-a839-91a0fd701877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:04.349954 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd6322-86ef-4f1d-a839-91a0fd701877 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:04.350237 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd6322-86ef-4f1d-a839-91a0fd701877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:04.350502 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd6322-86ef-4f1d-a839-91a0fd701877 admin admin] PATH_INFO: `/v3/projects/98df40ff4b50428ba390e87b7eb5a216/users/caea5d7a3c1c451ba0bdd6f7d5d3f4fe/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:04.352739 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd6322-86ef-4f1d-a839-91a0fd701877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98df40ff4b50428ba390e87b7eb5a216, user_id=caea5d7a3c1c451ba0bdd6f7d5d3f4fe, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:04.355467 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd6322-86ef-4f1d-a839-91a0fd701877 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:04.367177 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 987/1974] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:10:04 2022] PUT /identity/v3/projects/98df40ff4b50428ba390e87b7eb5a216/users/caea5d7a3c1c451ba0bdd6f7d5d3f4fe/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:04.378678 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf7e72-9428-490d-aca3-fb2d635f3128 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:04.379220 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf7e72-9428-490d-aca3-fb2d635f3128 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:04.379519 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf7e72-9428-490d-aca3-fb2d635f3128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:04.414026 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-62bf7e72-9428-490d-aca3-fb2d635f3128 None None] MFA Rules not processed for user `caea5d7a3c1c451ba0bdd6f7d5d3f4fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:04.415437 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-62bf7e72-9428-490d-aca3-fb2d635f3128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:04.486141 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 988/1975] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:04.497492 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd6322-86ef-4f1d-a839-91a0fd701877 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:04.499254 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-10cd6322-86ef-4f1d-a839-91a0fd701877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:04.560287 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd6322-86ef-4f1d-a839-91a0fd701877 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:04.564599 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43963c9c-ae49-4d6b-bf93-f6c9e9078f01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:04.565246 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43963c9c-ae49-4d6b-bf93-f6c9e9078f01 service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:04.565560 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43963c9c-ae49-4d6b-bf93-f6c9e9078f01 service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:04.565840 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43963c9c-ae49-4d6b-bf93-f6c9e9078f01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:04.575171 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43963c9c-ae49-4d6b-bf93-f6c9e9078f01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:04.576697 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43963c9c-ae49-4d6b-bf93-f6c9e9078f01 service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:04.586154 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 988/1976] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:10:04 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:10:04.659491 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf7e72-9428-490d-aca3-fb2d635f3128 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:04.670157 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf7e72-9428-490d-aca3-fb2d635f3128 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:04.675114 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16283f-4a4d-4b28-834b-588e01facee3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:04.675337 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16283f-4a4d-4b28-834b-588e01facee3 service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:04.675571 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16283f-4a4d-4b28-834b-588e01facee3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:04.675843 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16283f-4a4d-4b28-834b-588e01facee3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:04.733569 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16283f-4a4d-4b28-834b-588e01facee3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:04.735550 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16283f-4a4d-4b28-834b-588e01facee3 service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:04.744847 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 989/1977] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:10:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:10:05.328417 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43963c9c-ae49-4d6b-bf93-f6c9e9078f01 service cinder] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:05.339947 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43963c9c-ae49-4d6b-bf93-f6c9e9078f01 service cinder] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:05.348079 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5edf5ba-db5f-4463-a342-8ccb5ab05767 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:05.349054 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edf5ba-db5f-4463-a342-8ccb5ab05767 service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:05.349495 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edf5ba-db5f-4463-a342-8ccb5ab05767 service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:05.349967 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5edf5ba-db5f-4463-a342-8ccb5ab05767 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:05.352438 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-c5edf5ba-db5f-4463-a342-8ccb5ab05767 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:05.429697 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5edf5ba-db5f-4463-a342-8ccb5ab05767 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:05.431152 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5edf5ba-db5f-4463-a342-8ccb5ab05767 service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:05.442158 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 989/1978] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:10:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:10:06.579016 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16283f-4a4d-4b28-834b-588e01facee3 service cinder] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:06.588450 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16283f-4a4d-4b28-834b-588e01facee3 service cinder] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:06.594124 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1dc19-74a2-4667-b10b-4490a6f2a510 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:06.594815 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1dc19-74a2-4667-b10b-4490a6f2a510 service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:06.595098 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1dc19-74a2-4667-b10b-4490a6f2a510 service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:06.595370 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1dc19-74a2-4667-b10b-4490a6f2a510 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:06.597694 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-e5c1dc19-74a2-4667-b10b-4490a6f2a510 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:06.670730 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1dc19-74a2-4667-b10b-4490a6f2a510 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:06.672292 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1dc19-74a2-4667-b10b-4490a6f2a510 service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:06.684822 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 990/1979] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:10:06 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:10:07.713382 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5edf5ba-db5f-4463-a342-8ccb5ab05767 service cinder] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:07.715363 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-c5edf5ba-db5f-4463-a342-8ccb5ab05767 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:07.854595 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5edf5ba-db5f-4463-a342-8ccb5ab05767 service cinder] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:07.873351 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818af73-e645-47b4-9733-b84b4228ab92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:07.873351 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818af73-e645-47b4-9733-b84b4228ab92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:07.873351 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818af73-e645-47b4-9733-b84b4228ab92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:07.873351 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818af73-e645-47b4-9733-b84b4228ab92 admin admin] PATH_INFO: `/v3/users/d9b8233f16f04c55ba80b9a79c2e265a` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:07.875097 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c818af73-e645-47b4-9733-b84b4228ab92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9b8233f16f04c55ba80b9a79c2e265a)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:07.879361 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c818af73-e645-47b4-9733-b84b4228ab92 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:07.992094 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c818af73-e645-47b4-9733-b84b4228ab92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9b8233f16f04c55ba80b9a79c2e265a'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:07.992992 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c818af73-e645-47b4-9733-b84b4228ab92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9b8233f16f04c55ba80b9a79c2e265a'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:08.001577 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c818af73-e645-47b4-9733-b84b4228ab92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9b8233f16f04c55ba80b9a79c2e265a'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:08.013779 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c818af73-e645-47b4-9733-b84b4228ab92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9b8233f16f04c55ba80b9a79c2e265a'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:08.014682 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c818af73-e645-47b4-9733-b84b4228ab92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9b8233f16f04c55ba80b9a79c2e265a'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:08.035461 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 990/1980] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:10:07 2022] DELETE /identity/v3/users/d9b8233f16f04c55ba80b9a79c2e265a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:08.040917 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62600d7-d0ba-4ff2-90e6-3a6418e5f3ee None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:08.041432 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62600d7-d0ba-4ff2-90e6-3a6418e5f3ee None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:08.041948 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62600d7-d0ba-4ff2-90e6-3a6418e5f3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:08.063256 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-d62600d7-d0ba-4ff2-90e6-3a6418e5f3ee None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:08.064464 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-d62600d7-d0ba-4ff2-90e6-3a6418e5f3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:08.145927 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 991/1981] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:08.155886 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818af73-e645-47b4-9733-b84b4228ab92 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:08.157339 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-c818af73-e645-47b4-9733-b84b4228ab92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:08.264068 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818af73-e645-47b4-9733-b84b4228ab92 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:08.268226 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b102f-586b-4627-a29c-33611c0c2ac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:08.269435 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b102f-586b-4627-a29c-33611c0c2ac4 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:08.269876 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b102f-586b-4627-a29c-33611c0c2ac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:08.271241 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b102f-586b-4627-a29c-33611c0c2ac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:08.282086 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b102f-586b-4627-a29c-33611c0c2ac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:08.283864 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b102f-586b-4627-a29c-33611c0c2ac4 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:08.295626 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 991/1982] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:10:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:10:08.801475 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62600d7-d0ba-4ff2-90e6-3a6418e5f3ee None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:08.802921 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-d62600d7-d0ba-4ff2-90e6-3a6418e5f3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:08.819401 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62600d7-d0ba-4ff2-90e6-3a6418e5f3ee None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:08.823969 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb437ce1-4ada-4a24-9056-c361ac70d8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:08.824832 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb437ce1-4ada-4a24-9056-c361ac70d8d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:08.825116 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb437ce1-4ada-4a24-9056-c361ac70d8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:08.825388 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb437ce1-4ada-4a24-9056-c361ac70d8d9 admin admin] PATH_INFO: `/v3/projects/3ab6ea4815a2409592f0cd180c455ccf` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:08.827348 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb437ce1-4ada-4a24-9056-c361ac70d8d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ab6ea4815a2409592f0cd180c455ccf)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:08.829860 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb437ce1-4ada-4a24-9056-c361ac70d8d9 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:08.882742 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-cb437ce1-4ada-4a24-9056-c361ac70d8d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ab6ea4815a2409592f0cd180c455ccf', 'request_id': 'req-cb437ce1-4ada-4a24-9056-c361ac70d8d9'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:08.889281 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-cb437ce1-4ada-4a24-9056-c361ac70d8d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ab6ea4815a2409592f0cd180c455ccf', 'request_id': 'req-cb437ce1-4ada-4a24-9056-c361ac70d8d9'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:08.897432 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-cb437ce1-4ada-4a24-9056-c361ac70d8d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ab6ea4815a2409592f0cd180c455ccf', 'request_id': 'req-cb437ce1-4ada-4a24-9056-c361ac70d8d9'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:08.912577 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-cb437ce1-4ada-4a24-9056-c361ac70d8d9 admin admin] The token cache is being invalidate because project 3ab6ea4815a2409592f0cd180c455ccf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:10:08.913201 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-cb437ce1-4ada-4a24-9056-c361ac70d8d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:08.913942 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-cb437ce1-4ada-4a24-9056-c361ac70d8d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:08.915539 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 992/1983] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:10:08 2022] DELETE /identity/v3/projects/3ab6ea4815a2409592f0cd180c455ccf => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:08.919553 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b102f-586b-4627-a29c-33611c0c2ac4 service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:08.929721 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b102f-586b-4627-a29c-33611c0c2ac4 service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:08.987594 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83410768-7747-4df1-9504-c398d95f6942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:08.988489 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83410768-7747-4df1-9504-c398d95f6942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:08.988771 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83410768-7747-4df1-9504-c398d95f6942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:08.989046 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83410768-7747-4df1-9504-c398d95f6942 admin admin] PATH_INFO: `/v3/users/f3746975c09244538c3649868d3b8fdd` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:08.990229 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83410768-7747-4df1-9504-c398d95f6942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3746975c09244538c3649868d3b8fdd)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:08.992220 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83410768-7747-4df1-9504-c398d95f6942 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:09.041100 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-83410768-7747-4df1-9504-c398d95f6942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3746975c09244538c3649868d3b8fdd'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:09.041785 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-83410768-7747-4df1-9504-c398d95f6942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3746975c09244538c3649868d3b8fdd'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:09.048980 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-83410768-7747-4df1-9504-c398d95f6942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3746975c09244538c3649868d3b8fdd'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:09.061142 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-83410768-7747-4df1-9504-c398d95f6942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3746975c09244538c3649868d3b8fdd'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:09.061880 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-83410768-7747-4df1-9504-c398d95f6942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3746975c09244538c3649868d3b8fdd'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:09.081006 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 992/1984] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:10:08 2022] DELETE /identity/v3/users/f3746975c09244538c3649868d3b8fdd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:09.364619 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb437ce1-4ada-4a24-9056-c361ac70d8d9 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:09.366219 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-cb437ce1-4ada-4a24-9056-c361ac70d8d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:09.385478 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb437ce1-4ada-4a24-9056-c361ac70d8d9 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:09.443811 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70fb25e-ea37-4471-8cdf-06b0a8eba4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:09.444675 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fb25e-ea37-4471-8cdf-06b0a8eba4bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:09.445260 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fb25e-ea37-4471-8cdf-06b0a8eba4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:09.445733 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fb25e-ea37-4471-8cdf-06b0a8eba4bb admin admin] PATH_INFO: `/v3/projects/e88241d1c6e140f396284325ce518820` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:09.447128 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70fb25e-ea37-4471-8cdf-06b0a8eba4bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e88241d1c6e140f396284325ce518820)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:09.449135 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70fb25e-ea37-4471-8cdf-06b0a8eba4bb admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:09.495447 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b70fb25e-ea37-4471-8cdf-06b0a8eba4bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e88241d1c6e140f396284325ce518820', 'request_id': 'req-b70fb25e-ea37-4471-8cdf-06b0a8eba4bb'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:09.501361 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b70fb25e-ea37-4471-8cdf-06b0a8eba4bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e88241d1c6e140f396284325ce518820', 'request_id': 'req-b70fb25e-ea37-4471-8cdf-06b0a8eba4bb'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:09.507367 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b70fb25e-ea37-4471-8cdf-06b0a8eba4bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e88241d1c6e140f396284325ce518820', 'request_id': 'req-b70fb25e-ea37-4471-8cdf-06b0a8eba4bb'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:09.520409 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b70fb25e-ea37-4471-8cdf-06b0a8eba4bb admin admin] The token cache is being invalidate because project e88241d1c6e140f396284325ce518820 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:10:09.520705 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b70fb25e-ea37-4471-8cdf-06b0a8eba4bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:09.521326 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b70fb25e-ea37-4471-8cdf-06b0a8eba4bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:09.522824 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 993/1985] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:10:09 2022] DELETE /identity/v3/projects/e88241d1c6e140f396284325ce518820 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:09.529047 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4aa237-1162-435f-b9d3-ccddfc0754e7 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:09.529341 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4aa237-1162-435f-b9d3-ccddfc0754e7 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:09.529623 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4aa237-1162-435f-b9d3-ccddfc0754e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:09.547808 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-0a4aa237-1162-435f-b9d3-ccddfc0754e7 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:09.549259 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-0a4aa237-1162-435f-b9d3-ccddfc0754e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:09.613759 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 993/1986] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:09.624106 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d1e48-c3ba-4975-8742-f67b2261a6da None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:09.624964 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d1e48-c3ba-4975-8742-f67b2261a6da None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:09.625502 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d1e48-c3ba-4975-8742-f67b2261a6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:09.643889 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-444d1e48-c3ba-4975-8742-f67b2261a6da None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:09.645138 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-444d1e48-c3ba-4975-8742-f67b2261a6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:09.653154 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 994/1987] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:09.657277 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4aa237-1162-435f-b9d3-ccddfc0754e7 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:09.666806 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4aa237-1162-435f-b9d3-ccddfc0754e7 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:09.671807 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308aea8-26df-4286-8c2c-ab829bbc1c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:09.673155 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308aea8-26df-4286-8c2c-ab829bbc1c3e admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:09.673527 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308aea8-26df-4286-8c2c-ab829bbc1c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:09.673887 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308aea8-26df-4286-8c2c-ab829bbc1c3e admin admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:09.674719 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308aea8-26df-4286-8c2c-ab829bbc1c3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:10:09.675032 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308aea8-26df-4286-8c2c-ab829bbc1c3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:09.677209 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308aea8-26df-4286-8c2c-ab829bbc1c3e admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:09.689549 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 994/1988] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:10:09.694288 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d1e48-c3ba-4975-8742-f67b2261a6da None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:09.706519 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d1e48-c3ba-4975-8742-f67b2261a6da None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:09.721157 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963316a-6c9a-4083-a34f-97132c5df86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:09.721841 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963316a-6c9a-4083-a34f-97132c5df86e admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:09.722131 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963316a-6c9a-4083-a34f-97132c5df86e admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:09.722579 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963316a-6c9a-4083-a34f-97132c5df86e admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:09.723342 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963316a-6c9a-4083-a34f-97132c5df86e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:09.725318 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963316a-6c9a-4083-a34f-97132c5df86e admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:09.752598 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 995/1989] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:10:09 2022] POST /identity/v3/projects => generated 361 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:10:09.757581 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308aea8-26df-4286-8c2c-ab829bbc1c3e admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:09.769631 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308aea8-26df-4286-8c2c-ab829bbc1c3e admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:09.825773 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644ef1e-4a32-45d5-835e-3f324cca845d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:09.826443 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644ef1e-4a32-45d5-835e-3f324cca845d admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:09.826727 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644ef1e-4a32-45d5-835e-3f324cca845d admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:09.827001 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644ef1e-4a32-45d5-835e-3f324cca845d admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:09.827702 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644ef1e-4a32-45d5-835e-3f324cca845d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:09.829619 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644ef1e-4a32-45d5-835e-3f324cca845d admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:09.852892 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 995/1990] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:10:09 2022] POST /identity/v3/users => generated 281 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:10:09.854365 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963316a-6c9a-4083-a34f-97132c5df86e admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:09.864708 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963316a-6c9a-4083-a34f-97132c5df86e admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:09.869217 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf592a60-a766-4eca-8a4f-1c90ebcbd21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:09.869867 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf592a60-a766-4eca-8a4f-1c90ebcbd21e admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:09.870146 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf592a60-a766-4eca-8a4f-1c90ebcbd21e admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:09.870416 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf592a60-a766-4eca-8a4f-1c90ebcbd21e admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:09.871130 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf592a60-a766-4eca-8a4f-1c90ebcbd21e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:09.872725 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf592a60-a766-4eca-8a4f-1c90ebcbd21e admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:09.883626 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 996/1991] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:10:09.887357 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644ef1e-4a32-45d5-835e-3f324cca845d admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:09.897302 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644ef1e-4a32-45d5-835e-3f324cca845d admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:09.902073 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5f49b-9e69-45c8-8074-68d38606b6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:09.902738 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5f49b-9e69-45c8-8074-68d38606b6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:09.903028 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5f49b-9e69-45c8-8074-68d38606b6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:09.903754 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5f49b-9e69-45c8-8074-68d38606b6a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:09.904199 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef5f49b-9e69-45c8-8074-68d38606b6a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:09.905832 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef5f49b-9e69-45c8-8074-68d38606b6a7 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:09.916253 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 996/1992] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:10:09.921736 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf592a60-a766-4eca-8a4f-1c90ebcbd21e admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:09.931988 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf592a60-a766-4eca-8a4f-1c90ebcbd21e admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:09.937549 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c148c79-1202-4461-801d-fe400f6e0e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:09.938439 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c148c79-1202-4461-801d-fe400f6e0e9a admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:09.938726 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c148c79-1202-4461-801d-fe400f6e0e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:09.939007 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c148c79-1202-4461-801d-fe400f6e0e9a admin admin] PATH_INFO: `/v3/projects/7393d9dc0e144b07b7d33e12dc7ca30d/users/5084602bb05343b888cc1b45e2a7709e/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:09.954544 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c148c79-1202-4461-801d-fe400f6e0e9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7393d9dc0e144b07b7d33e12dc7ca30d, user_id=5084602bb05343b888cc1b45e2a7709e, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:09.958564 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c148c79-1202-4461-801d-fe400f6e0e9a admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:09.975586 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 997/1993] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:10:09 2022] PUT /identity/v3/projects/7393d9dc0e144b07b7d33e12dc7ca30d/users/5084602bb05343b888cc1b45e2a7709e/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:09.989098 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64c909-a773-44dc-b276-28829de6efbc None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:09.989620 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64c909-a773-44dc-b276-28829de6efbc None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:09.989847 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64c909-a773-44dc-b276-28829de6efbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:10.016804 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-6e64c909-a773-44dc-b276-28829de6efbc None None] MFA Rules not processed for user `5084602bb05343b888cc1b45e2a7709e`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:10.018030 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-6e64c909-a773-44dc-b276-28829de6efbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:10.108357 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 997/1994] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:10.141879 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c148c79-1202-4461-801d-fe400f6e0e9a admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:10.143706 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-2c148c79-1202-4461-801d-fe400f6e0e9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:10.202563 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c148c79-1202-4461-801d-fe400f6e0e9a admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:10.206264 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db8faf-b031-4399-b2da-4b021e156af0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:10.206926 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db8faf-b031-4399-b2da-4b021e156af0 service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:10.207390 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db8faf-b031-4399-b2da-4b021e156af0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:10.207669 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db8faf-b031-4399-b2da-4b021e156af0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:10.216636 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db8faf-b031-4399-b2da-4b021e156af0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:10.218625 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db8faf-b031-4399-b2da-4b021e156af0 service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:10.227837 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 998/1995] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:10:10 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:10:10.243355 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64c909-a773-44dc-b276-28829de6efbc None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:10.308773 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64c909-a773-44dc-b276-28829de6efbc None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:10.313576 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d3168-3b24-4d79-81ad-46921b43073a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:10.314506 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d3168-3b24-4d79-81ad-46921b43073a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:10.314854 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d3168-3b24-4d79-81ad-46921b43073a admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:10.315198 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d3168-3b24-4d79-81ad-46921b43073a admin admin] PATH_INFO: `/v3/users/5084602bb05343b888cc1b45e2a7709e` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:10.316413 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d3168-3b24-4d79-81ad-46921b43073a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5084602bb05343b888cc1b45e2a7709e)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:10.318567 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d3168-3b24-4d79-81ad-46921b43073a admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:10.371322 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-d39d3168-3b24-4d79-81ad-46921b43073a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5084602bb05343b888cc1b45e2a7709e'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:10.372144 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-d39d3168-3b24-4d79-81ad-46921b43073a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5084602bb05343b888cc1b45e2a7709e'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:10.378723 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-d39d3168-3b24-4d79-81ad-46921b43073a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5084602bb05343b888cc1b45e2a7709e'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:10.390135 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-d39d3168-3b24-4d79-81ad-46921b43073a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5084602bb05343b888cc1b45e2a7709e'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:10.390798 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-d39d3168-3b24-4d79-81ad-46921b43073a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5084602bb05343b888cc1b45e2a7709e'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:10.403178 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 998/1996] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:10:10 2022] DELETE /identity/v3/users/5084602bb05343b888cc1b45e2a7709e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:10.408275 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797350f7-4257-4274-9b86-bbba2001c8ad None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:10.408720 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797350f7-4257-4274-9b86-bbba2001c8ad None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:10.408861 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797350f7-4257-4274-9b86-bbba2001c8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:10.426028 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-797350f7-4257-4274-9b86-bbba2001c8ad None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:10.427217 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-797350f7-4257-4274-9b86-bbba2001c8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:10.487157 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 999/1997] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:10:10.493763 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d3168-3b24-4d79-81ad-46921b43073a admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:10.495184 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-d39d3168-3b24-4d79-81ad-46921b43073a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:10.550884 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d3168-3b24-4d79-81ad-46921b43073a admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:10.554509 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a28ca9-2c1a-47ea-b045-a59804dd91c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:10.555152 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a28ca9-2c1a-47ea-b045-a59804dd91c5 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:10.555434 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a28ca9-2c1a-47ea-b045-a59804dd91c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:10.555734 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a28ca9-2c1a-47ea-b045-a59804dd91c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:10.565511 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a28ca9-2c1a-47ea-b045-a59804dd91c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:10.567014 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a28ca9-2c1a-47ea-b045-a59804dd91c5 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:10.576935 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 999/1998] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:10:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:10:10.966741 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797350f7-4257-4274-9b86-bbba2001c8ad None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:10.970183 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-797350f7-4257-4274-9b86-bbba2001c8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:10.988437 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797350f7-4257-4274-9b86-bbba2001c8ad None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:10.994173 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4c8e3-3c18-4f5b-91e9-65afc34ff9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:10.995254 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4c8e3-3c18-4f5b-91e9-65afc34ff9a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:10.995972 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4c8e3-3c18-4f5b-91e9-65afc34ff9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:10.996218 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4c8e3-3c18-4f5b-91e9-65afc34ff9a5 admin admin] PATH_INFO: `/v3/projects/7393d9dc0e144b07b7d33e12dc7ca30d` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:10.997891 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc4c8e3-3c18-4f5b-91e9-65afc34ff9a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7393d9dc0e144b07b7d33e12dc7ca30d)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:11.000870 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc4c8e3-3c18-4f5b-91e9-65afc34ff9a5 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:11.063488 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5bc4c8e3-3c18-4f5b-91e9-65afc34ff9a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7393d9dc0e144b07b7d33e12dc7ca30d', 'request_id': 'req-5bc4c8e3-3c18-4f5b-91e9-65afc34ff9a5'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:11.070413 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5bc4c8e3-3c18-4f5b-91e9-65afc34ff9a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7393d9dc0e144b07b7d33e12dc7ca30d', 'request_id': 'req-5bc4c8e3-3c18-4f5b-91e9-65afc34ff9a5'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:11.081237 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5bc4c8e3-3c18-4f5b-91e9-65afc34ff9a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7393d9dc0e144b07b7d33e12dc7ca30d', 'request_id': 'req-5bc4c8e3-3c18-4f5b-91e9-65afc34ff9a5'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:11.095515 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5bc4c8e3-3c18-4f5b-91e9-65afc34ff9a5 admin admin] The token cache is being invalidate because project 7393d9dc0e144b07b7d33e12dc7ca30d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:10:11.096069 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5bc4c8e3-3c18-4f5b-91e9-65afc34ff9a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:11.096875 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5bc4c8e3-3c18-4f5b-91e9-65afc34ff9a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:11.098426 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1000/1999] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:10:10 2022] DELETE /identity/v3/projects/7393d9dc0e144b07b7d33e12dc7ca30d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:11.103344 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968022f2-888f-490a-9a67-db2eb6d960fa None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:11.103871 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968022f2-888f-490a-9a67-db2eb6d960fa None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:11.104197 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968022f2-888f-490a-9a67-db2eb6d960fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:11.123143 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-968022f2-888f-490a-9a67-db2eb6d960fa None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:11.125097 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-968022f2-888f-490a-9a67-db2eb6d960fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:11.195483 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1000/2000] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:11.204549 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242e888-fe64-46f0-b12f-ed7e7be51f32 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:11.205701 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242e888-fe64-46f0-b12f-ed7e7be51f32 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:11.206130 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242e888-fe64-46f0-b12f-ed7e7be51f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:11.228661 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-0242e888-fe64-46f0-b12f-ed7e7be51f32 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:11.230298 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-0242e888-fe64-46f0-b12f-ed7e7be51f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:11.243761 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1001/2001] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:11.246344 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968022f2-888f-490a-9a67-db2eb6d960fa None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:11.257332 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968022f2-888f-490a-9a67-db2eb6d960fa None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:11.263322 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5a20c-9975-4212-be74-b50fb045bab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:11.264141 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5a20c-9975-4212-be74-b50fb045bab3 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:11.264431 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5a20c-9975-4212-be74-b50fb045bab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:11.264737 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5a20c-9975-4212-be74-b50fb045bab3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:11.265541 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c5a20c-9975-4212-be74-b50fb045bab3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:10:11.265866 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c5a20c-9975-4212-be74-b50fb045bab3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:11.268009 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c5a20c-9975-4212-be74-b50fb045bab3 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:11.282832 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1001/2002] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:10:11.287497 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242e888-fe64-46f0-b12f-ed7e7be51f32 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:11.298058 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242e888-fe64-46f0-b12f-ed7e7be51f32 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:11.302937 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580a7e8-2914-41fc-8c7b-528246598b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:11.303609 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580a7e8-2914-41fc-8c7b-528246598b0a admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:11.303928 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580a7e8-2914-41fc-8c7b-528246598b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:11.304221 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580a7e8-2914-41fc-8c7b-528246598b0a admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:11.305586 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5580a7e8-2914-41fc-8c7b-528246598b0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:11.308047 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5580a7e8-2914-41fc-8c7b-528246598b0a admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:11.337743 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1002/2003] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:10:11 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:10:11.342462 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5a20c-9975-4212-be74-b50fb045bab3 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:11.354403 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5a20c-9975-4212-be74-b50fb045bab3 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:11.425633 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19943c70-bf01-48e7-8932-3796405866e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:11.426249 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19943c70-bf01-48e7-8932-3796405866e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:11.426541 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19943c70-bf01-48e7-8932-3796405866e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:11.426754 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19943c70-bf01-48e7-8932-3796405866e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:11.427498 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19943c70-bf01-48e7-8932-3796405866e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:11.429468 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19943c70-bf01-48e7-8932-3796405866e1 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:11.463986 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1002/2004] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:10:11 2022] POST /identity/v3/users => generated 288 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:10:11.467455 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580a7e8-2914-41fc-8c7b-528246598b0a admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:11.478482 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580a7e8-2914-41fc-8c7b-528246598b0a admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:11.484161 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250615a6-c0de-4c6d-9134-8b47bd1e86bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:11.484722 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250615a6-c0de-4c6d-9134-8b47bd1e86bd admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:11.485005 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250615a6-c0de-4c6d-9134-8b47bd1e86bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:11.485311 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250615a6-c0de-4c6d-9134-8b47bd1e86bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:11.486032 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250615a6-c0de-4c6d-9134-8b47bd1e86bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:11.487668 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250615a6-c0de-4c6d-9134-8b47bd1e86bd admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:11.501285 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1003/2005] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:10:11.505278 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19943c70-bf01-48e7-8932-3796405866e1 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:11.515769 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19943c70-bf01-48e7-8932-3796405866e1 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:11.520630 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ebc81-b784-40c4-b975-830826758e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:11.521303 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ebc81-b784-40c4-b975-830826758e0e admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:11.521584 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ebc81-b784-40c4-b975-830826758e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:11.521857 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ebc81-b784-40c4-b975-830826758e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:11.522728 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ebc81-b784-40c4-b975-830826758e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:11.524398 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ebc81-b784-40c4-b975-830826758e0e admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:11.534794 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1003/2006] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:10:11.538723 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250615a6-c0de-4c6d-9134-8b47bd1e86bd admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:11.550528 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250615a6-c0de-4c6d-9134-8b47bd1e86bd admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:11.555464 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841f16d-ddb3-4b40-9368-038699b65729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:11.556377 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841f16d-ddb3-4b40-9368-038699b65729 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:11.556664 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841f16d-ddb3-4b40-9368-038699b65729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:11.556940 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841f16d-ddb3-4b40-9368-038699b65729 admin admin] PATH_INFO: `/v3/projects/c2afd63aac3841fa9fa6d00c05b6bec7/users/23de04d99907426185eeb358c8ec16e7/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:11.576184 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841f16d-ddb3-4b40-9368-038699b65729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2afd63aac3841fa9fa6d00c05b6bec7, user_id=23de04d99907426185eeb358c8ec16e7, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:11.579482 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841f16d-ddb3-4b40-9368-038699b65729 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:11.593352 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1004/2007] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:10:11 2022] PUT /identity/v3/projects/c2afd63aac3841fa9fa6d00c05b6bec7/users/23de04d99907426185eeb358c8ec16e7/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:10:11.603411 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ecd5c-1c40-4335-a898-17abb68918e0 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:11.603755 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ecd5c-1c40-4335-a898-17abb68918e0 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:11.604066 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ecd5c-1c40-4335-a898-17abb68918e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:11.634123 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-259ecd5c-1c40-4335-a898-17abb68918e0 None None] MFA Rules not processed for user `23de04d99907426185eeb358c8ec16e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:11.635334 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-259ecd5c-1c40-4335-a898-17abb68918e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:11.707091 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1004/2008] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:11.711529 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841f16d-ddb3-4b40-9368-038699b65729 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:11.772699 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841f16d-ddb3-4b40-9368-038699b65729 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:11.777903 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e8793-8284-428b-a226-8856c124e040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:11.778616 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e8793-8284-428b-a226-8856c124e040 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:11.778918 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e8793-8284-428b-a226-8856c124e040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:11.779163 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e8793-8284-428b-a226-8856c124e040 admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:11.779890 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e8793-8284-428b-a226-8856c124e040 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:11.782298 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e8793-8284-428b-a226-8856c124e040 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:11.816517 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1005/2009] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:10:11 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:10:11.817752 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ecd5c-1c40-4335-a898-17abb68918e0 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:11.828804 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ecd5c-1c40-4335-a898-17abb68918e0 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:11.887809 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4598361-758a-40e8-9ea7-247d3e43eead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:11.888511 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4598361-758a-40e8-9ea7-247d3e43eead admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:11.888797 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4598361-758a-40e8-9ea7-247d3e43eead admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:11.889106 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4598361-758a-40e8-9ea7-247d3e43eead admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:11.889771 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4598361-758a-40e8-9ea7-247d3e43eead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:11.892205 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4598361-758a-40e8-9ea7-247d3e43eead admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:11.915260 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1005/2010] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:10:11 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:10:11.916724 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e8793-8284-428b-a226-8856c124e040 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:11.927962 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e8793-8284-428b-a226-8856c124e040 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:11.932867 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd0c9b-b2b5-4c0b-8802-173d69ec8cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:11.933562 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd0c9b-b2b5-4c0b-8802-173d69ec8cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:11.933865 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd0c9b-b2b5-4c0b-8802-173d69ec8cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:11.934123 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd0c9b-b2b5-4c0b-8802-173d69ec8cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:11.934852 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd0c9b-b2b5-4c0b-8802-173d69ec8cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:11.936465 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd0c9b-b2b5-4c0b-8802-173d69ec8cc0 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:11.948349 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1006/2011] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:10:11.952657 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4598361-758a-40e8-9ea7-247d3e43eead admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:11.963034 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4598361-758a-40e8-9ea7-247d3e43eead admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:11.969583 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882a2d0-723e-4341-9aa0-4886d179efa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:11.970594 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882a2d0-723e-4341-9aa0-4886d179efa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:11.970881 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882a2d0-723e-4341-9aa0-4886d179efa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:11.971156 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882a2d0-723e-4341-9aa0-4886d179efa5 admin admin] PATH_INFO: `/v3/projects/6e53bccf0184401eaef6bb141fdecf94/users/04967e0937704b09bba650e47804ce5b/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:11.994742 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882a2d0-723e-4341-9aa0-4886d179efa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e53bccf0184401eaef6bb141fdecf94, user_id=04967e0937704b09bba650e47804ce5b, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:11.997843 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882a2d0-723e-4341-9aa0-4886d179efa5 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:12.011650 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1006/2012] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:10:11 2022] PUT /identity/v3/projects/6e53bccf0184401eaef6bb141fdecf94/users/04967e0937704b09bba650e47804ce5b/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:12.016200 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd0c9b-b2b5-4c0b-8802-173d69ec8cc0 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:12.026690 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd0c9b-b2b5-4c0b-8802-173d69ec8cc0 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:12.121139 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6d881-b6d1-441a-b38b-42ff7455f0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:12.121848 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6d881-b6d1-441a-b38b-42ff7455f0ce admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:12.122114 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6d881-b6d1-441a-b38b-42ff7455f0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:12.122392 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6d881-b6d1-441a-b38b-42ff7455f0ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:12.123129 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6d881-b6d1-441a-b38b-42ff7455f0ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:12.124811 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6d881-b6d1-441a-b38b-42ff7455f0ce admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:12.141825 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1007/2013] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:10:12.145637 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882a2d0-723e-4341-9aa0-4886d179efa5 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:12.157020 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882a2d0-723e-4341-9aa0-4886d179efa5 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:12.162026 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38cf29-4f7b-4d42-b4c4-fc37c8607b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:12.163083 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38cf29-4f7b-4d42-b4c4-fc37c8607b84 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:12.163438 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38cf29-4f7b-4d42-b4c4-fc37c8607b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:12.163880 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38cf29-4f7b-4d42-b4c4-fc37c8607b84 admin admin] PATH_INFO: `/v3/projects/6e53bccf0184401eaef6bb141fdecf94/users/04967e0937704b09bba650e47804ce5b/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:12.170332 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd38cf29-4f7b-4d42-b4c4-fc37c8607b84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e53bccf0184401eaef6bb141fdecf94, user_id=04967e0937704b09bba650e47804ce5b, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:12.173219 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd38cf29-4f7b-4d42-b4c4-fc37c8607b84 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:12.186379 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1007/2014] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:10:12 2022] PUT /identity/v3/projects/6e53bccf0184401eaef6bb141fdecf94/users/04967e0937704b09bba650e47804ce5b/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:12.197573 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06d00d-8836-49d0-9541-45022edbcc62 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:12.197862 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06d00d-8836-49d0-9541-45022edbcc62 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:12.198140 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06d00d-8836-49d0-9541-45022edbcc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:12.228905 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-cd06d00d-8836-49d0-9541-45022edbcc62 None None] MFA Rules not processed for user `04967e0937704b09bba650e47804ce5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:12.230100 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-cd06d00d-8836-49d0-9541-45022edbcc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:12.306639 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1008/2015] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:12.317629 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38cf29-4f7b-4d42-b4c4-fc37c8607b84 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:12.319569 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-dd38cf29-4f7b-4d42-b4c4-fc37c8607b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:12.325762 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06d00d-8836-49d0-9541-45022edbcc62 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:12.327750 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-cd06d00d-8836-49d0-9541-45022edbcc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:12.376137 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38cf29-4f7b-4d42-b4c4-fc37c8607b84 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:12.379815 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d06c2c-6abd-468a-905e-b5fdc275e882 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:12.380452 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d06c2c-6abd-468a-905e-b5fdc275e882 service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:12.380741 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d06c2c-6abd-468a-905e-b5fdc275e882 service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:12.381020 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d06c2c-6abd-468a-905e-b5fdc275e882 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:12.390548 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06d00d-8836-49d0-9541-45022edbcc62 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:12.395290 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8d5fe-0073-4638-aad5-6a3a2f6d3830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:12.396186 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8d5fe-0073-4638-aad5-6a3a2f6d3830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:12.396471 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8d5fe-0073-4638-aad5-6a3a2f6d3830 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:12.396745 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8d5fe-0073-4638-aad5-6a3a2f6d3830 admin admin] PATH_INFO: `/v3/users/1cdf38df494644f4b3aac491e0ef3c23` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:12.397945 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8d5fe-0073-4638-aad5-6a3a2f6d3830 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cdf38df494644f4b3aac491e0ef3c23)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:12.399929 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8d5fe-0073-4638-aad5-6a3a2f6d3830 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:12.435897 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d06c2c-6abd-468a-905e-b5fdc275e882 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:12.437881 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d06c2c-6abd-468a-905e-b5fdc275e882 service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:12.447068 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1008/2016] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:10:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:10:12.447384 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-c6b8d5fe-0073-4638-aad5-6a3a2f6d3830 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cdf38df494644f4b3aac491e0ef3c23'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:12.454940 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-c6b8d5fe-0073-4638-aad5-6a3a2f6d3830 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cdf38df494644f4b3aac491e0ef3c23'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:12.462985 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-c6b8d5fe-0073-4638-aad5-6a3a2f6d3830 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cdf38df494644f4b3aac491e0ef3c23'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:12.474971 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-c6b8d5fe-0073-4638-aad5-6a3a2f6d3830 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cdf38df494644f4b3aac491e0ef3c23'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:12.475621 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-c6b8d5fe-0073-4638-aad5-6a3a2f6d3830 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cdf38df494644f4b3aac491e0ef3c23'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:12.481479 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1009/2017] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:10:12 2022] DELETE /identity/v3/users/1cdf38df494644f4b3aac491e0ef3c23 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:10:12.486255 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ddda8-c48b-440b-9b93-e2555f8b12b1 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:12.486610 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ddda8-c48b-440b-9b93-e2555f8b12b1 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:12.486809 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ddda8-c48b-440b-9b93-e2555f8b12b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:12.505077 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-637ddda8-c48b-440b-9b93-e2555f8b12b1 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:12.506347 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-637ddda8-c48b-440b-9b93-e2555f8b12b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:12.570404 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1009/2018] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:12.580696 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8d5fe-0073-4638-aad5-6a3a2f6d3830 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:12.582242 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-c6b8d5fe-0073-4638-aad5-6a3a2f6d3830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:12.641718 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8d5fe-0073-4638-aad5-6a3a2f6d3830 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:12.645860 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb5e0a0-dd8f-415b-80b5-83ee33830441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:12.646552 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5e0a0-dd8f-415b-80b5-83ee33830441 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:12.646833 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5e0a0-dd8f-415b-80b5-83ee33830441 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:12.647287 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb5e0a0-dd8f-415b-80b5-83ee33830441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:12.658074 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb5e0a0-dd8f-415b-80b5-83ee33830441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:12.659416 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb5e0a0-dd8f-415b-80b5-83ee33830441 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:12.669079 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1010/2019] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:10:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:10:12.829051 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ddda8-c48b-440b-9b93-e2555f8b12b1 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:12.830709 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-637ddda8-c48b-440b-9b93-e2555f8b12b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:12.843899 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ddda8-c48b-440b-9b93-e2555f8b12b1 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:12.848462 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e8a2e-a4f2-4e2b-80fd-08a3f304bd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:12.849325 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e8a2e-a4f2-4e2b-80fd-08a3f304bd49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:12.849609 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e8a2e-a4f2-4e2b-80fd-08a3f304bd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:12.849879 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e8a2e-a4f2-4e2b-80fd-08a3f304bd49 admin admin] PATH_INFO: `/v3/users/4a6b2735191b4e78b2e95a15d99dc445` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:12.851209 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e8a2e-a4f2-4e2b-80fd-08a3f304bd49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a6b2735191b4e78b2e95a15d99dc445)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:12.853160 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e8a2e-a4f2-4e2b-80fd-08a3f304bd49 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:12.898500 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-5e8e8a2e-a4f2-4e2b-80fd-08a3f304bd49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a6b2735191b4e78b2e95a15d99dc445'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:12.899206 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-5e8e8a2e-a4f2-4e2b-80fd-08a3f304bd49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a6b2735191b4e78b2e95a15d99dc445'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:12.906317 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-5e8e8a2e-a4f2-4e2b-80fd-08a3f304bd49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a6b2735191b4e78b2e95a15d99dc445'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:12.918206 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-5e8e8a2e-a4f2-4e2b-80fd-08a3f304bd49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a6b2735191b4e78b2e95a15d99dc445'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:12.918987 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-5e8e8a2e-a4f2-4e2b-80fd-08a3f304bd49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a6b2735191b4e78b2e95a15d99dc445'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:12.933009 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1010/2020] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:10:12 2022] DELETE /identity/v3/users/4a6b2735191b4e78b2e95a15d99dc445 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:12.938522 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb08f5-0501-46b5-b6c3-bae226198945 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:12.938863 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb08f5-0501-46b5-b6c3-bae226198945 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:12.939194 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb08f5-0501-46b5-b6c3-bae226198945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:12.954063 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e8a2e-a4f2-4e2b-80fd-08a3f304bd49 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:12.955573 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-5e8e8a2e-a4f2-4e2b-80fd-08a3f304bd49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:12.956407 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-2edb08f5-0501-46b5-b6c3-bae226198945 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:12.957597 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-2edb08f5-0501-46b5-b6c3-bae226198945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:13.015734 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1011/2021] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:10:13.024814 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e8a2e-a4f2-4e2b-80fd-08a3f304bd49 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:13.025386 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb08f5-0501-46b5-b6c3-bae226198945 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:13.026734 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-2edb08f5-0501-46b5-b6c3-bae226198945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:13.029822 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c935c7-2d85-4b47-95cf-e38cb6f19d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:13.030716 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c935c7-2d85-4b47-95cf-e38cb6f19d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:13.031006 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c935c7-2d85-4b47-95cf-e38cb6f19d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:13.031402 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c935c7-2d85-4b47-95cf-e38cb6f19d73 admin admin] PATH_INFO: `/v3/projects/956d77945cd74846bee181d8a89a9944` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:13.032622 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c935c7-2d85-4b47-95cf-e38cb6f19d73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=956d77945cd74846bee181d8a89a9944)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:13.034508 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c935c7-2d85-4b47-95cf-e38cb6f19d73 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:13.082019 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb08f5-0501-46b5-b6c3-bae226198945 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:13.082767 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-a1c935c7-2d85-4b47-95cf-e38cb6f19d73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '956d77945cd74846bee181d8a89a9944', 'request_id': 'req-a1c935c7-2d85-4b47-95cf-e38cb6f19d73'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:13.088272 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-a1c935c7-2d85-4b47-95cf-e38cb6f19d73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '956d77945cd74846bee181d8a89a9944', 'request_id': 'req-a1c935c7-2d85-4b47-95cf-e38cb6f19d73'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:13.094794 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-a1c935c7-2d85-4b47-95cf-e38cb6f19d73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '956d77945cd74846bee181d8a89a9944', 'request_id': 'req-a1c935c7-2d85-4b47-95cf-e38cb6f19d73'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:13.125909 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-a1c935c7-2d85-4b47-95cf-e38cb6f19d73 admin admin] The token cache is being invalidate because project 956d77945cd74846bee181d8a89a9944 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:10:13.126211 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-a1c935c7-2d85-4b47-95cf-e38cb6f19d73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:13.127106 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-a1c935c7-2d85-4b47-95cf-e38cb6f19d73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:13.128983 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1011/2022] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:10:12 2022] DELETE /identity/v3/projects/956d77945cd74846bee181d8a89a9944 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:10:13.135142 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cb789-e9de-4535-9b11-35ce8895837d None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:13.135497 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cb789-e9de-4535-9b11-35ce8895837d None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:13.135830 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cb789-e9de-4535-9b11-35ce8895837d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:13.136740 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa89e8a-f007-45ed-9327-f92db31e0f7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:13.137519 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa89e8a-f007-45ed-9327-f92db31e0f7c service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:13.137836 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa89e8a-f007-45ed-9327-f92db31e0f7c service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:13.138114 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa89e8a-f007-45ed-9327-f92db31e0f7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:13.140045 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-eaa89e8a-f007-45ed-9327-f92db31e0f7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:13.154830 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-a87cb789-e9de-4535-9b11-35ce8895837d None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:13.156906 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-a87cb789-e9de-4535-9b11-35ce8895837d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:13.206991 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa89e8a-f007-45ed-9327-f92db31e0f7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:13.208646 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa89e8a-f007-45ed-9327-f92db31e0f7c service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:13.219820 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1012/2023] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:10:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:10:13.223296 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1012/2024] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:13.233415 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f006a-a146-4e82-ad84-1d1afdcd1414 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:13.234360 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f006a-a146-4e82-ad84-1d1afdcd1414 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:13.234719 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f006a-a146-4e82-ad84-1d1afdcd1414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:13.255728 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-f27f006a-a146-4e82-ad84-1d1afdcd1414 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:13.257041 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-f27f006a-a146-4e82-ad84-1d1afdcd1414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:13.267431 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1013/2025] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:13.271770 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa89e8a-f007-45ed-9327-f92db31e0f7c service neutron] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:13.282799 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa89e8a-f007-45ed-9327-f92db31e0f7c service neutron] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:13.288087 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd18733-79ac-4c6b-920e-7cc3a1dc5353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:13.288925 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd18733-79ac-4c6b-920e-7cc3a1dc5353 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:13.289237 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd18733-79ac-4c6b-920e-7cc3a1dc5353 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:13.289547 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd18733-79ac-4c6b-920e-7cc3a1dc5353 admin admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:13.290569 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd18733-79ac-4c6b-920e-7cc3a1dc5353 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:10:13.290984 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd18733-79ac-4c6b-920e-7cc3a1dc5353 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:13.292958 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd18733-79ac-4c6b-920e-7cc3a1dc5353 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:13.311882 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1013/2026] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 04:10:13.313647 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f006a-a146-4e82-ad84-1d1afdcd1414 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:13.325288 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f006a-a146-4e82-ad84-1d1afdcd1414 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:13.330284 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666512d0-acfc-468c-b1be-3af9e437d8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:13.330955 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666512d0-acfc-468c-b1be-3af9e437d8c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:13.331238 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666512d0-acfc-468c-b1be-3af9e437d8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:13.336081 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666512d0-acfc-468c-b1be-3af9e437d8c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:13.339768 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666512d0-acfc-468c-b1be-3af9e437d8c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:13.341315 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666512d0-acfc-468c-b1be-3af9e437d8c5 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:13.379769 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1014/2027] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:10:13 2022] POST /identity/v3/projects => generated 367 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:10:13.382169 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd18733-79ac-4c6b-920e-7cc3a1dc5353 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:13.408523 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd18733-79ac-4c6b-920e-7cc3a1dc5353 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:13.475647 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023f753-547a-40a8-87d7-48cfa4ad34b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:13.476366 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023f753-547a-40a8-87d7-48cfa4ad34b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:13.476649 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023f753-547a-40a8-87d7-48cfa4ad34b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:13.476928 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023f753-547a-40a8-87d7-48cfa4ad34b7 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:13.477764 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023f753-547a-40a8-87d7-48cfa4ad34b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:13.479844 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023f753-547a-40a8-87d7-48cfa4ad34b7 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:13.504785 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1014/2028] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:10:13 2022] POST /identity/v3/users => generated 284 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:10:13.508917 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666512d0-acfc-468c-b1be-3af9e437d8c5 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:13.520498 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666512d0-acfc-468c-b1be-3af9e437d8c5 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:13.526185 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023f753-547a-40a8-87d7-48cfa4ad34b7 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:13.527875 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-5023f753-547a-40a8-87d7-48cfa4ad34b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:13.528152 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ebb204-4910-43c5-aa81-0c1662593033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:13.528871 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebb204-4910-43c5-aa81-0c1662593033 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:13.529468 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebb204-4910-43c5-aa81-0c1662593033 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:13.529751 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebb204-4910-43c5-aa81-0c1662593033 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:13.531087 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ebb204-4910-43c5-aa81-0c1662593033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:13.534285 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ebb204-4910-43c5-aa81-0c1662593033 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:13.544596 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023f753-547a-40a8-87d7-48cfa4ad34b7 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:13.550152 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68cd2d5-d83a-4f59-967b-aee1d76e0f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:13.551137 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cd2d5-d83a-4f59-967b-aee1d76e0f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:13.551431 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cd2d5-d83a-4f59-967b-aee1d76e0f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:13.551745 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cd2d5-d83a-4f59-967b-aee1d76e0f8a admin admin] PATH_INFO: `/v3/projects/1559010e4014411da826e0b2506ddd52` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:13.553193 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68cd2d5-d83a-4f59-967b-aee1d76e0f8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1559010e4014411da826e0b2506ddd52)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:13.553617 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1015/2029] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:10:13.556253 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68cd2d5-d83a-4f59-967b-aee1d76e0f8a admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:13.558139 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ebb204-4910-43c5-aa81-0c1662593033 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:13.569472 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ebb204-4910-43c5-aa81-0c1662593033 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:13.574814 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86d48e-f70e-4b0b-9305-1da6ac32b174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:13.575482 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86d48e-f70e-4b0b-9305-1da6ac32b174 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:13.575799 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86d48e-f70e-4b0b-9305-1da6ac32b174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:13.576087 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86d48e-f70e-4b0b-9305-1da6ac32b174 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:13.576862 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86d48e-f70e-4b0b-9305-1da6ac32b174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:13.580365 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86d48e-f70e-4b0b-9305-1da6ac32b174 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:13.592431 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1016/2030] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:10:13.596889 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86d48e-f70e-4b0b-9305-1da6ac32b174 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:13.607767 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86d48e-f70e-4b0b-9305-1da6ac32b174 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:13.610395 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-c68cd2d5-d83a-4f59-967b-aee1d76e0f8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1559010e4014411da826e0b2506ddd52', 'request_id': 'req-c68cd2d5-d83a-4f59-967b-aee1d76e0f8a'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:13.616928 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-c68cd2d5-d83a-4f59-967b-aee1d76e0f8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1559010e4014411da826e0b2506ddd52', 'request_id': 'req-c68cd2d5-d83a-4f59-967b-aee1d76e0f8a'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:13.627837 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-c68cd2d5-d83a-4f59-967b-aee1d76e0f8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1559010e4014411da826e0b2506ddd52', 'request_id': 'req-c68cd2d5-d83a-4f59-967b-aee1d76e0f8a'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:13.649003 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-c68cd2d5-d83a-4f59-967b-aee1d76e0f8a admin admin] The token cache is being invalidate because project 1559010e4014411da826e0b2506ddd52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:10:13.649366 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-c68cd2d5-d83a-4f59-967b-aee1d76e0f8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:13.650202 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-c68cd2d5-d83a-4f59-967b-aee1d76e0f8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:13.652073 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1015/2031] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:10:13 2022] DELETE /identity/v3/projects/1559010e4014411da826e0b2506ddd52 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:10:13.656504 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68cd2d5-d83a-4f59-967b-aee1d76e0f8a admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:13.658122 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-c68cd2d5-d83a-4f59-967b-aee1d76e0f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:13.684700 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d939c-c222-49f7-b377-bbf87881d913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:13.685777 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d939c-c222-49f7-b377-bbf87881d913 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:13.686193 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d939c-c222-49f7-b377-bbf87881d913 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:13.686638 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d939c-c222-49f7-b377-bbf87881d913 admin admin] PATH_INFO: `/v3/projects/538aa8b7b9644301b438d131def60cd4/users/45cf2abc0a4147ae89ffdc4489ff3a91/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:13.703869 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d939c-c222-49f7-b377-bbf87881d913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=538aa8b7b9644301b438d131def60cd4, user_id=45cf2abc0a4147ae89ffdc4489ff3a91, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:13.706569 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d939c-c222-49f7-b377-bbf87881d913 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:13.722315 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1017/2032] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:10:13 2022] PUT /identity/v3/projects/538aa8b7b9644301b438d131def60cd4/users/45cf2abc0a4147ae89ffdc4489ff3a91/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:10:13.729741 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68cd2d5-d83a-4f59-967b-aee1d76e0f8a admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:13.733424 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062d791-b7a8-4f7e-b170-488188376a19 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:13.733793 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062d791-b7a8-4f7e-b170-488188376a19 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:13.734109 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062d791-b7a8-4f7e-b170-488188376a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:13.764073 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-7062d791-b7a8-4f7e-b170-488188376a19 None None] MFA Rules not processed for user `45cf2abc0a4147ae89ffdc4489ff3a91`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:13.766288 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-7062d791-b7a8-4f7e-b170-488188376a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:13.800403 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130324d1-d671-41bb-afcb-f9b08145252b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:13.801780 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130324d1-d671-41bb-afcb-f9b08145252b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:13.802318 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130324d1-d671-41bb-afcb-f9b08145252b admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:13.802489 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130324d1-d671-41bb-afcb-f9b08145252b admin admin] PATH_INFO: `/v3/users/1c8cf990f192481b9828e13c6bd59438` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:13.804070 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130324d1-d671-41bb-afcb-f9b08145252b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c8cf990f192481b9828e13c6bd59438)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:13.806215 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130324d1-d671-41bb-afcb-f9b08145252b admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:13.859848 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1018/2033] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:13 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:10:13.869222 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062d791-b7a8-4f7e-b170-488188376a19 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:13.871228 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-7062d791-b7a8-4f7e-b170-488188376a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:13.878553 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-130324d1-d671-41bb-afcb-f9b08145252b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c8cf990f192481b9828e13c6bd59438'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:13.887309 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-130324d1-d671-41bb-afcb-f9b08145252b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c8cf990f192481b9828e13c6bd59438'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:13.898197 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-130324d1-d671-41bb-afcb-f9b08145252b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c8cf990f192481b9828e13c6bd59438'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:13.911665 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-130324d1-d671-41bb-afcb-f9b08145252b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c8cf990f192481b9828e13c6bd59438'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:13.912440 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-130324d1-d671-41bb-afcb-f9b08145252b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c8cf990f192481b9828e13c6bd59438'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:13.918782 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1016/2034] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:10:13 2022] DELETE /identity/v3/users/1c8cf990f192481b9828e13c6bd59438 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:13.960607 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062d791-b7a8-4f7e-b170-488188376a19 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:14.024591 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5ee8f-cade-4000-8a9d-4ba296ca5a2e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7c195f91114855acc58163631544d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:14.025294 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5ee8f-cade-4000-8a9d-4ba296ca5a2e service glance] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:14.025582 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5ee8f-cade-4000-8a9d-4ba296ca5a2e service glance] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:14.025882 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5ee8f-cade-4000-8a9d-4ba296ca5a2e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:14.027822 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-45a5ee8f-cade-4000-8a9d-4ba296ca5a2e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:14.094838 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5ee8f-cade-4000-8a9d-4ba296ca5a2e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:14.094838 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5ee8f-cade-4000-8a9d-4ba296ca5a2e service glance] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:14.105587 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1019/2035] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:10:13 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:10:14.247046 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130324d1-d671-41bb-afcb-f9b08145252b admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:14.248993 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-130324d1-d671-41bb-afcb-f9b08145252b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:14.332655 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130324d1-d671-41bb-afcb-f9b08145252b admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:14.349754 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4fba4-20c9-4191-91e3-c9eb1eaac8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:14.351260 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4fba4-20c9-4191-91e3-c9eb1eaac8d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:14.351608 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4fba4-20c9-4191-91e3-c9eb1eaac8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:14.351944 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4fba4-20c9-4191-91e3-c9eb1eaac8d6 admin admin] PATH_INFO: `/v3/projects/865cb38861634823bb850af8a0b1d0e0` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:14.353192 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b4fba4-20c9-4191-91e3-c9eb1eaac8d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=865cb38861634823bb850af8a0b1d0e0)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:14.355248 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b4fba4-20c9-4191-91e3-c9eb1eaac8d6 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:14.408248 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-27b4fba4-20c9-4191-91e3-c9eb1eaac8d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '865cb38861634823bb850af8a0b1d0e0', 'request_id': 'req-27b4fba4-20c9-4191-91e3-c9eb1eaac8d6'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:14.415168 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-27b4fba4-20c9-4191-91e3-c9eb1eaac8d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '865cb38861634823bb850af8a0b1d0e0', 'request_id': 'req-27b4fba4-20c9-4191-91e3-c9eb1eaac8d6'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:14.423918 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-27b4fba4-20c9-4191-91e3-c9eb1eaac8d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '865cb38861634823bb850af8a0b1d0e0', 'request_id': 'req-27b4fba4-20c9-4191-91e3-c9eb1eaac8d6'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:14.452845 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-27b4fba4-20c9-4191-91e3-c9eb1eaac8d6 admin admin] The token cache is being invalidate because project 865cb38861634823bb850af8a0b1d0e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:10:14.453210 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-27b4fba4-20c9-4191-91e3-c9eb1eaac8d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:14.453944 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-27b4fba4-20c9-4191-91e3-c9eb1eaac8d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:14.456204 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1017/2036] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:10:14 2022] DELETE /identity/v3/projects/865cb38861634823bb850af8a0b1d0e0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:14.460233 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5ee8f-cade-4000-8a9d-4ba296ca5a2e service glance] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:14.471992 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5ee8f-cade-4000-8a9d-4ba296ca5a2e service glance] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:14.536839 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4cd1d-71ee-4714-8578-10f7b826eb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:14.537010 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4cd1d-71ee-4714-8578-10f7b826eb33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:14.537429 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4cd1d-71ee-4714-8578-10f7b826eb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:14.537776 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4cd1d-71ee-4714-8578-10f7b826eb33 admin admin] PATH_INFO: `/v3/users/8d5fe42cc3434232bfc93766df2320fa` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:14.539099 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4cd1d-71ee-4714-8578-10f7b826eb33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d5fe42cc3434232bfc93766df2320fa)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:14.541127 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4cd1d-71ee-4714-8578-10f7b826eb33 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:14.606481 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-43c4cd1d-71ee-4714-8578-10f7b826eb33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d5fe42cc3434232bfc93766df2320fa'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:14.609085 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-43c4cd1d-71ee-4714-8578-10f7b826eb33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d5fe42cc3434232bfc93766df2320fa'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:14.620489 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-43c4cd1d-71ee-4714-8578-10f7b826eb33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d5fe42cc3434232bfc93766df2320fa'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:14.635765 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-43c4cd1d-71ee-4714-8578-10f7b826eb33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d5fe42cc3434232bfc93766df2320fa'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:14.636608 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-43c4cd1d-71ee-4714-8578-10f7b826eb33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d5fe42cc3434232bfc93766df2320fa'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:14.654210 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1020/2037] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:10:14 2022] DELETE /identity/v3/users/8d5fe42cc3434232bfc93766df2320fa => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:10:14.867296 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4fba4-20c9-4191-91e3-c9eb1eaac8d6 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:14.868730 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-27b4fba4-20c9-4191-91e3-c9eb1eaac8d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:14.883339 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4fba4-20c9-4191-91e3-c9eb1eaac8d6 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:14.938128 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4cd1d-71ee-4714-8578-10f7b826eb33 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:14.939592 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-43c4cd1d-71ee-4714-8578-10f7b826eb33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:14.945915 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d9a2b-99b6-48c4-8b12-8f7fe11bfcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:14.946790 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d9a2b-99b6-48c4-8b12-8f7fe11bfcf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:14.947324 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d9a2b-99b6-48c4-8b12-8f7fe11bfcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:14.947840 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d9a2b-99b6-48c4-8b12-8f7fe11bfcf1 admin admin] PATH_INFO: `/v3/users/9b4851901f254a5ab66a739141ad42d5` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:14.949273 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d9a2b-99b6-48c4-8b12-8f7fe11bfcf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b4851901f254a5ab66a739141ad42d5)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:14.951414 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d9a2b-99b6-48c4-8b12-8f7fe11bfcf1 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:15.006315 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5c0d9a2b-99b6-48c4-8b12-8f7fe11bfcf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b4851901f254a5ab66a739141ad42d5'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:15.012879 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5c0d9a2b-99b6-48c4-8b12-8f7fe11bfcf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b4851901f254a5ab66a739141ad42d5'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:15.021972 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5c0d9a2b-99b6-48c4-8b12-8f7fe11bfcf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b4851901f254a5ab66a739141ad42d5'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:15.038121 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4cd1d-71ee-4714-8578-10f7b826eb33 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:15.038419 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5c0d9a2b-99b6-48c4-8b12-8f7fe11bfcf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b4851901f254a5ab66a739141ad42d5'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:15.039565 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5c0d9a2b-99b6-48c4-8b12-8f7fe11bfcf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b4851901f254a5ab66a739141ad42d5'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:15.044455 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6e822-11cc-4249-a7fb-6ff8eb270282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:15.045411 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6e822-11cc-4249-a7fb-6ff8eb270282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:15.045684 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6e822-11cc-4249-a7fb-6ff8eb270282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:15.046017 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6e822-11cc-4249-a7fb-6ff8eb270282 admin admin] PATH_INFO: `/v3/projects/701a22654b85485db205c89d62fc9657` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:15.047456 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6e822-11cc-4249-a7fb-6ff8eb270282 admin admin] RBAC: Authorizing `identity:delete_project(project_id=701a22654b85485db205c89d62fc9657)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:15.049896 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6e822-11cc-4249-a7fb-6ff8eb270282 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:15.050438 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1018/2038] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:10:14 2022] DELETE /identity/v3/users/9b4851901f254a5ab66a739141ad42d5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:15.054070 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d9a2b-99b6-48c4-8b12-8f7fe11bfcf1 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:15.055432 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-5c0d9a2b-99b6-48c4-8b12-8f7fe11bfcf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:15.124279 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b7a6e822-11cc-4249-a7fb-6ff8eb270282 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '701a22654b85485db205c89d62fc9657', 'request_id': 'req-b7a6e822-11cc-4249-a7fb-6ff8eb270282'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:15.129609 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b7a6e822-11cc-4249-a7fb-6ff8eb270282 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '701a22654b85485db205c89d62fc9657', 'request_id': 'req-b7a6e822-11cc-4249-a7fb-6ff8eb270282'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:15.136844 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d9a2b-99b6-48c4-8b12-8f7fe11bfcf1 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:15.137553 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b7a6e822-11cc-4249-a7fb-6ff8eb270282 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '701a22654b85485db205c89d62fc9657', 'request_id': 'req-b7a6e822-11cc-4249-a7fb-6ff8eb270282'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:15.151895 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b7a6e822-11cc-4249-a7fb-6ff8eb270282 admin admin] The token cache is being invalidate because project 701a22654b85485db205c89d62fc9657 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:10:15.152187 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b7a6e822-11cc-4249-a7fb-6ff8eb270282 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:15.152806 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b7a6e822-11cc-4249-a7fb-6ff8eb270282 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:15.154389 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1021/2039] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:10:14 2022] DELETE /identity/v3/projects/701a22654b85485db205c89d62fc9657 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:10:15.159452 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341398f-bbb0-446f-bf4b-5ca7ece82ff1 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:15.159770 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341398f-bbb0-446f-bf4b-5ca7ece82ff1 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:15.160054 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341398f-bbb0-446f-bf4b-5ca7ece82ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:15.181302 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-c341398f-bbb0-446f-bf4b-5ca7ece82ff1 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:15.182505 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-c341398f-bbb0-446f-bf4b-5ca7ece82ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:15.198154 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf8358-6e89-4d63-ac13-639ab06cf61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:15.199038 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf8358-6e89-4d63-ac13-639ab06cf61b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:15.199318 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf8358-6e89-4d63-ac13-639ab06cf61b admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:15.199594 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf8358-6e89-4d63-ac13-639ab06cf61b admin admin] PATH_INFO: `/v3/users/23de04d99907426185eeb358c8ec16e7` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:15.201068 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf8358-6e89-4d63-ac13-639ab06cf61b admin admin] RBAC: Authorizing `identity:delete_user(user_id=23de04d99907426185eeb358c8ec16e7)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:15.203476 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf8358-6e89-4d63-ac13-639ab06cf61b admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:15.255663 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-dbcf8358-6e89-4d63-ac13-639ab06cf61b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23de04d99907426185eeb358c8ec16e7'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:15.257834 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1022/2040] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:15.261049 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd87813-8302-4e4c-ba56-095b634c1e82 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:15.261340 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd87813-8302-4e4c-ba56-095b634c1e82 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:15.261616 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd87813-8302-4e4c-ba56-095b634c1e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:15.262701 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-dbcf8358-6e89-4d63-ac13-639ab06cf61b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23de04d99907426185eeb358c8ec16e7'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:15.270702 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-dbcf8358-6e89-4d63-ac13-639ab06cf61b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23de04d99907426185eeb358c8ec16e7'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:15.285841 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-cfd87813-8302-4e4c-ba56-095b634c1e82 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:15.285841 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-cfd87813-8302-4e4c-ba56-095b634c1e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:15.286212 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-dbcf8358-6e89-4d63-ac13-639ab06cf61b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23de04d99907426185eeb358c8ec16e7'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:15.286992 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-dbcf8358-6e89-4d63-ac13-639ab06cf61b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23de04d99907426185eeb358c8ec16e7'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:15.294202 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1019/2041] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:10:15 2022] DELETE /identity/v3/users/23de04d99907426185eeb358c8ec16e7 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:15.294966 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1023/2042] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:15.295135 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf8358-6e89-4d63-ac13-639ab06cf61b admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:15.296597 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-dbcf8358-6e89-4d63-ac13-639ab06cf61b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:15.299295 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5dac52-72fb-4a3e-90e1-3ada8fb2f7db None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:15.299990 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5dac52-72fb-4a3e-90e1-3ada8fb2f7db None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:15.300281 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5dac52-72fb-4a3e-90e1-3ada8fb2f7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:15.317499 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-ef5dac52-72fb-4a3e-90e1-3ada8fb2f7db None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:15.318953 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-ef5dac52-72fb-4a3e-90e1-3ada8fb2f7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:15.357411 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf8358-6e89-4d63-ac13-639ab06cf61b admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:15.363185 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca168e1-d136-4642-9bc9-31ac4c7190bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:15.363185 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca168e1-d136-4642-9bc9-31ac4c7190bd service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:15.363185 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca168e1-d136-4642-9bc9-31ac4c7190bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:15.363185 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca168e1-d136-4642-9bc9-31ac4c7190bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:15.364969 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-fca168e1-d136-4642-9bc9-31ac4c7190bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:15.379005 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1024/2043] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:15.380333 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67a8eb-d1d5-485e-a67e-e7fb98964208 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:15.380621 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67a8eb-d1d5-485e-a67e-e7fb98964208 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:15.380957 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67a8eb-d1d5-485e-a67e-e7fb98964208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:15.402009 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-eb67a8eb-d1d5-485e-a67e-e7fb98964208 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:15.403236 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-eb67a8eb-d1d5-485e-a67e-e7fb98964208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:15.411571 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1025/2044] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:15.412204 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67a8eb-d1d5-485e-a67e-e7fb98964208 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:15.421359 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67a8eb-d1d5-485e-a67e-e7fb98964208 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:15.427250 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae545e-a963-459c-a653-7c32182a4a98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:15.427250 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae545e-a963-459c-a653-7c32182a4a98 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:15.427250 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae545e-a963-459c-a653-7c32182a4a98 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:15.427250 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae545e-a963-459c-a653-7c32182a4a98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:15.441986 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae545e-a963-459c-a653-7c32182a4a98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:15.442527 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca168e1-d136-4642-9bc9-31ac4c7190bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:15.444165 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae545e-a963-459c-a653-7c32182a4a98 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:15.444657 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca168e1-d136-4642-9bc9-31ac4c7190bd service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:15.455608 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1020/2045] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:10:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:10:15.455979 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1026/2046] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:10:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:10:15.456916 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae545e-a963-459c-a653-7c32182a4a98 service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:15.466008 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae545e-a963-459c-a653-7c32182a4a98 service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:15.470785 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc997df-7cdc-4577-a2bb-c44592fd300c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:15.471427 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc997df-7cdc-4577-a2bb-c44592fd300c admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:15.471731 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc997df-7cdc-4577-a2bb-c44592fd300c admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:15.472014 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc997df-7cdc-4577-a2bb-c44592fd300c admin admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:15.472730 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc997df-7cdc-4577-a2bb-c44592fd300c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:10:15.473039 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc997df-7cdc-4577-a2bb-c44592fd300c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:15.474611 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc997df-7cdc-4577-a2bb-c44592fd300c admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:15.485927 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1027/2047] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:10:15.490283 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca168e1-d136-4642-9bc9-31ac4c7190bd service neutron] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:15.500733 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca168e1-d136-4642-9bc9-31ac4c7190bd service neutron] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:15.505947 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20f051-8044-464d-9a1d-2cd2d422282f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:15.506595 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20f051-8044-464d-9a1d-2cd2d422282f admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:15.507010 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20f051-8044-464d-9a1d-2cd2d422282f admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:15.507289 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20f051-8044-464d-9a1d-2cd2d422282f admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:15.508158 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20f051-8044-464d-9a1d-2cd2d422282f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:15.510164 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20f051-8044-464d-9a1d-2cd2d422282f admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:15.560624 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1021/2048] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:10:15 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:10:15.565750 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc997df-7cdc-4577-a2bb-c44592fd300c admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:15.578011 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc997df-7cdc-4577-a2bb-c44592fd300c admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:15.636524 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d5022-ff2c-49bd-8258-ee4dfa0b3b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:15.637198 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d5022-ff2c-49bd-8258-ee4dfa0b3b8a admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:15.637481 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d5022-ff2c-49bd-8258-ee4dfa0b3b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:15.637764 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d5022-ff2c-49bd-8258-ee4dfa0b3b8a admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:15.638452 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d5022-ff2c-49bd-8258-ee4dfa0b3b8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:15.641226 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d5022-ff2c-49bd-8258-ee4dfa0b3b8a admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:15.665261 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1028/2049] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:10:15 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:10:15.669231 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20f051-8044-464d-9a1d-2cd2d422282f admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:15.679461 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20f051-8044-464d-9a1d-2cd2d422282f admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:15.688659 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e571ab4-6a70-4a5b-8e06-5746e1290467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:15.689604 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e571ab4-6a70-4a5b-8e06-5746e1290467 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:15.689604 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e571ab4-6a70-4a5b-8e06-5746e1290467 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:15.689916 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e571ab4-6a70-4a5b-8e06-5746e1290467 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:15.690688 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e571ab4-6a70-4a5b-8e06-5746e1290467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:15.692359 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e571ab4-6a70-4a5b-8e06-5746e1290467 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:15.704856 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1022/2050] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:10:15.708972 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d5022-ff2c-49bd-8258-ee4dfa0b3b8a admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:15.727872 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d5022-ff2c-49bd-8258-ee4dfa0b3b8a admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:15.756007 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e924ae-b0d4-4aad-b45f-7fcddb4b6e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:15.756813 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e924ae-b0d4-4aad-b45f-7fcddb4b6e40 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:15.757176 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e924ae-b0d4-4aad-b45f-7fcddb4b6e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:15.758080 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e924ae-b0d4-4aad-b45f-7fcddb4b6e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:15.762000 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e924ae-b0d4-4aad-b45f-7fcddb4b6e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:15.764231 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e924ae-b0d4-4aad-b45f-7fcddb4b6e40 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:15.798820 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1029/2051] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:10:15.800446 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e571ab4-6a70-4a5b-8e06-5746e1290467 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:15.819014 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e571ab4-6a70-4a5b-8e06-5746e1290467 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:15.832325 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9da60b-d6c9-4c52-b875-c55a705146eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:15.833493 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9da60b-d6c9-4c52-b875-c55a705146eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:15.834085 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9da60b-d6c9-4c52-b875-c55a705146eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:15.834531 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9da60b-d6c9-4c52-b875-c55a705146eb admin admin] PATH_INFO: `/v3/projects/cf0d035d2bc54ff5b6bcafa0d3833387/users/293ab89ef6454bedb8788ae6df8cefb1/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:15.851732 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9da60b-d6c9-4c52-b875-c55a705146eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf0d035d2bc54ff5b6bcafa0d3833387, user_id=293ab89ef6454bedb8788ae6df8cefb1, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:15.854565 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9da60b-d6c9-4c52-b875-c55a705146eb admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:15.872519 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1023/2052] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:10:15 2022] PUT /identity/v3/projects/cf0d035d2bc54ff5b6bcafa0d3833387/users/293ab89ef6454bedb8788ae6df8cefb1/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:10:15.885421 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80949f8a-b3d7-4770-94be-01daaa102a0a None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:15.886658 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80949f8a-b3d7-4770-94be-01daaa102a0a None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:15.887227 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80949f8a-b3d7-4770-94be-01daaa102a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:15.920489 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-80949f8a-b3d7-4770-94be-01daaa102a0a None None] MFA Rules not processed for user `293ab89ef6454bedb8788ae6df8cefb1`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:15.922489 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-80949f8a-b3d7-4770-94be-01daaa102a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:15.937204 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9da60b-d6c9-4c52-b875-c55a705146eb admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:15.939826 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-8b9da60b-d6c9-4c52-b875-c55a705146eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:16.030463 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1030/2053] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:16.041195 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9da60b-d6c9-4c52-b875-c55a705146eb admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:16.042565 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80949f8a-b3d7-4770-94be-01daaa102a0a None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:16.043968 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-80949f8a-b3d7-4770-94be-01daaa102a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:16.051252 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4b02b-e055-42c5-a55b-d9737a74fce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:16.052190 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4b02b-e055-42c5-a55b-d9737a74fce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:16.052540 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4b02b-e055-42c5-a55b-d9737a74fce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:16.052886 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4b02b-e055-42c5-a55b-d9737a74fce1 admin admin] PATH_INFO: `/v3/projects/b3dab337c7c54c09a3d452f76a345e73` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:16.054171 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4b02b-e055-42c5-a55b-d9737a74fce1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3dab337c7c54c09a3d452f76a345e73)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:16.056310 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4b02b-e055-42c5-a55b-d9737a74fce1 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:16.105882 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-89d4b02b-e055-42c5-a55b-d9737a74fce1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3dab337c7c54c09a3d452f76a345e73', 'request_id': 'req-89d4b02b-e055-42c5-a55b-d9737a74fce1'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:16.111673 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80949f8a-b3d7-4770-94be-01daaa102a0a None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:16.121163 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-89d4b02b-e055-42c5-a55b-d9737a74fce1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3dab337c7c54c09a3d452f76a345e73', 'request_id': 'req-89d4b02b-e055-42c5-a55b-d9737a74fce1'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:16.128951 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-89d4b02b-e055-42c5-a55b-d9737a74fce1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3dab337c7c54c09a3d452f76a345e73', 'request_id': 'req-89d4b02b-e055-42c5-a55b-d9737a74fce1'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:16.144381 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-89d4b02b-e055-42c5-a55b-d9737a74fce1 admin admin] The token cache is being invalidate because project b3dab337c7c54c09a3d452f76a345e73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:10:16.144727 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-89d4b02b-e055-42c5-a55b-d9737a74fce1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:16.145498 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-89d4b02b-e055-42c5-a55b-d9737a74fce1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:16.147603 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1024/2054] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:10:15 2022] DELETE /identity/v3/projects/b3dab337c7c54c09a3d452f76a345e73 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:16.151501 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4b02b-e055-42c5-a55b-d9737a74fce1 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:16.153145 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-89d4b02b-e055-42c5-a55b-d9737a74fce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:16.178310 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9577d5-46bd-41c3-9597-04e14acdee28 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7c195f91114855acc58163631544d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:16.178972 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9577d5-46bd-41c3-9597-04e14acdee28 service glance] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:16.179253 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9577d5-46bd-41c3-9597-04e14acdee28 service glance] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:16.179530 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9577d5-46bd-41c3-9597-04e14acdee28 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:16.181602 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-5f9577d5-46bd-41c3-9597-04e14acdee28 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:16.234682 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4b02b-e055-42c5-a55b-d9737a74fce1 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:16.257280 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f953e03-dd2e-4dcb-90f4-86db33e3ee15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:16.258360 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f953e03-dd2e-4dcb-90f4-86db33e3ee15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:16.258743 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f953e03-dd2e-4dcb-90f4-86db33e3ee15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:16.259122 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f953e03-dd2e-4dcb-90f4-86db33e3ee15 admin admin] PATH_INFO: `/v3/users/caea5d7a3c1c451ba0bdd6f7d5d3f4fe` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:16.260531 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f953e03-dd2e-4dcb-90f4-86db33e3ee15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caea5d7a3c1c451ba0bdd6f7d5d3f4fe)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:16.264237 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f953e03-dd2e-4dcb-90f4-86db33e3ee15 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:16.265450 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9577d5-46bd-41c3-9597-04e14acdee28 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:16.266909 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9577d5-46bd-41c3-9597-04e14acdee28 service glance] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:16.293306 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1031/2055] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:10:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:10:16.307563 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9577d5-46bd-41c3-9597-04e14acdee28 service glance] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:16.310584 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-5f9577d5-46bd-41c3-9597-04e14acdee28 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:16.338191 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9577d5-46bd-41c3-9597-04e14acdee28 service glance] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:16.347026 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae57ed-9245-4a7b-9120-442b8eba2bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:16.348957 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae57ed-9245-4a7b-9120-442b8eba2bb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:16.362789 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae57ed-9245-4a7b-9120-442b8eba2bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:16.363133 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae57ed-9245-4a7b-9120-442b8eba2bb5 admin admin] PATH_INFO: `/v3/projects/c2afd63aac3841fa9fa6d00c05b6bec7` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:16.364606 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae57ed-9245-4a7b-9120-442b8eba2bb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2afd63aac3841fa9fa6d00c05b6bec7)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:16.367126 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae57ed-9245-4a7b-9120-442b8eba2bb5 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:16.367959 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-2f953e03-dd2e-4dcb-90f4-86db33e3ee15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caea5d7a3c1c451ba0bdd6f7d5d3f4fe'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:16.378191 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-2f953e03-dd2e-4dcb-90f4-86db33e3ee15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caea5d7a3c1c451ba0bdd6f7d5d3f4fe'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:16.393966 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-2f953e03-dd2e-4dcb-90f4-86db33e3ee15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caea5d7a3c1c451ba0bdd6f7d5d3f4fe'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:16.412836 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-2f953e03-dd2e-4dcb-90f4-86db33e3ee15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caea5d7a3c1c451ba0bdd6f7d5d3f4fe'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:16.413583 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-2f953e03-dd2e-4dcb-90f4-86db33e3ee15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caea5d7a3c1c451ba0bdd6f7d5d3f4fe'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:16.421790 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1025/2056] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:10:16 2022] DELETE /identity/v3/users/caea5d7a3c1c451ba0bdd6f7d5d3f4fe => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:16.430812 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-bfae57ed-9245-4a7b-9120-442b8eba2bb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2afd63aac3841fa9fa6d00c05b6bec7', 'request_id': 'req-bfae57ed-9245-4a7b-9120-442b8eba2bb5'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:16.437597 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-bfae57ed-9245-4a7b-9120-442b8eba2bb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2afd63aac3841fa9fa6d00c05b6bec7', 'request_id': 'req-bfae57ed-9245-4a7b-9120-442b8eba2bb5'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:16.446625 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-bfae57ed-9245-4a7b-9120-442b8eba2bb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2afd63aac3841fa9fa6d00c05b6bec7', 'request_id': 'req-bfae57ed-9245-4a7b-9120-442b8eba2bb5'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:16.467542 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-bfae57ed-9245-4a7b-9120-442b8eba2bb5 admin admin] The token cache is being invalidate because project c2afd63aac3841fa9fa6d00c05b6bec7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:10:16.468742 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-bfae57ed-9245-4a7b-9120-442b8eba2bb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:16.469360 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-bfae57ed-9245-4a7b-9120-442b8eba2bb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:16.470956 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1032/2057] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:10:16 2022] DELETE /identity/v3/projects/c2afd63aac3841fa9fa6d00c05b6bec7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:16.479319 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f953e03-dd2e-4dcb-90f4-86db33e3ee15 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:16.480842 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-2f953e03-dd2e-4dcb-90f4-86db33e3ee15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:16.572274 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f953e03-dd2e-4dcb-90f4-86db33e3ee15 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:16.595848 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff1666-181b-4a7f-b511-690f2faefaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:16.596994 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff1666-181b-4a7f-b511-690f2faefaa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:16.597375 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff1666-181b-4a7f-b511-690f2faefaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:16.597770 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff1666-181b-4a7f-b511-690f2faefaa6 admin admin] PATH_INFO: `/v3/users/04967e0937704b09bba650e47804ce5b` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:16.600073 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff1666-181b-4a7f-b511-690f2faefaa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04967e0937704b09bba650e47804ce5b)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:16.602084 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff1666-181b-4a7f-b511-690f2faefaa6 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:16.689522 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-a5ff1666-181b-4a7f-b511-690f2faefaa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04967e0937704b09bba650e47804ce5b'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:16.697810 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-a5ff1666-181b-4a7f-b511-690f2faefaa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04967e0937704b09bba650e47804ce5b'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:16.708883 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-a5ff1666-181b-4a7f-b511-690f2faefaa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04967e0937704b09bba650e47804ce5b'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:16.724248 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-a5ff1666-181b-4a7f-b511-690f2faefaa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04967e0937704b09bba650e47804ce5b'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:16.725224 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-a5ff1666-181b-4a7f-b511-690f2faefaa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04967e0937704b09bba650e47804ce5b'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:16.731797 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1026/2058] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:10:16 2022] DELETE /identity/v3/users/04967e0937704b09bba650e47804ce5b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:16.750204 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae57ed-9245-4a7b-9120-442b8eba2bb5 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:16.751509 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-bfae57ed-9245-4a7b-9120-442b8eba2bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:16.868415 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae57ed-9245-4a7b-9120-442b8eba2bb5 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:16.947730 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e804f-c675-411a-858a-35f1cb6ce8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:16.948779 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e804f-c675-411a-858a-35f1cb6ce8f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:16.949350 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e804f-c675-411a-858a-35f1cb6ce8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:16.949693 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e804f-c675-411a-858a-35f1cb6ce8f5 admin admin] PATH_INFO: `/v3/projects/98df40ff4b50428ba390e87b7eb5a216` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:16.951128 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e804f-c675-411a-858a-35f1cb6ce8f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98df40ff4b50428ba390e87b7eb5a216)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:16.953902 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e804f-c675-411a-858a-35f1cb6ce8f5 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:17.005748 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b19e804f-c675-411a-858a-35f1cb6ce8f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98df40ff4b50428ba390e87b7eb5a216', 'request_id': 'req-b19e804f-c675-411a-858a-35f1cb6ce8f5'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:17.012175 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b19e804f-c675-411a-858a-35f1cb6ce8f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98df40ff4b50428ba390e87b7eb5a216', 'request_id': 'req-b19e804f-c675-411a-858a-35f1cb6ce8f5'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:17.019388 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b19e804f-c675-411a-858a-35f1cb6ce8f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98df40ff4b50428ba390e87b7eb5a216', 'request_id': 'req-b19e804f-c675-411a-858a-35f1cb6ce8f5'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:17.035319 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b19e804f-c675-411a-858a-35f1cb6ce8f5 admin admin] The token cache is being invalidate because project 98df40ff4b50428ba390e87b7eb5a216 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:10:17.035319 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b19e804f-c675-411a-858a-35f1cb6ce8f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:17.036190 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b19e804f-c675-411a-858a-35f1cb6ce8f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:17.038431 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1033/2059] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:10:16 2022] DELETE /identity/v3/projects/98df40ff4b50428ba390e87b7eb5a216 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:17.043330 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee361d-e83f-4b06-a279-0d65bb5caa89 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:17.044282 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee361d-e83f-4b06-a279-0d65bb5caa89 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:17.045442 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee361d-e83f-4b06-a279-0d65bb5caa89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:17.085655 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-66ee361d-e83f-4b06-a279-0d65bb5caa89 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:17.087603 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-66ee361d-e83f-4b06-a279-0d65bb5caa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:17.103165 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e804f-c675-411a-858a-35f1cb6ce8f5 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:17.105285 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-b19e804f-c675-411a-858a-35f1cb6ce8f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:17.191714 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1027/2060] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:17.199436 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c744af-dc1e-44f3-a6d0-c708bf497ade None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:17.199863 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c744af-dc1e-44f3-a6d0-c708bf497ade None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:17.200152 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c744af-dc1e-44f3-a6d0-c708bf497ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:17.201518 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e804f-c675-411a-858a-35f1cb6ce8f5 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:17.206835 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed5000-d9d8-450d-8246-a08331c02c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:17.207727 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed5000-d9d8-450d-8246-a08331c02c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:17.208017 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed5000-d9d8-450d-8246-a08331c02c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:17.208309 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed5000-d9d8-450d-8246-a08331c02c6d admin admin] PATH_INFO: `/v3/projects/6e53bccf0184401eaef6bb141fdecf94` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:17.209481 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed5000-d9d8-450d-8246-a08331c02c6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e53bccf0184401eaef6bb141fdecf94)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:17.211374 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed5000-d9d8-450d-8246-a08331c02c6d admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:17.220055 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-51c744af-dc1e-44f3-a6d0-c708bf497ade None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:17.221285 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-51c744af-dc1e-44f3-a6d0-c708bf497ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:17.231337 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1028/2061] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:17.235631 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c744af-dc1e-44f3-a6d0-c708bf497ade None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:17.245201 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c744af-dc1e-44f3-a6d0-c708bf497ade None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:17.252811 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457626c-f014-4c1d-a57c-180b7909a4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:17.253705 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457626c-f014-4c1d-a57c-180b7909a4de admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:17.254156 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457626c-f014-4c1d-a57c-180b7909a4de admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:17.254594 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457626c-f014-4c1d-a57c-180b7909a4de admin admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:17.255470 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457626c-f014-4c1d-a57c-180b7909a4de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:10:17.255958 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457626c-f014-4c1d-a57c-180b7909a4de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:17.257897 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457626c-f014-4c1d-a57c-180b7909a4de admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:17.276269 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1029/2062] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 04:10:17.281305 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457626c-f014-4c1d-a57c-180b7909a4de admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:17.282483 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-94ed5000-d9d8-450d-8246-a08331c02c6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e53bccf0184401eaef6bb141fdecf94', 'request_id': 'req-94ed5000-d9d8-450d-8246-a08331c02c6d'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:17.293186 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457626c-f014-4c1d-a57c-180b7909a4de admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:17.298078 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-94ed5000-d9d8-450d-8246-a08331c02c6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e53bccf0184401eaef6bb141fdecf94', 'request_id': 'req-94ed5000-d9d8-450d-8246-a08331c02c6d'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:17.319821 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-94ed5000-d9d8-450d-8246-a08331c02c6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e53bccf0184401eaef6bb141fdecf94', 'request_id': 'req-94ed5000-d9d8-450d-8246-a08331c02c6d'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:17.348260 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-94ed5000-d9d8-450d-8246-a08331c02c6d admin admin] The token cache is being invalidate because project 6e53bccf0184401eaef6bb141fdecf94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:10:17.349183 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-94ed5000-d9d8-450d-8246-a08331c02c6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:17.350419 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-94ed5000-d9d8-450d-8246-a08331c02c6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:17.356897 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1034/2063] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:10:17 2022] DELETE /identity/v3/projects/6e53bccf0184401eaef6bb141fdecf94 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:10:17.358839 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf8024-b6c0-441a-b986-6366f3c8c94f None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:17.359147 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf8024-b6c0-441a-b986-6366f3c8c94f None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:17.359428 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf8024-b6c0-441a-b986-6366f3c8c94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:17.362454 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d3cc3-c7ca-4157-b866-6102c3dc21c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:17.363155 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d3cc3-c7ca-4157-b866-6102c3dc21c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:17.363752 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d3cc3-c7ca-4157-b866-6102c3dc21c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:17.363891 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d3cc3-c7ca-4157-b866-6102c3dc21c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:17.364730 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d3cc3-c7ca-4157-b866-6102c3dc21c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:17.366817 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d3cc3-c7ca-4157-b866-6102c3dc21c9 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:17.388986 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-dfbf8024-b6c0-441a-b986-6366f3c8c94f None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:17.390255 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-dfbf8024-b6c0-441a-b986-6366f3c8c94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:17.399804 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1030/2064] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:10:17 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:10:17.404554 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d3cc3-c7ca-4157-b866-6102c3dc21c9 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:17.406661 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-9a0d3cc3-c7ca-4157-b866-6102c3dc21c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:17.409751 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1035/2065] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:17.418103 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49155ad9-f73f-43ce-9959-3b2ea2fd974a None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:17.418454 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49155ad9-f73f-43ce-9959-3b2ea2fd974a None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:17.418770 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49155ad9-f73f-43ce-9959-3b2ea2fd974a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:17.448637 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-49155ad9-f73f-43ce-9959-3b2ea2fd974a None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:17.450220 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-49155ad9-f73f-43ce-9959-3b2ea2fd974a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:17.512548 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d3cc3-c7ca-4157-b866-6102c3dc21c9 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:17.518084 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87366f-2d72-470d-9864-08ac50176d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:17.518758 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87366f-2d72-470d-9864-08ac50176d58 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:17.519046 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87366f-2d72-470d-9864-08ac50176d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:17.519327 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87366f-2d72-470d-9864-08ac50176d58 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:17.520253 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da87366f-2d72-470d-9864-08ac50176d58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:17.521991 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da87366f-2d72-470d-9864-08ac50176d58 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:17.532497 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1036/2066] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:10:17.536011 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49155ad9-f73f-43ce-9959-3b2ea2fd974a None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:17.546585 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49155ad9-f73f-43ce-9959-3b2ea2fd974a None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:17.548822 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1031/2067] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:10:17 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:10:17.552635 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87366f-2d72-470d-9864-08ac50176d58 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:17.554716 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f8129-f38e-4590-8d2a-98cb27beca17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:17.555376 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f8129-f38e-4590-8d2a-98cb27beca17 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:17.555660 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f8129-f38e-4590-8d2a-98cb27beca17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:17.555961 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f8129-f38e-4590-8d2a-98cb27beca17 admin admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:17.556683 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f8129-f38e-4590-8d2a-98cb27beca17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:10:17.557422 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f8129-f38e-4590-8d2a-98cb27beca17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:17.558985 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f8129-f38e-4590-8d2a-98cb27beca17 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:17.563149 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87366f-2d72-470d-9864-08ac50176d58 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:17.568389 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6676cf9-d417-4843-9d15-9b1977415611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:17.569050 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6676cf9-d417-4843-9d15-9b1977415611 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:17.569335 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6676cf9-d417-4843-9d15-9b1977415611 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:17.569615 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6676cf9-d417-4843-9d15-9b1977415611 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:17.570344 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6676cf9-d417-4843-9d15-9b1977415611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:17.571976 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6676cf9-d417-4843-9d15-9b1977415611 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:17.576634 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1037/2068] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 04:10:17.577596 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f8129-f38e-4590-8d2a-98cb27beca17 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:17.587733 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1032/2069] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:10:17.588862 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f8129-f38e-4590-8d2a-98cb27beca17 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:17.590131 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6676cf9-d417-4843-9d15-9b1977415611 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:17.594498 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90477aac-c9bc-4e40-98ab-eadbdfea6684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:17.595187 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90477aac-c9bc-4e40-98ab-eadbdfea6684 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:17.595471 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90477aac-c9bc-4e40-98ab-eadbdfea6684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:17.595848 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90477aac-c9bc-4e40-98ab-eadbdfea6684 admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:17.596576 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90477aac-c9bc-4e40-98ab-eadbdfea6684 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:17.598538 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90477aac-c9bc-4e40-98ab-eadbdfea6684 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:17.604898 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6676cf9-d417-4843-9d15-9b1977415611 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:17.611481 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae24dc-e786-4132-a828-5824b273f06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:17.612684 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae24dc-e786-4132-a828-5824b273f06a admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:17.612815 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae24dc-e786-4132-a828-5824b273f06a admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:17.612983 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae24dc-e786-4132-a828-5824b273f06a admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:17.613719 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae24dc-e786-4132-a828-5824b273f06a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:17.615394 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae24dc-e786-4132-a828-5824b273f06a admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:17.628646 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1038/2070] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:10:17 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:10:17.635072 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90477aac-c9bc-4e40-98ab-eadbdfea6684 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:17.635915 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1033/2071] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:10:17.640402 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae24dc-e786-4132-a828-5824b273f06a admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:17.653304 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae24dc-e786-4132-a828-5824b273f06a admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:17.726483 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90477aac-c9bc-4e40-98ab-eadbdfea6684 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:17.732567 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edebfc07-97cb-4558-a0b5-a4e34b5b1d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:17.733327 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebfc07-97cb-4558-a0b5-a4e34b5b1d2a admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:17.734355 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebfc07-97cb-4558-a0b5-a4e34b5b1d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:17.734355 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebfc07-97cb-4558-a0b5-a4e34b5b1d2a admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:17.735068 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edebfc07-97cb-4558-a0b5-a4e34b5b1d2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:17.737021 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edebfc07-97cb-4558-a0b5-a4e34b5b1d2a admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:17.749290 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6855b-4223-4322-95e7-b05ea3c8b2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:17.750297 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6855b-4223-4322-95e7-b05ea3c8b2e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:17.750634 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6855b-4223-4322-95e7-b05ea3c8b2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:17.750851 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6855b-4223-4322-95e7-b05ea3c8b2e1 admin admin] PATH_INFO: `/v3/projects/bfdbb61535c745f5bed34c4263b2d463/users/c58a38d31880488689b7a3ee5d76df69/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:17.763721 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1039/2072] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:10:17 2022] POST /identity/v3/users => generated 287 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:10:17.766787 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edebfc07-97cb-4558-a0b5-a4e34b5b1d2a admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:17.774332 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba6855b-4223-4322-95e7-b05ea3c8b2e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfdbb61535c745f5bed34c4263b2d463, user_id=c58a38d31880488689b7a3ee5d76df69, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:17.777178 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba6855b-4223-4322-95e7-b05ea3c8b2e1 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:17.781110 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edebfc07-97cb-4558-a0b5-a4e34b5b1d2a admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:17.786164 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91809c61-9e77-49bc-99d3-bba81fea6eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:17.786917 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91809c61-9e77-49bc-99d3-bba81fea6eaa admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:17.787274 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91809c61-9e77-49bc-99d3-bba81fea6eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:17.787674 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91809c61-9e77-49bc-99d3-bba81fea6eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:17.788388 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91809c61-9e77-49bc-99d3-bba81fea6eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:17.790009 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91809c61-9e77-49bc-99d3-bba81fea6eaa admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:17.795167 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1034/2073] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:10:17 2022] PUT /identity/v3/projects/bfdbb61535c745f5bed34c4263b2d463/users/c58a38d31880488689b7a3ee5d76df69/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:17.809142 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1040/2074] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:10:17.809620 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257aacc-ba6d-48d8-a685-169382ad3426 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:17.809914 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257aacc-ba6d-48d8-a685-169382ad3426 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:17.810263 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257aacc-ba6d-48d8-a685-169382ad3426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:17.813219 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91809c61-9e77-49bc-99d3-bba81fea6eaa admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:17.824583 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91809c61-9e77-49bc-99d3-bba81fea6eaa admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:17.849241 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-5257aacc-ba6d-48d8-a685-169382ad3426 None None] MFA Rules not processed for user `c58a38d31880488689b7a3ee5d76df69`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:17.850451 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-5257aacc-ba6d-48d8-a685-169382ad3426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:17.900101 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00015410-7bfb-4d86-ac36-609042b35bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:17.900856 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00015410-7bfb-4d86-ac36-609042b35bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:17.901207 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00015410-7bfb-4d86-ac36-609042b35bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:17.901555 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00015410-7bfb-4d86-ac36-609042b35bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:17.902347 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00015410-7bfb-4d86-ac36-609042b35bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:17.907844 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00015410-7bfb-4d86-ac36-609042b35bb7 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:17.937295 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1041/2075] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:10:17.941738 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00015410-7bfb-4d86-ac36-609042b35bb7 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:17.948909 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1035/2076] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:17.954948 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257aacc-ba6d-48d8-a685-169382ad3426 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:17.959175 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00015410-7bfb-4d86-ac36-609042b35bb7 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:17.968778 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257aacc-ba6d-48d8-a685-169382ad3426 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:17.969958 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fa74e-d615-40d7-a693-be7bc6fc3844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:17.970860 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fa74e-d615-40d7-a693-be7bc6fc3844 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:17.971140 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fa74e-d615-40d7-a693-be7bc6fc3844 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:17.971414 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fa74e-d615-40d7-a693-be7bc6fc3844 admin admin] PATH_INFO: `/v3/projects/800ca3221d5c44b38dfdfca75a7cc37c/users/5f23f76aa53f43b29425ef6b46bc41c6/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:17.985528 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c82bf-505e-42ec-aed4-97dc82fe7278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:17.986206 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c82bf-505e-42ec-aed4-97dc82fe7278 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:17.986493 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c82bf-505e-42ec-aed4-97dc82fe7278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:17.986768 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c82bf-505e-42ec-aed4-97dc82fe7278 admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:17.987646 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c82bf-505e-42ec-aed4-97dc82fe7278 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:17.989626 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c82bf-505e-42ec-aed4-97dc82fe7278 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:17.998503 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3fa74e-d615-40d7-a693-be7bc6fc3844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=800ca3221d5c44b38dfdfca75a7cc37c, user_id=5f23f76aa53f43b29425ef6b46bc41c6, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:18.001250 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3fa74e-d615-40d7-a693-be7bc6fc3844 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:18.015618 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1042/2077] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:10:17 2022] PUT /identity/v3/projects/800ca3221d5c44b38dfdfca75a7cc37c/users/5f23f76aa53f43b29425ef6b46bc41c6/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:10:18.020422 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1036/2078] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:10:17 2022] POST /identity/v3/projects => generated 389 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:10:18.021112 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c93703-2d08-4350-8c4f-900dbdc19791 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:18.021453 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c93703-2d08-4350-8c4f-900dbdc19791 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:18.021784 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c93703-2d08-4350-8c4f-900dbdc19791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:18.023998 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c82bf-505e-42ec-aed4-97dc82fe7278 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:18.047835 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-92c93703-2d08-4350-8c4f-900dbdc19791 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:18.049072 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-92c93703-2d08-4350-8c4f-900dbdc19791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:18.095911 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c82bf-505e-42ec-aed4-97dc82fe7278 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:18.100741 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c73f9-b0d5-4e2d-ac4d-388a0dd6df87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:18.101577 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c73f9-b0d5-4e2d-ac4d-388a0dd6df87 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:18.101898 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c73f9-b0d5-4e2d-ac4d-388a0dd6df87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:18.102018 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c73f9-b0d5-4e2d-ac4d-388a0dd6df87 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:18.102710 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c73f9-b0d5-4e2d-ac4d-388a0dd6df87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:18.105318 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c73f9-b0d5-4e2d-ac4d-388a0dd6df87 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:18.133864 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1037/2079] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:10:18 2022] POST /identity/v3/users => generated 301 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:10:18.138349 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1043/2080] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:10:18.138666 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c73f9-b0d5-4e2d-ac4d-388a0dd6df87 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:18.151881 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c73f9-b0d5-4e2d-ac4d-388a0dd6df87 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:18.152916 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c93703-2d08-4350-8c4f-900dbdc19791 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:18.154810 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-92c93703-2d08-4350-8c4f-900dbdc19791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:18.157319 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb4b4c-919b-4907-b51b-17386367a0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:18.158122 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb4b4c-919b-4907-b51b-17386367a0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:18.158410 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb4b4c-919b-4907-b51b-17386367a0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:18.158687 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb4b4c-919b-4907-b51b-17386367a0b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:18.159414 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb4b4c-919b-4907-b51b-17386367a0b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:18.161042 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb4b4c-919b-4907-b51b-17386367a0b9 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:18.179066 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1038/2081] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:10:18.183251 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb4b4c-919b-4907-b51b-17386367a0b9 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:18.192585 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb4b4c-919b-4907-b51b-17386367a0b9 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:18.197577 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6485f78-b166-4d65-b01a-9b659a9d8528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:18.198473 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6485f78-b166-4d65-b01a-9b659a9d8528 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:18.198749 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6485f78-b166-4d65-b01a-9b659a9d8528 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:18.199018 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6485f78-b166-4d65-b01a-9b659a9d8528 admin admin] PATH_INFO: `/v3/projects/1d75dd4ccbc2427a8d961064088e8d37/users/7429a2de30334102869653a05738c31e/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:18.210048 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c93703-2d08-4350-8c4f-900dbdc19791 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:18.213878 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4af05-0cac-4343-b7fb-d75da76bcbfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:18.214079 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6485f78-b166-4d65-b01a-9b659a9d8528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d75dd4ccbc2427a8d961064088e8d37, user_id=7429a2de30334102869653a05738c31e, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:18.214540 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4af05-0cac-4343-b7fb-d75da76bcbfe service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:18.214821 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4af05-0cac-4343-b7fb-d75da76bcbfe service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:18.215096 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4af05-0cac-4343-b7fb-d75da76bcbfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:18.216794 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6485f78-b166-4d65-b01a-9b659a9d8528 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:18.225491 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4af05-0cac-4343-b7fb-d75da76bcbfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:18.226935 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4af05-0cac-4343-b7fb-d75da76bcbfe service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:18.229750 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1039/2082] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:10:18 2022] PUT /identity/v3/projects/1d75dd4ccbc2427a8d961064088e8d37/users/7429a2de30334102869653a05738c31e/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:10:18.233511 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6485f78-b166-4d65-b01a-9b659a9d8528 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:18.236736 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1044/2083] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:10:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:10:18.302919 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6485f78-b166-4d65-b01a-9b659a9d8528 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:18.308579 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a663534-95ac-41ce-8e30-19ef9f630e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:18.309319 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a663534-95ac-41ce-8e30-19ef9f630e66 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:18.309566 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a663534-95ac-41ce-8e30-19ef9f630e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:18.309868 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a663534-95ac-41ce-8e30-19ef9f630e66 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:18.310800 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a663534-95ac-41ce-8e30-19ef9f630e66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:18.312658 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a663534-95ac-41ce-8e30-19ef9f630e66 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:18.327850 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1040/2084] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:10:18.329012 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4af05-0cac-4343-b7fb-d75da76bcbfe service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:18.338789 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4af05-0cac-4343-b7fb-d75da76bcbfe service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:18.344583 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267391d-1dd1-4ff4-94e0-4f358ca73ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:18.345462 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267391d-1dd1-4ff4-94e0-4f358ca73ed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:18.345740 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267391d-1dd1-4ff4-94e0-4f358ca73ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:18.346015 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267391d-1dd1-4ff4-94e0-4f358ca73ed2 admin admin] PATH_INFO: `/v3/projects/1d75dd4ccbc2427a8d961064088e8d37/users/7429a2de30334102869653a05738c31e/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:18.348006 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267391d-1dd1-4ff4-94e0-4f358ca73ed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d75dd4ccbc2427a8d961064088e8d37, user_id=7429a2de30334102869653a05738c31e, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:18.350620 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267391d-1dd1-4ff4-94e0-4f358ca73ed2 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:18.361067 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1045/2085] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:10:18 2022] PUT /identity/v3/projects/1d75dd4ccbc2427a8d961064088e8d37/users/7429a2de30334102869653a05738c31e/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:10:18.371251 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04edcd-a4c4-47cd-860c-98a284a2c12f None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:18.371542 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04edcd-a4c4-47cd-860c-98a284a2c12f None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:18.371863 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04edcd-a4c4-47cd-860c-98a284a2c12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:18.407420 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-7a04edcd-a4c4-47cd-860c-98a284a2c12f None None] MFA Rules not processed for user `7429a2de30334102869653a05738c31e`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:18.408961 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-7a04edcd-a4c4-47cd-860c-98a284a2c12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:18.523278 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1041/2086] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:18 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:10:18.536087 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267391d-1dd1-4ff4-94e0-4f358ca73ed2 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:18.540180 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-e267391d-1dd1-4ff4-94e0-4f358ca73ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:18.604044 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267391d-1dd1-4ff4-94e0-4f358ca73ed2 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:18.607667 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be962f1-0c5d-427c-9110-2d60ee567e4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:18.608668 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be962f1-0c5d-427c-9110-2d60ee567e4f service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:18.608989 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be962f1-0c5d-427c-9110-2d60ee567e4f service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:18.609421 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be962f1-0c5d-427c-9110-2d60ee567e4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:18.620292 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be962f1-0c5d-427c-9110-2d60ee567e4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:18.621906 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be962f1-0c5d-427c-9110-2d60ee567e4f service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:18.633441 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1046/2087] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:10:18 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:10:18.813300 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04edcd-a4c4-47cd-860c-98a284a2c12f None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:18.944837 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04edcd-a4c4-47cd-860c-98a284a2c12f None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:18.957558 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4487a-2847-4f7b-9a9d-4fcef9de6483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:18.958571 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4487a-2847-4f7b-9a9d-4fcef9de6483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:18.958946 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4487a-2847-4f7b-9a9d-4fcef9de6483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:18.959150 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4487a-2847-4f7b-9a9d-4fcef9de6483 admin admin] PATH_INFO: `/v3/users/c58a38d31880488689b7a3ee5d76df69` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:18.963414 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4487a-2847-4f7b-9a9d-4fcef9de6483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c58a38d31880488689b7a3ee5d76df69)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:18.966741 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4487a-2847-4f7b-9a9d-4fcef9de6483 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:19.054173 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-aae4487a-2847-4f7b-9a9d-4fcef9de6483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c58a38d31880488689b7a3ee5d76df69'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:19.064222 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-aae4487a-2847-4f7b-9a9d-4fcef9de6483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c58a38d31880488689b7a3ee5d76df69'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:19.078962 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-aae4487a-2847-4f7b-9a9d-4fcef9de6483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c58a38d31880488689b7a3ee5d76df69'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:19.095156 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-aae4487a-2847-4f7b-9a9d-4fcef9de6483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c58a38d31880488689b7a3ee5d76df69'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:19.096359 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-aae4487a-2847-4f7b-9a9d-4fcef9de6483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c58a38d31880488689b7a3ee5d76df69'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:19.102817 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1042/2088] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:10:18 2022] DELETE /identity/v3/users/c58a38d31880488689b7a3ee5d76df69 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:19.107657 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc43772-1380-4dab-a615-80c50ca426f3 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:19.109096 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc43772-1380-4dab-a615-80c50ca426f3 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:19.109376 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc43772-1380-4dab-a615-80c50ca426f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:19.137987 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361364d9-bf8b-4b66-829c-041a2926124a None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:19.138269 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361364d9-bf8b-4b66-829c-041a2926124a None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:19.138989 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361364d9-bf8b-4b66-829c-041a2926124a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:19.141158 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-efc43772-1380-4dab-a615-80c50ca426f3 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:19.142382 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-efc43772-1380-4dab-a615-80c50ca426f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:19.175234 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-361364d9-bf8b-4b66-829c-041a2926124a None None] MFA Rules not processed for user `5f23f76aa53f43b29425ef6b46bc41c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:19.176587 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-361364d9-bf8b-4b66-829c-041a2926124a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:19.226201 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1047/2089] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:19.236174 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc43772-1380-4dab-a615-80c50ca426f3 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:19.238080 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-efc43772-1380-4dab-a615-80c50ca426f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:19.262416 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1043/2090] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:19.276932 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361364d9-bf8b-4b66-829c-041a2926124a None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:19.278452 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-361364d9-bf8b-4b66-829c-041a2926124a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:19.307444 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc43772-1380-4dab-a615-80c50ca426f3 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:19.311232 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42df498-8b28-4e0a-8f3f-745a9d871b24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:19.311977 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42df498-8b28-4e0a-8f3f-745a9d871b24 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:19.312272 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42df498-8b28-4e0a-8f3f-745a9d871b24 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:19.312542 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42df498-8b28-4e0a-8f3f-745a9d871b24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:19.322343 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42df498-8b28-4e0a-8f3f-745a9d871b24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:19.324035 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42df498-8b28-4e0a-8f3f-745a9d871b24 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:19.333993 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1048/2091] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:10:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:10:19.344329 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361364d9-bf8b-4b66-829c-041a2926124a None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:19.348144 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a7692-acd0-48ac-aa8c-6edda9619f2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:19.348928 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a7692-acd0-48ac-aa8c-6edda9619f2b service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:19.349110 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a7692-acd0-48ac-aa8c-6edda9619f2b service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:19.349392 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a7692-acd0-48ac-aa8c-6edda9619f2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:19.358050 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a7692-acd0-48ac-aa8c-6edda9619f2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:19.360076 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a7692-acd0-48ac-aa8c-6edda9619f2b service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:19.370414 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1044/2092] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:10:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:10:19.617451 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42df498-8b28-4e0a-8f3f-745a9d871b24 service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:19.624151 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-c42df498-8b28-4e0a-8f3f-745a9d871b24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:19.649230 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42df498-8b28-4e0a-8f3f-745a9d871b24 service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:19.657873 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30218dcb-bfa8-4168-bc8c-1546380c06f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:19.658876 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30218dcb-bfa8-4168-bc8c-1546380c06f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:19.659400 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30218dcb-bfa8-4168-bc8c-1546380c06f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:19.659920 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30218dcb-bfa8-4168-bc8c-1546380c06f2 admin admin] PATH_INFO: `/v3/projects/bfdbb61535c745f5bed34c4263b2d463` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:19.661346 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30218dcb-bfa8-4168-bc8c-1546380c06f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfdbb61535c745f5bed34c4263b2d463)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:19.663353 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30218dcb-bfa8-4168-bc8c-1546380c06f2 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:19.712998 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-30218dcb-bfa8-4168-bc8c-1546380c06f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfdbb61535c745f5bed34c4263b2d463', 'request_id': 'req-30218dcb-bfa8-4168-bc8c-1546380c06f2'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:19.719062 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-30218dcb-bfa8-4168-bc8c-1546380c06f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfdbb61535c745f5bed34c4263b2d463', 'request_id': 'req-30218dcb-bfa8-4168-bc8c-1546380c06f2'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:19.725068 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-30218dcb-bfa8-4168-bc8c-1546380c06f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfdbb61535c745f5bed34c4263b2d463', 'request_id': 'req-30218dcb-bfa8-4168-bc8c-1546380c06f2'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:19.737559 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-30218dcb-bfa8-4168-bc8c-1546380c06f2 admin admin] The token cache is being invalidate because project bfdbb61535c745f5bed34c4263b2d463 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:10:19.737864 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-30218dcb-bfa8-4168-bc8c-1546380c06f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:19.738521 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-30218dcb-bfa8-4168-bc8c-1546380c06f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:19.740121 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1049/2093] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:10:19 2022] DELETE /identity/v3/projects/bfdbb61535c745f5bed34c4263b2d463 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:19.744515 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a7692-acd0-48ac-aa8c-6edda9619f2b service cinder] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:19.755083 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a7692-acd0-48ac-aa8c-6edda9619f2b service cinder] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:19.809200 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74f04d-495d-4a5c-b27e-813540b77803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:19.810102 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74f04d-495d-4a5c-b27e-813540b77803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:19.810382 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74f04d-495d-4a5c-b27e-813540b77803 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:19.810657 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74f04d-495d-4a5c-b27e-813540b77803 admin admin] PATH_INFO: `/v3/users/7429a2de30334102869653a05738c31e` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:19.811879 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74f04d-495d-4a5c-b27e-813540b77803 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7429a2de30334102869653a05738c31e)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:19.813759 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74f04d-495d-4a5c-b27e-813540b77803 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:19.861498 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-fb74f04d-495d-4a5c-b27e-813540b77803 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7429a2de30334102869653a05738c31e'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:19.868127 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-fb74f04d-495d-4a5c-b27e-813540b77803 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7429a2de30334102869653a05738c31e'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:19.876335 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-fb74f04d-495d-4a5c-b27e-813540b77803 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7429a2de30334102869653a05738c31e'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:19.887775 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-fb74f04d-495d-4a5c-b27e-813540b77803 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7429a2de30334102869653a05738c31e'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:19.888456 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-fb74f04d-495d-4a5c-b27e-813540b77803 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7429a2de30334102869653a05738c31e'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:19.894907 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1045/2094] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:10:19 2022] DELETE /identity/v3/users/7429a2de30334102869653a05738c31e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:20.228045 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30218dcb-bfa8-4168-bc8c-1546380c06f2 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:20.232192 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-30218dcb-bfa8-4168-bc8c-1546380c06f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:20.252140 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30218dcb-bfa8-4168-bc8c-1546380c06f2 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:20.314793 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94798c-f9d3-4b30-93e6-19d2c06830f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:20.315645 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94798c-f9d3-4b30-93e6-19d2c06830f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:20.315953 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94798c-f9d3-4b30-93e6-19d2c06830f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:20.316233 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94798c-f9d3-4b30-93e6-19d2c06830f1 admin admin] PATH_INFO: `/v3/projects/1d75dd4ccbc2427a8d961064088e8d37` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:20.317399 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94798c-f9d3-4b30-93e6-19d2c06830f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d75dd4ccbc2427a8d961064088e8d37)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:20.319547 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94798c-f9d3-4b30-93e6-19d2c06830f1 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:20.365464 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-cc94798c-f9d3-4b30-93e6-19d2c06830f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d75dd4ccbc2427a8d961064088e8d37', 'request_id': 'req-cc94798c-f9d3-4b30-93e6-19d2c06830f1'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:20.370499 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-cc94798c-f9d3-4b30-93e6-19d2c06830f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d75dd4ccbc2427a8d961064088e8d37', 'request_id': 'req-cc94798c-f9d3-4b30-93e6-19d2c06830f1'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:20.376407 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-cc94798c-f9d3-4b30-93e6-19d2c06830f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d75dd4ccbc2427a8d961064088e8d37', 'request_id': 'req-cc94798c-f9d3-4b30-93e6-19d2c06830f1'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:20.388066 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-cc94798c-f9d3-4b30-93e6-19d2c06830f1 admin admin] The token cache is being invalidate because project 1d75dd4ccbc2427a8d961064088e8d37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:10:20.388298 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-cc94798c-f9d3-4b30-93e6-19d2c06830f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:20.388926 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-cc94798c-f9d3-4b30-93e6-19d2c06830f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:20.390968 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1050/2095] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:10:20 2022] DELETE /identity/v3/projects/1d75dd4ccbc2427a8d961064088e8d37 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:20.396176 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4e305-4521-426d-babe-74760b7eb232 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:20.396664 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4e305-4521-426d-babe-74760b7eb232 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:20.396756 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4e305-4521-426d-babe-74760b7eb232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:20.416079 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-02c4e305-4521-426d-babe-74760b7eb232 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:20.417289 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-02c4e305-4521-426d-babe-74760b7eb232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:20.475902 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1046/2096] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:20.484362 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca104c-4f5b-459b-b80a-5a0a1e4b9004 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:20.484689 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca104c-4f5b-459b-b80a-5a0a1e4b9004 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:20.485126 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca104c-4f5b-459b-b80a-5a0a1e4b9004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:20.503259 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-18ca104c-4f5b-459b-b80a-5a0a1e4b9004 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:20.504520 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-18ca104c-4f5b-459b-b80a-5a0a1e4b9004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:20.512528 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1051/2097] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:20.517623 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4e305-4521-426d-babe-74760b7eb232 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:20.527471 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4e305-4521-426d-babe-74760b7eb232 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:20.533138 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77078a0a-6d0a-491b-b8fd-e3d2999f12b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:20.533812 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77078a0a-6d0a-491b-b8fd-e3d2999f12b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:20.534098 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77078a0a-6d0a-491b-b8fd-e3d2999f12b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:20.534370 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77078a0a-6d0a-491b-b8fd-e3d2999f12b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:20.535099 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77078a0a-6d0a-491b-b8fd-e3d2999f12b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:10:20.535441 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77078a0a-6d0a-491b-b8fd-e3d2999f12b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:20.537102 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77078a0a-6d0a-491b-b8fd-e3d2999f12b2 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:20.549871 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1047/2098] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 04:10:20.554640 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca104c-4f5b-459b-b80a-5a0a1e4b9004 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:20.563897 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca104c-4f5b-459b-b80a-5a0a1e4b9004 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:20.569017 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1682504-9d32-486f-92a9-113952ef9a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:20.569653 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1682504-9d32-486f-92a9-113952ef9a3c admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:20.569937 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1682504-9d32-486f-92a9-113952ef9a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:20.570216 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1682504-9d32-486f-92a9-113952ef9a3c admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:20.570900 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1682504-9d32-486f-92a9-113952ef9a3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:20.572834 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1682504-9d32-486f-92a9-113952ef9a3c admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:20.599871 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1052/2099] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:10:20 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:10:20.603979 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77078a0a-6d0a-491b-b8fd-e3d2999f12b2 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:20.613621 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77078a0a-6d0a-491b-b8fd-e3d2999f12b2 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:20.668844 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a3f358-fecf-4eda-a329-840ba32032b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:20.669448 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3f358-fecf-4eda-a329-840ba32032b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:20.669734 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3f358-fecf-4eda-a329-840ba32032b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:20.670006 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3f358-fecf-4eda-a329-840ba32032b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:20.670691 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a3f358-fecf-4eda-a329-840ba32032b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:20.672653 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a3f358-fecf-4eda-a329-840ba32032b8 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:20.693776 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1048/2100] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:10:20 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:10:20.698133 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1682504-9d32-486f-92a9-113952ef9a3c admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:20.710597 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1682504-9d32-486f-92a9-113952ef9a3c admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:20.715312 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa8386-2d98-4045-b2aa-54ff34bbfaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:20.716001 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa8386-2d98-4045-b2aa-54ff34bbfaee admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:20.716289 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa8386-2d98-4045-b2aa-54ff34bbfaee admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:20.716566 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa8386-2d98-4045-b2aa-54ff34bbfaee admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:20.717297 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa8386-2d98-4045-b2aa-54ff34bbfaee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:20.718948 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa8386-2d98-4045-b2aa-54ff34bbfaee admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:20.729630 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1053/2101] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:10:20.733699 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa8386-2d98-4045-b2aa-54ff34bbfaee admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:20.733828 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8daf10-6c87-43be-b8bd-c4e255010925 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:20.734327 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8daf10-6c87-43be-b8bd-c4e255010925 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:20.734616 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8daf10-6c87-43be-b8bd-c4e255010925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:20.743278 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa8386-2d98-4045-b2aa-54ff34bbfaee admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:20.748239 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d86a91-f696-4485-84ca-6ca85dde2e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:20.749367 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d86a91-f696-4485-84ca-6ca85dde2e25 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:20.749649 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d86a91-f696-4485-84ca-6ca85dde2e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:20.749921 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d86a91-f696-4485-84ca-6ca85dde2e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:20.750634 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d86a91-f696-4485-84ca-6ca85dde2e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:20.752240 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d86a91-f696-4485-84ca-6ca85dde2e25 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:20.752728 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-df8daf10-6c87-43be-b8bd-c4e255010925 None None] MFA Rules not processed for user `5f23f76aa53f43b29425ef6b46bc41c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:20.753898 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-df8daf10-6c87-43be-b8bd-c4e255010925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:20.761940 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1054/2102] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:10:20.766676 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d86a91-f696-4485-84ca-6ca85dde2e25 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:20.775852 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d86a91-f696-4485-84ca-6ca85dde2e25 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:20.780307 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca2bf6-f6a6-4e50-9a9d-72350c77afbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:20.781147 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca2bf6-f6a6-4e50-9a9d-72350c77afbb admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:20.781430 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca2bf6-f6a6-4e50-9a9d-72350c77afbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:20.781740 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca2bf6-f6a6-4e50-9a9d-72350c77afbb admin admin] PATH_INFO: `/v3/projects/895bfd648abe44c49ed270791ce86e42/users/0b13f0495e084771a0c5fb878871fdc3/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:20.796354 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca2bf6-f6a6-4e50-9a9d-72350c77afbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=895bfd648abe44c49ed270791ce86e42, user_id=0b13f0495e084771a0c5fb878871fdc3, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:20.798991 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca2bf6-f6a6-4e50-9a9d-72350c77afbb admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:20.809620 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1049/2103] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:20.814761 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1055/2104] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:10:20 2022] PUT /identity/v3/projects/895bfd648abe44c49ed270791ce86e42/users/0b13f0495e084771a0c5fb878871fdc3/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:10:20.824025 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fe57c-05a9-4dda-b0e7-b0452cb6945c None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:20.824314 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fe57c-05a9-4dda-b0e7-b0452cb6945c None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:20.824590 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fe57c-05a9-4dda-b0e7-b0452cb6945c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:20.855308 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-238fe57c-05a9-4dda-b0e7-b0452cb6945c None None] MFA Rules not processed for user `0b13f0495e084771a0c5fb878871fdc3`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:20.856556 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-238fe57c-05a9-4dda-b0e7-b0452cb6945c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:20.915811 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1050/2105] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:20.920289 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca2bf6-f6a6-4e50-9a9d-72350c77afbb admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:20.979751 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca2bf6-f6a6-4e50-9a9d-72350c77afbb admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:20.985050 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6b65d-1b49-4ef0-9aab-2752da6bb9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:20.985734 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6b65d-1b49-4ef0-9aab-2752da6bb9ba admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:20.986011 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6b65d-1b49-4ef0-9aab-2752da6bb9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:20.986462 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6b65d-1b49-4ef0-9aab-2752da6bb9ba admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:20.986989 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca6b65d-1b49-4ef0-9aab-2752da6bb9ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:20.988924 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca6b65d-1b49-4ef0-9aab-2752da6bb9ba admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:21.019510 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1056/2106] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:10:20 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:10:21.023656 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fe57c-05a9-4dda-b0e7-b0452cb6945c None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:21.034450 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fe57c-05a9-4dda-b0e7-b0452cb6945c None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:21.090261 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154d5d8-122b-4fa4-ad43-70d4e3510083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:21.090926 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154d5d8-122b-4fa4-ad43-70d4e3510083 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:21.091209 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154d5d8-122b-4fa4-ad43-70d4e3510083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:21.091484 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154d5d8-122b-4fa4-ad43-70d4e3510083 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:21.092217 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154d5d8-122b-4fa4-ad43-70d4e3510083 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:21.094748 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154d5d8-122b-4fa4-ad43-70d4e3510083 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:21.114945 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1051/2107] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:10:21 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:10:21.119174 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6b65d-1b49-4ef0-9aab-2752da6bb9ba admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:21.129936 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6b65d-1b49-4ef0-9aab-2752da6bb9ba admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:21.134570 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35cd28-56ba-4857-a6c9-8e36165e553f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:21.135227 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35cd28-56ba-4857-a6c9-8e36165e553f admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:21.135532 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35cd28-56ba-4857-a6c9-8e36165e553f admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:21.135817 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35cd28-56ba-4857-a6c9-8e36165e553f admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:21.136550 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f35cd28-56ba-4857-a6c9-8e36165e553f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:21.138125 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f35cd28-56ba-4857-a6c9-8e36165e553f admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:21.149738 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1057/2108] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:10:21.153697 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154d5d8-122b-4fa4-ad43-70d4e3510083 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:21.164049 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154d5d8-122b-4fa4-ad43-70d4e3510083 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:21.168629 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d7cf6-49c7-45c2-bed7-cc6ea4bd6a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:21.169280 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d7cf6-49c7-45c2-bed7-cc6ea4bd6a96 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:21.169567 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d7cf6-49c7-45c2-bed7-cc6ea4bd6a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:21.169848 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d7cf6-49c7-45c2-bed7-cc6ea4bd6a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:21.170638 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d7cf6-49c7-45c2-bed7-cc6ea4bd6a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:21.172228 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d7cf6-49c7-45c2-bed7-cc6ea4bd6a96 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:21.181761 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1052/2109] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:10:21.185623 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35cd28-56ba-4857-a6c9-8e36165e553f admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:21.195401 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35cd28-56ba-4857-a6c9-8e36165e553f admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:21.199966 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07531a0-db69-4ecc-983d-3201b419284a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:21.200827 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07531a0-db69-4ecc-983d-3201b419284a admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:21.201110 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07531a0-db69-4ecc-983d-3201b419284a admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:21.201390 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07531a0-db69-4ecc-983d-3201b419284a admin admin] PATH_INFO: `/v3/projects/90527cb8063a4ea2a2373a384623c2cc/users/14deabdc6fa04400bcf00377fe0438c6/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:21.215816 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07531a0-db69-4ecc-983d-3201b419284a admin admin] RBAC: Authorizing `identity:create_grant(project_id=90527cb8063a4ea2a2373a384623c2cc, user_id=14deabdc6fa04400bcf00377fe0438c6, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:21.219195 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07531a0-db69-4ecc-983d-3201b419284a admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:21.232083 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1058/2110] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:10:21 2022] PUT /identity/v3/projects/90527cb8063a4ea2a2373a384623c2cc/users/14deabdc6fa04400bcf00377fe0438c6/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:21.242511 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79139e-b922-424c-8d8e-8f1f00c95a97 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:21.242810 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79139e-b922-424c-8d8e-8f1f00c95a97 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:21.243093 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79139e-b922-424c-8d8e-8f1f00c95a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:21.271167 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-5d79139e-b922-424c-8d8e-8f1f00c95a97 None None] MFA Rules not processed for user `14deabdc6fa04400bcf00377fe0438c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:21.272419 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-5d79139e-b922-424c-8d8e-8f1f00c95a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:21.339465 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1053/2111] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:21.344778 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07531a0-db69-4ecc-983d-3201b419284a admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:21.403987 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07531a0-db69-4ecc-983d-3201b419284a admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:21.408830 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63564bac-23c8-4a5b-89cc-c44f5783074a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:21.409485 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63564bac-23c8-4a5b-89cc-c44f5783074a admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:21.409768 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63564bac-23c8-4a5b-89cc-c44f5783074a admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:21.410044 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63564bac-23c8-4a5b-89cc-c44f5783074a admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:21.410749 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63564bac-23c8-4a5b-89cc-c44f5783074a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:21.412788 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63564bac-23c8-4a5b-89cc-c44f5783074a admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:21.439543 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1059/2112] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:10:21 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:10:21.444473 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79139e-b922-424c-8d8e-8f1f00c95a97 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:21.459988 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79139e-b922-424c-8d8e-8f1f00c95a97 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:21.537478 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b3822-05a9-4b3e-b689-599c8f1dc0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:21.538149 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b3822-05a9-4b3e-b689-599c8f1dc0b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:21.538430 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b3822-05a9-4b3e-b689-599c8f1dc0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:21.538703 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b3822-05a9-4b3e-b689-599c8f1dc0b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:21.539403 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b3822-05a9-4b3e-b689-599c8f1dc0b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:21.541490 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b3822-05a9-4b3e-b689-599c8f1dc0b8 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:21.564512 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1054/2113] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:10:21 2022] POST /identity/v3/users => generated 298 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:10:21.568740 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63564bac-23c8-4a5b-89cc-c44f5783074a admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:21.579336 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63564bac-23c8-4a5b-89cc-c44f5783074a admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:21.584136 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f09f99-de39-4cce-86a3-2769212c760e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:21.584831 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f09f99-de39-4cce-86a3-2769212c760e admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:21.585118 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f09f99-de39-4cce-86a3-2769212c760e admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:21.585405 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f09f99-de39-4cce-86a3-2769212c760e admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:21.586143 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f09f99-de39-4cce-86a3-2769212c760e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:21.587826 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f09f99-de39-4cce-86a3-2769212c760e admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:21.598534 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1060/2114] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:10:21.602654 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b3822-05a9-4b3e-b689-599c8f1dc0b8 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:21.613098 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b3822-05a9-4b3e-b689-599c8f1dc0b8 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:21.619163 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b1e24-2971-4202-bfbe-cb99345dfa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:21.620565 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b1e24-2971-4202-bfbe-cb99345dfa15 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:21.620565 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b1e24-2971-4202-bfbe-cb99345dfa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:21.620958 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b1e24-2971-4202-bfbe-cb99345dfa15 admin admin] PATH_INFO: `/v3/projects/5885d3e5cb9e4c689ffcfcaf3d2ed48a/users/25168ec5522b44bdbb91a3cd0f3b1a17/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:21.641422 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b1e24-2971-4202-bfbe-cb99345dfa15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5885d3e5cb9e4c689ffcfcaf3d2ed48a, user_id=25168ec5522b44bdbb91a3cd0f3b1a17, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:21.644667 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84b1e24-2971-4202-bfbe-cb99345dfa15 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:21.671055 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1055/2115] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:10:21 2022] PUT /identity/v3/projects/5885d3e5cb9e4c689ffcfcaf3d2ed48a/users/25168ec5522b44bdbb91a3cd0f3b1a17/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:21.675097 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f09f99-de39-4cce-86a3-2769212c760e admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:21.685525 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f09f99-de39-4cce-86a3-2769212c760e admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:21.745667 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc5c88-9ba8-4665-93e7-0912b6f9d51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:21.746361 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc5c88-9ba8-4665-93e7-0912b6f9d51e admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:21.746613 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc5c88-9ba8-4665-93e7-0912b6f9d51e admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:21.746891 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc5c88-9ba8-4665-93e7-0912b6f9d51e admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:21.747618 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc5c88-9ba8-4665-93e7-0912b6f9d51e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:21.749825 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc5c88-9ba8-4665-93e7-0912b6f9d51e admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:21.764160 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1061/2116] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:10:21.766016 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b1e24-2971-4202-bfbe-cb99345dfa15 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:21.777539 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b1e24-2971-4202-bfbe-cb99345dfa15 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:21.782559 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e6d27-b9d1-4bdc-a5a8-1205e4259ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:21.783579 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e6d27-b9d1-4bdc-a5a8-1205e4259ce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:21.783897 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e6d27-b9d1-4bdc-a5a8-1205e4259ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:21.800098 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e6d27-b9d1-4bdc-a5a8-1205e4259ce0 admin admin] PATH_INFO: `/v3/projects/5885d3e5cb9e4c689ffcfcaf3d2ed48a/users/25168ec5522b44bdbb91a3cd0f3b1a17/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:21.802410 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e6d27-b9d1-4bdc-a5a8-1205e4259ce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5885d3e5cb9e4c689ffcfcaf3d2ed48a, user_id=25168ec5522b44bdbb91a3cd0f3b1a17, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:21.806097 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e6d27-b9d1-4bdc-a5a8-1205e4259ce0 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:21.821758 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1056/2117] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:10:21 2022] PUT /identity/v3/projects/5885d3e5cb9e4c689ffcfcaf3d2ed48a/users/25168ec5522b44bdbb91a3cd0f3b1a17/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:21.834101 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0daf894-d259-4e09-afa0-83292ef2a10a None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:21.834395 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0daf894-d259-4e09-afa0-83292ef2a10a None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:21.834679 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0daf894-d259-4e09-afa0-83292ef2a10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:21.861048 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-b0daf894-d259-4e09-afa0-83292ef2a10a None None] MFA Rules not processed for user `25168ec5522b44bdbb91a3cd0f3b1a17`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:21.862257 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-b0daf894-d259-4e09-afa0-83292ef2a10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:21.928078 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1062/2118] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:21.940895 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e6d27-b9d1-4bdc-a5a8-1205e4259ce0 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:21.942736 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-b69e6d27-b9d1-4bdc-a5a8-1205e4259ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:22.001741 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e6d27-b9d1-4bdc-a5a8-1205e4259ce0 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:22.005650 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b707ea-bce6-4c12-bb50-6e64c4c75dc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:22.006302 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b707ea-bce6-4c12-bb50-6e64c4c75dc1 service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:22.006607 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b707ea-bce6-4c12-bb50-6e64c4c75dc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:22.006885 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b707ea-bce6-4c12-bb50-6e64c4c75dc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:22.070230 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b707ea-bce6-4c12-bb50-6e64c4c75dc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:22.071661 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b707ea-bce6-4c12-bb50-6e64c4c75dc1 service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:22.080659 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1057/2119] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:10:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:10:22.179575 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0daf894-d259-4e09-afa0-83292ef2a10a None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:22.181820 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-b0daf894-d259-4e09-afa0-83292ef2a10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:22.252482 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0daf894-d259-4e09-afa0-83292ef2a10a None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:22.257077 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da9288-acb9-4a76-b9f0-f6b7dc08d3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:22.258382 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da9288-acb9-4a76-b9f0-f6b7dc08d3c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:22.258634 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da9288-acb9-4a76-b9f0-f6b7dc08d3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:22.259023 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da9288-acb9-4a76-b9f0-f6b7dc08d3c7 admin admin] PATH_INFO: `/v3/users/d7f2c45ac1b0456fae21ecc1150a3cff` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:22.260329 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da9288-acb9-4a76-b9f0-f6b7dc08d3c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7f2c45ac1b0456fae21ecc1150a3cff)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:22.262524 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da9288-acb9-4a76-b9f0-f6b7dc08d3c7 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:22.308535 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-53da9288-acb9-4a76-b9f0-f6b7dc08d3c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7f2c45ac1b0456fae21ecc1150a3cff'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:22.309527 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-53da9288-acb9-4a76-b9f0-f6b7dc08d3c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7f2c45ac1b0456fae21ecc1150a3cff'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:22.317529 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-53da9288-acb9-4a76-b9f0-f6b7dc08d3c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7f2c45ac1b0456fae21ecc1150a3cff'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:22.330521 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-53da9288-acb9-4a76-b9f0-f6b7dc08d3c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7f2c45ac1b0456fae21ecc1150a3cff'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:22.331476 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-53da9288-acb9-4a76-b9f0-f6b7dc08d3c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7f2c45ac1b0456fae21ecc1150a3cff'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:22.347599 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1063/2120] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:10:22 2022] DELETE /identity/v3/users/d7f2c45ac1b0456fae21ecc1150a3cff => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:10:22.540354 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b707ea-bce6-4c12-bb50-6e64c4c75dc1 service cinder] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:22.557952 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b707ea-bce6-4c12-bb50-6e64c4c75dc1 service cinder] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:22.621665 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef8351-e706-44bb-be1e-5529ca978325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:22.622570 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef8351-e706-44bb-be1e-5529ca978325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:22.622837 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef8351-e706-44bb-be1e-5529ca978325 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:22.623226 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef8351-e706-44bb-be1e-5529ca978325 admin admin] PATH_INFO: `/v3/projects/8709904b3d2c45eeaf39c924b23a36b7` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:22.624739 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef8351-e706-44bb-be1e-5529ca978325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8709904b3d2c45eeaf39c924b23a36b7)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:22.626845 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef8351-e706-44bb-be1e-5529ca978325 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:22.671346 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-daef8351-e706-44bb-be1e-5529ca978325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8709904b3d2c45eeaf39c924b23a36b7', 'request_id': 'req-daef8351-e706-44bb-be1e-5529ca978325'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:22.676590 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-daef8351-e706-44bb-be1e-5529ca978325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8709904b3d2c45eeaf39c924b23a36b7', 'request_id': 'req-daef8351-e706-44bb-be1e-5529ca978325'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:22.682455 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-daef8351-e706-44bb-be1e-5529ca978325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8709904b3d2c45eeaf39c924b23a36b7', 'request_id': 'req-daef8351-e706-44bb-be1e-5529ca978325'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:22.693920 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-daef8351-e706-44bb-be1e-5529ca978325 admin admin] The token cache is being invalidate because project 8709904b3d2c45eeaf39c924b23a36b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:10:22.694207 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-daef8351-e706-44bb-be1e-5529ca978325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:22.694855 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-daef8351-e706-44bb-be1e-5529ca978325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:22.696473 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1058/2121] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:10:22 2022] DELETE /identity/v3/projects/8709904b3d2c45eeaf39c924b23a36b7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:10:22.701644 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58e7e6-76df-4c10-812d-ccc8a5fde96d None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:22.702491 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58e7e6-76df-4c10-812d-ccc8a5fde96d None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:22.702786 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58e7e6-76df-4c10-812d-ccc8a5fde96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:22.721654 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-ab58e7e6-76df-4c10-812d-ccc8a5fde96d None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:22.722903 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-ab58e7e6-76df-4c10-812d-ccc8a5fde96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:22.785351 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1064/2122] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:22.793060 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad9fb8-90bd-4e52-b872-6e92e821ee05 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:22.793347 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad9fb8-90bd-4e52-b872-6e92e821ee05 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:22.793620 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad9fb8-90bd-4e52-b872-6e92e821ee05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:22.811103 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-07ad9fb8-90bd-4e52-b872-6e92e821ee05 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:22.812347 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-07ad9fb8-90bd-4e52-b872-6e92e821ee05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:22.820970 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1059/2123] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:10:22.825471 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58e7e6-76df-4c10-812d-ccc8a5fde96d None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:22.835546 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58e7e6-76df-4c10-812d-ccc8a5fde96d None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:22.840023 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f719f4-4822-4e28-93ac-b129c95f0de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:22.840661 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f719f4-4822-4e28-93ac-b129c95f0de0 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:22.840941 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f719f4-4822-4e28-93ac-b129c95f0de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:22.841216 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f719f4-4822-4e28-93ac-b129c95f0de0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:22.841931 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f719f4-4822-4e28-93ac-b129c95f0de0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:10:22.842232 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f719f4-4822-4e28-93ac-b129c95f0de0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:22.844457 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f719f4-4822-4e28-93ac-b129c95f0de0 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:22.855310 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1065/2124] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:10:22.859482 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad9fb8-90bd-4e52-b872-6e92e821ee05 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:22.868478 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad9fb8-90bd-4e52-b872-6e92e821ee05 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:22.873035 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a5910-72ea-4f9f-8b01-ad2951731416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:22.874196 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a5910-72ea-4f9f-8b01-ad2951731416 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:22.874477 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a5910-72ea-4f9f-8b01-ad2951731416 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:22.874751 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a5910-72ea-4f9f-8b01-ad2951731416 admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:22.875439 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a5910-72ea-4f9f-8b01-ad2951731416 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:22.877422 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a5910-72ea-4f9f-8b01-ad2951731416 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:22.903132 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1060/2125] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:10:22 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:10:22.907374 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f719f4-4822-4e28-93ac-b129c95f0de0 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:22.917791 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f719f4-4822-4e28-93ac-b129c95f0de0 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:22.971622 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d5de5-956c-4c0a-bef8-ac6525f4237a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:22.972242 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d5de5-956c-4c0a-bef8-ac6525f4237a admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:22.972531 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d5de5-956c-4c0a-bef8-ac6525f4237a admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:22.972812 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d5de5-956c-4c0a-bef8-ac6525f4237a admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:22.973517 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d5de5-956c-4c0a-bef8-ac6525f4237a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:22.975548 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d5de5-956c-4c0a-bef8-ac6525f4237a admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:22.997981 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1066/2126] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:10:22 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:10:23.002862 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a5910-72ea-4f9f-8b01-ad2951731416 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:23.013082 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a5910-72ea-4f9f-8b01-ad2951731416 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:23.018559 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344e2c3-92b2-4b2d-b528-2705d1a17398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:23.019204 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344e2c3-92b2-4b2d-b528-2705d1a17398 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:23.019485 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344e2c3-92b2-4b2d-b528-2705d1a17398 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:23.019786 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344e2c3-92b2-4b2d-b528-2705d1a17398 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:23.020502 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344e2c3-92b2-4b2d-b528-2705d1a17398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:23.022162 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344e2c3-92b2-4b2d-b528-2705d1a17398 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:23.033060 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1061/2127] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:10:23.036975 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d5de5-956c-4c0a-bef8-ac6525f4237a admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:23.046835 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d5de5-956c-4c0a-bef8-ac6525f4237a admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:23.051363 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60e90c-b05e-47f0-8b5b-25bf6a39b786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:23.052038 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60e90c-b05e-47f0-8b5b-25bf6a39b786 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:23.052321 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60e90c-b05e-47f0-8b5b-25bf6a39b786 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:23.052599 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60e90c-b05e-47f0-8b5b-25bf6a39b786 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:23.053310 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60e90c-b05e-47f0-8b5b-25bf6a39b786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:23.054883 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60e90c-b05e-47f0-8b5b-25bf6a39b786 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:23.065467 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1067/2128] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:10:23.069071 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344e2c3-92b2-4b2d-b528-2705d1a17398 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:23.079664 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344e2c3-92b2-4b2d-b528-2705d1a17398 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:23.084398 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4f3ad-8aaa-4012-87e2-9e2cdc78dc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:23.085325 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4f3ad-8aaa-4012-87e2-9e2cdc78dc7e admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:23.085607 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4f3ad-8aaa-4012-87e2-9e2cdc78dc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:23.085881 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4f3ad-8aaa-4012-87e2-9e2cdc78dc7e admin admin] PATH_INFO: `/v3/projects/4bb4fe0c9d6643ce886b4e3582a4c816/users/d78a9f8d6fa54845a68972977d13109b/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:23.100425 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4f3ad-8aaa-4012-87e2-9e2cdc78dc7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bb4fe0c9d6643ce886b4e3582a4c816, user_id=d78a9f8d6fa54845a68972977d13109b, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:23.103076 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4f3ad-8aaa-4012-87e2-9e2cdc78dc7e admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:23.115808 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1062/2129] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:10:23 2022] PUT /identity/v3/projects/4bb4fe0c9d6643ce886b4e3582a4c816/users/d78a9f8d6fa54845a68972977d13109b/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:23.120846 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97a2eb-f83b-4744-961f-7fa7670834a8 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:23.121138 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97a2eb-f83b-4744-961f-7fa7670834a8 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:23.121416 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97a2eb-f83b-4744-961f-7fa7670834a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:23.139248 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-2a97a2eb-f83b-4744-961f-7fa7670834a8 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:23.140986 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-2a97a2eb-f83b-4744-961f-7fa7670834a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:23.197624 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1068/2130] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:23.207552 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4f3ad-8aaa-4012-87e2-9e2cdc78dc7e admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:23.209988 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-d5d4f3ad-8aaa-4012-87e2-9e2cdc78dc7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:23.267830 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4f3ad-8aaa-4012-87e2-9e2cdc78dc7e admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:23.271612 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c1285-a62d-4bb1-b0b3-912fb00508eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:23.272281 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c1285-a62d-4bb1-b0b3-912fb00508eb service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:23.272675 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c1285-a62d-4bb1-b0b3-912fb00508eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:23.272956 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c1285-a62d-4bb1-b0b3-912fb00508eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:23.283054 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c1285-a62d-4bb1-b0b3-912fb00508eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:23.284510 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c1285-a62d-4bb1-b0b3-912fb00508eb service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:23.293753 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1063/2131] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:10:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:10:23.626220 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97a2eb-f83b-4744-961f-7fa7670834a8 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:23.627987 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-2a97a2eb-f83b-4744-961f-7fa7670834a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:23.687656 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97a2eb-f83b-4744-961f-7fa7670834a8 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:23.691277 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11e332-1a5c-4caf-be58-0262dc3ad3df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:23.691961 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11e332-1a5c-4caf-be58-0262dc3ad3df service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:23.692239 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11e332-1a5c-4caf-be58-0262dc3ad3df service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:23.692519 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11e332-1a5c-4caf-be58-0262dc3ad3df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:23.694716 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-0e11e332-1a5c-4caf-be58-0262dc3ad3df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:23.763051 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11e332-1a5c-4caf-be58-0262dc3ad3df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:23.764568 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11e332-1a5c-4caf-be58-0262dc3ad3df service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:23.774496 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1069/2132] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:10:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:10:24.407463 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c1285-a62d-4bb1-b0b3-912fb00508eb service neutron] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:24.409007 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-184c1285-a62d-4bb1-b0b3-912fb00508eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:24.422395 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c1285-a62d-4bb1-b0b3-912fb00508eb service neutron] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:24.426382 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6f427-1a2f-48bd-a202-2f7b78f6cfbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:24.427140 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6f427-1a2f-48bd-a202-2f7b78f6cfbb service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:24.427497 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6f427-1a2f-48bd-a202-2f7b78f6cfbb service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:24.427919 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6f427-1a2f-48bd-a202-2f7b78f6cfbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:24.429920 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-55b6f427-1a2f-48bd-a202-2f7b78f6cfbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:24.505050 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6f427-1a2f-48bd-a202-2f7b78f6cfbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:24.506506 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6f427-1a2f-48bd-a202-2f7b78f6cfbb service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:24.520093 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1064/2133] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:10:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:10:27.489773 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc9035-e199-4527-85d2-bbb819f5ec84 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:27.490351 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc9035-e199-4527-85d2-bbb819f5ec84 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:27.490351 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc9035-e199-4527-85d2-bbb819f5ec84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:27.537192 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-b3dc9035-e199-4527-85d2-bbb819f5ec84 None None] MFA Rules not processed for user `d78a9f8d6fa54845a68972977d13109b`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:27.539667 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-b3dc9035-e199-4527-85d2-bbb819f5ec84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:27.687483 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1070/2134] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:27.724163 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6f427-1a2f-48bd-a202-2f7b78f6cfbb service cinder] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:27.728656 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-55b6f427-1a2f-48bd-a202-2f7b78f6cfbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:27.827329 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6f427-1a2f-48bd-a202-2f7b78f6cfbb service cinder] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:27.833187 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e800c9-c03b-4b4d-a961-827a09ac75d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:27.834967 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e800c9-c03b-4b4d-a961-827a09ac75d5 service nova] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:27.835302 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e800c9-c03b-4b4d-a961-827a09ac75d5 service nova] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:27.835635 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e800c9-c03b-4b4d-a961-827a09ac75d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:27.844812 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e800c9-c03b-4b4d-a961-827a09ac75d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:27.846808 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e800c9-c03b-4b4d-a961-827a09ac75d5 service nova] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:27.857370 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1065/2135] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:10:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:10:28.825563 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc9035-e199-4527-85d2-bbb819f5ec84 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:28.827554 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-b3dc9035-e199-4527-85d2-bbb819f5ec84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:28.841614 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc9035-e199-4527-85d2-bbb819f5ec84 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:28.847486 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32858e-4ada-40ab-bddd-a2be54030068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:28.848636 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32858e-4ada-40ab-bddd-a2be54030068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:28.849205 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32858e-4ada-40ab-bddd-a2be54030068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:28.849860 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32858e-4ada-40ab-bddd-a2be54030068 admin admin] PATH_INFO: `/v3/users/0b13f0495e084771a0c5fb878871fdc3` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:28.851472 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32858e-4ada-40ab-bddd-a2be54030068 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b13f0495e084771a0c5fb878871fdc3)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:28.853185 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32858e-4ada-40ab-bddd-a2be54030068 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:28.906131 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-ee32858e-4ada-40ab-bddd-a2be54030068 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b13f0495e084771a0c5fb878871fdc3'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:28.906914 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-ee32858e-4ada-40ab-bddd-a2be54030068 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b13f0495e084771a0c5fb878871fdc3'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:28.914741 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-ee32858e-4ada-40ab-bddd-a2be54030068 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b13f0495e084771a0c5fb878871fdc3'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:28.926329 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-ee32858e-4ada-40ab-bddd-a2be54030068 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b13f0495e084771a0c5fb878871fdc3'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:28.927171 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-ee32858e-4ada-40ab-bddd-a2be54030068 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b13f0495e084771a0c5fb878871fdc3'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:28.948140 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1071/2136] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:10:28 2022] DELETE /identity/v3/users/0b13f0495e084771a0c5fb878871fdc3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:28.950921 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd12e5-953d-43af-b5a4-5ffa08014beb None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:28.951556 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd12e5-953d-43af-b5a4-5ffa08014beb None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:28.951556 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd12e5-953d-43af-b5a4-5ffa08014beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:28.969550 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-5ddd12e5-953d-43af-b5a4-5ffa08014beb None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:28.971061 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-5ddd12e5-953d-43af-b5a4-5ffa08014beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:29.042555 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1066/2137] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:29.052185 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32858e-4ada-40ab-bddd-a2be54030068 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:29.053620 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-ee32858e-4ada-40ab-bddd-a2be54030068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:29.129063 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32858e-4ada-40ab-bddd-a2be54030068 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:29.133910 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4a942-56e0-4a7d-9599-63b1e5b6b312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:29.135715 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4a942-56e0-4a7d-9599-63b1e5b6b312 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:29.136170 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4a942-56e0-4a7d-9599-63b1e5b6b312 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:29.136648 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b4a942-56e0-4a7d-9599-63b1e5b6b312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:29.148900 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b4a942-56e0-4a7d-9599-63b1e5b6b312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:29.150400 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b4a942-56e0-4a7d-9599-63b1e5b6b312 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:29.162499 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1072/2138] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:10:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:10:29.387996 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef349b55-4ee9-4229-9536-121c1e79d936 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:29.388284 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef349b55-4ee9-4229-9536-121c1e79d936 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:29.388729 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef349b55-4ee9-4229-9536-121c1e79d936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:29.411036 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-ef349b55-4ee9-4229-9536-121c1e79d936 None None] MFA Rules not processed for user `d78a9f8d6fa54845a68972977d13109b`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:29.412399 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-ef349b55-4ee9-4229-9536-121c1e79d936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:29.462079 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4a942-56e0-4a7d-9599-63b1e5b6b312 service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:29.466867 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-61b4a942-56e0-4a7d-9599-63b1e5b6b312 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:29.481397 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b4a942-56e0-4a7d-9599-63b1e5b6b312 service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:29.493098 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87bee22-13e8-449e-9e98-cd52af082684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:29.494756 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bee22-13e8-449e-9e98-cd52af082684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:29.495034 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bee22-13e8-449e-9e98-cd52af082684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:29.498415 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bee22-13e8-449e-9e98-cd52af082684 admin admin] PATH_INFO: `/v3/projects/895bfd648abe44c49ed270791ce86e42` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:29.500323 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87bee22-13e8-449e-9e98-cd52af082684 admin admin] RBAC: Authorizing `identity:delete_project(project_id=895bfd648abe44c49ed270791ce86e42)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:29.503659 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87bee22-13e8-449e-9e98-cd52af082684 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:29.506259 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1067/2139] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:29.566827 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-f87bee22-13e8-449e-9e98-cd52af082684 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '895bfd648abe44c49ed270791ce86e42', 'request_id': 'req-f87bee22-13e8-449e-9e98-cd52af082684'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:29.573939 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-f87bee22-13e8-449e-9e98-cd52af082684 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '895bfd648abe44c49ed270791ce86e42', 'request_id': 'req-f87bee22-13e8-449e-9e98-cd52af082684'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:29.582606 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-f87bee22-13e8-449e-9e98-cd52af082684 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '895bfd648abe44c49ed270791ce86e42', 'request_id': 'req-f87bee22-13e8-449e-9e98-cd52af082684'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:29.611434 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-f87bee22-13e8-449e-9e98-cd52af082684 admin admin] The token cache is being invalidate because project 895bfd648abe44c49ed270791ce86e42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:10:29.611768 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-f87bee22-13e8-449e-9e98-cd52af082684 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:29.612420 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-f87bee22-13e8-449e-9e98-cd52af082684 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:29.614376 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1073/2140] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:10:29 2022] DELETE /identity/v3/projects/895bfd648abe44c49ed270791ce86e42 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:10:29.618114 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef349b55-4ee9-4229-9536-121c1e79d936 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:29.632182 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef349b55-4ee9-4229-9536-121c1e79d936 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:29.696889 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b5b6e-e90c-45a9-b3b6-1906a7ac57d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:29.697783 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b5b6e-e90c-45a9-b3b6-1906a7ac57d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:29.698064 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b5b6e-e90c-45a9-b3b6-1906a7ac57d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:29.698339 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b5b6e-e90c-45a9-b3b6-1906a7ac57d0 admin admin] PATH_INFO: `/v3/users/14deabdc6fa04400bcf00377fe0438c6` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:29.699557 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b5b6e-e90c-45a9-b3b6-1906a7ac57d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14deabdc6fa04400bcf00377fe0438c6)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:29.701597 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b5b6e-e90c-45a9-b3b6-1906a7ac57d0 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:29.751877 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-a65b5b6e-e90c-45a9-b3b6-1906a7ac57d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14deabdc6fa04400bcf00377fe0438c6'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:29.758645 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-a65b5b6e-e90c-45a9-b3b6-1906a7ac57d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14deabdc6fa04400bcf00377fe0438c6'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:29.767261 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-a65b5b6e-e90c-45a9-b3b6-1906a7ac57d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14deabdc6fa04400bcf00377fe0438c6'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:29.779146 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-a65b5b6e-e90c-45a9-b3b6-1906a7ac57d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14deabdc6fa04400bcf00377fe0438c6'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:29.780343 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-a65b5b6e-e90c-45a9-b3b6-1906a7ac57d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14deabdc6fa04400bcf00377fe0438c6'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:29.786098 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1068/2141] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:10:29 2022] DELETE /identity/v3/users/14deabdc6fa04400bcf00377fe0438c6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:30.105437 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87bee22-13e8-449e-9e98-cd52af082684 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:30.107065 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-f87bee22-13e8-449e-9e98-cd52af082684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:30.126031 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87bee22-13e8-449e-9e98-cd52af082684 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:30.193243 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b91aed-e737-4548-aeef-eefdff49ae33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:30.194229 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b91aed-e737-4548-aeef-eefdff49ae33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:30.194518 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b91aed-e737-4548-aeef-eefdff49ae33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:30.194800 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b91aed-e737-4548-aeef-eefdff49ae33 admin admin] PATH_INFO: `/v3/projects/90527cb8063a4ea2a2373a384623c2cc` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:30.196376 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b91aed-e737-4548-aeef-eefdff49ae33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90527cb8063a4ea2a2373a384623c2cc)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:30.198348 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b91aed-e737-4548-aeef-eefdff49ae33 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:30.256962 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c4b91aed-e737-4548-aeef-eefdff49ae33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90527cb8063a4ea2a2373a384623c2cc', 'request_id': 'req-c4b91aed-e737-4548-aeef-eefdff49ae33'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:30.263148 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c4b91aed-e737-4548-aeef-eefdff49ae33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90527cb8063a4ea2a2373a384623c2cc', 'request_id': 'req-c4b91aed-e737-4548-aeef-eefdff49ae33'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:30.270028 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c4b91aed-e737-4548-aeef-eefdff49ae33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90527cb8063a4ea2a2373a384623c2cc', 'request_id': 'req-c4b91aed-e737-4548-aeef-eefdff49ae33'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:30.285765 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c4b91aed-e737-4548-aeef-eefdff49ae33 admin admin] The token cache is being invalidate because project 90527cb8063a4ea2a2373a384623c2cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:10:30.286307 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c4b91aed-e737-4548-aeef-eefdff49ae33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:30.286967 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c4b91aed-e737-4548-aeef-eefdff49ae33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:30.288606 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1074/2142] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:10:30 2022] DELETE /identity/v3/projects/90527cb8063a4ea2a2373a384623c2cc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:10:30.292674 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b5b6e-e90c-45a9-b3b6-1906a7ac57d0 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:30.294039 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-a65b5b6e-e90c-45a9-b3b6-1906a7ac57d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:30.314957 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b5b6e-e90c-45a9-b3b6-1906a7ac57d0 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:30.393212 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741afd7-15f3-4680-913c-7c4d6a272402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:30.394555 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741afd7-15f3-4680-913c-7c4d6a272402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:30.394989 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741afd7-15f3-4680-913c-7c4d6a272402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:30.395403 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741afd7-15f3-4680-913c-7c4d6a272402 admin admin] PATH_INFO: `/v3/users/25168ec5522b44bdbb91a3cd0f3b1a17` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:30.397210 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741afd7-15f3-4680-913c-7c4d6a272402 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25168ec5522b44bdbb91a3cd0f3b1a17)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:30.399548 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741afd7-15f3-4680-913c-7c4d6a272402 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:30.447004 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-1741afd7-15f3-4680-913c-7c4d6a272402 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25168ec5522b44bdbb91a3cd0f3b1a17'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:30.454229 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-1741afd7-15f3-4680-913c-7c4d6a272402 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25168ec5522b44bdbb91a3cd0f3b1a17'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:30.461642 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-1741afd7-15f3-4680-913c-7c4d6a272402 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25168ec5522b44bdbb91a3cd0f3b1a17'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:30.474824 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-1741afd7-15f3-4680-913c-7c4d6a272402 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25168ec5522b44bdbb91a3cd0f3b1a17'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:30.475562 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-1741afd7-15f3-4680-913c-7c4d6a272402 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25168ec5522b44bdbb91a3cd0f3b1a17'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:30.481725 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1069/2143] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:10:30 2022] DELETE /identity/v3/users/25168ec5522b44bdbb91a3cd0f3b1a17 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:30.780452 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b91aed-e737-4548-aeef-eefdff49ae33 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:30.781897 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-c4b91aed-e737-4548-aeef-eefdff49ae33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:30.797076 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b91aed-e737-4548-aeef-eefdff49ae33 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:30.856971 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32799586-496f-448b-998c-341cad5fc4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:30.858303 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32799586-496f-448b-998c-341cad5fc4db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:30.858571 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32799586-496f-448b-998c-341cad5fc4db admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:30.859058 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32799586-496f-448b-998c-341cad5fc4db admin admin] PATH_INFO: `/v3/projects/5885d3e5cb9e4c689ffcfcaf3d2ed48a` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:30.860036 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32799586-496f-448b-998c-341cad5fc4db admin admin] RBAC: Authorizing `identity:delete_project(project_id=5885d3e5cb9e4c689ffcfcaf3d2ed48a)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:30.861964 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32799586-496f-448b-998c-341cad5fc4db admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:30.938928 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-32799586-496f-448b-998c-341cad5fc4db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5885d3e5cb9e4c689ffcfcaf3d2ed48a', 'request_id': 'req-32799586-496f-448b-998c-341cad5fc4db'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:30.944491 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-32799586-496f-448b-998c-341cad5fc4db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5885d3e5cb9e4c689ffcfcaf3d2ed48a', 'request_id': 'req-32799586-496f-448b-998c-341cad5fc4db'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:30.950436 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-32799586-496f-448b-998c-341cad5fc4db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5885d3e5cb9e4c689ffcfcaf3d2ed48a', 'request_id': 'req-32799586-496f-448b-998c-341cad5fc4db'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:30.971519 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-32799586-496f-448b-998c-341cad5fc4db admin admin] The token cache is being invalidate because project 5885d3e5cb9e4c689ffcfcaf3d2ed48a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:10:30.971861 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-32799586-496f-448b-998c-341cad5fc4db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:30.972647 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-32799586-496f-448b-998c-341cad5fc4db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:10:30.974530 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1075/2144] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:10:30 2022] DELETE /identity/v3/projects/5885d3e5cb9e4c689ffcfcaf3d2ed48a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:10:30.979615 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49accc-4ec1-4c74-8f12-37e60d042ba4 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:30.980023 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49accc-4ec1-4c74-8f12-37e60d042ba4 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:30.980327 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49accc-4ec1-4c74-8f12-37e60d042ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:30.999724 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-cf49accc-4ec1-4c74-8f12-37e60d042ba4 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:31.000929 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-cf49accc-4ec1-4c74-8f12-37e60d042ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:31.061872 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1070/2145] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:31.070636 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3076d56-99b0-452b-8daf-67f6d2189b83 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:31.071412 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3076d56-99b0-452b-8daf-67f6d2189b83 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:31.071926 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3076d56-99b0-452b-8daf-67f6d2189b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:31.090622 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-e3076d56-99b0-452b-8daf-67f6d2189b83 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:31.091884 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-e3076d56-99b0-452b-8daf-67f6d2189b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:31.099946 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1076/2146] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:31.104232 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49accc-4ec1-4c74-8f12-37e60d042ba4 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:31.114512 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49accc-4ec1-4c74-8f12-37e60d042ba4 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:31.119487 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f3939-3280-498a-9d95-6b15a9193c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:31.120083 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f3939-3280-498a-9d95-6b15a9193c36 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:31.120467 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f3939-3280-498a-9d95-6b15a9193c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:31.120750 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f3939-3280-498a-9d95-6b15a9193c36 admin admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:31.121618 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f3939-3280-498a-9d95-6b15a9193c36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:10:31.121931 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f3939-3280-498a-9d95-6b15a9193c36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:31.124665 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f3939-3280-498a-9d95-6b15a9193c36 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:31.143768 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1071/2147] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:10:31.145722 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3076d56-99b0-452b-8daf-67f6d2189b83 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:31.158246 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3076d56-99b0-452b-8daf-67f6d2189b83 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:31.164300 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2fb58-949a-4399-9810-472dd8a944fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:31.164977 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2fb58-949a-4399-9810-472dd8a944fc admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:31.165263 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2fb58-949a-4399-9810-472dd8a944fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:31.165547 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2fb58-949a-4399-9810-472dd8a944fc admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:31.166267 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2fb58-949a-4399-9810-472dd8a944fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:31.168264 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2fb58-949a-4399-9810-472dd8a944fc admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:31.196331 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1077/2148] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:10:31 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:10:31.200457 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f3939-3280-498a-9d95-6b15a9193c36 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:31.210776 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f3939-3280-498a-9d95-6b15a9193c36 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:31.273230 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe99b66-a913-4cfa-b3ee-9f4a21513653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:31.274017 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe99b66-a913-4cfa-b3ee-9f4a21513653 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:31.274302 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe99b66-a913-4cfa-b3ee-9f4a21513653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:31.274579 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe99b66-a913-4cfa-b3ee-9f4a21513653 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:31.275282 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe99b66-a913-4cfa-b3ee-9f4a21513653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:31.277884 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe99b66-a913-4cfa-b3ee-9f4a21513653 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:31.302139 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1072/2149] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:10:31 2022] POST /identity/v3/users => generated 282 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:10:31.306420 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2fb58-949a-4399-9810-472dd8a944fc admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:31.317234 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2fb58-949a-4399-9810-472dd8a944fc admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:31.322333 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13165bb1-7135-4b04-95ef-bc46a1534152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:31.323147 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13165bb1-7135-4b04-95ef-bc46a1534152 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:31.323450 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13165bb1-7135-4b04-95ef-bc46a1534152 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:31.324304 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13165bb1-7135-4b04-95ef-bc46a1534152 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:31.324886 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13165bb1-7135-4b04-95ef-bc46a1534152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:31.326268 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13165bb1-7135-4b04-95ef-bc46a1534152 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:31.337923 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1078/2150] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:10:31.342675 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe99b66-a913-4cfa-b3ee-9f4a21513653 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:31.354211 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe99b66-a913-4cfa-b3ee-9f4a21513653 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:31.359717 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead2adf-103c-404d-a41f-b169e048e99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:31.360410 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead2adf-103c-404d-a41f-b169e048e99c admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:31.360694 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead2adf-103c-404d-a41f-b169e048e99c admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:31.360972 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead2adf-103c-404d-a41f-b169e048e99c admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:31.361704 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead2adf-103c-404d-a41f-b169e048e99c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:31.363291 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead2adf-103c-404d-a41f-b169e048e99c admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:31.374128 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1073/2151] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:10:31.378445 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13165bb1-7135-4b04-95ef-bc46a1534152 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:31.388672 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13165bb1-7135-4b04-95ef-bc46a1534152 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:31.393365 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd55be-860a-4e98-ad04-6581d1949a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:31.394325 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd55be-860a-4e98-ad04-6581d1949a2b admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:31.394615 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd55be-860a-4e98-ad04-6581d1949a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:31.394891 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd55be-860a-4e98-ad04-6581d1949a2b admin admin] PATH_INFO: `/v3/projects/45cd2870877349388ef2f5e02aff149f/users/16235d3b35a04bc39fe08a4ce8cefc5d/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:31.410396 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd55be-860a-4e98-ad04-6581d1949a2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=45cd2870877349388ef2f5e02aff149f, user_id=16235d3b35a04bc39fe08a4ce8cefc5d, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:31.413133 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd55be-860a-4e98-ad04-6581d1949a2b admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:31.428777 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1079/2152] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:10:31 2022] PUT /identity/v3/projects/45cd2870877349388ef2f5e02aff149f/users/16235d3b35a04bc39fe08a4ce8cefc5d/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:10:31.439332 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819f373-0bcc-4cef-8ffb-d005ecdabda8 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:31.439630 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819f373-0bcc-4cef-8ffb-d005ecdabda8 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:31.440064 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819f373-0bcc-4cef-8ffb-d005ecdabda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:31.476597 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-1819f373-0bcc-4cef-8ffb-d005ecdabda8 None None] MFA Rules not processed for user `16235d3b35a04bc39fe08a4ce8cefc5d`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:10:31.477869 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-1819f373-0bcc-4cef-8ffb-d005ecdabda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:31.566032 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1074/2153] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:10:31 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:10:31.578941 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd55be-860a-4e98-ad04-6581d1949a2b admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:10:31.581193 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-3fdd55be-860a-4e98-ad04-6581d1949a2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:10:31.659857 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd55be-860a-4e98-ad04-6581d1949a2b admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:10:31.666459 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4161dac-c0ff-41b1-b4f6-4cee4be6dfd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:10:31.667282 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4161dac-c0ff-41b1-b4f6-4cee4be6dfd8 service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:10:31.667598 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4161dac-c0ff-41b1-b4f6-4cee4be6dfd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:10:31.667930 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4161dac-c0ff-41b1-b4f6-4cee4be6dfd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:10:31.677521 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4161dac-c0ff-41b1-b4f6-4cee4be6dfd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:10:31.679255 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4161dac-c0ff-41b1-b4f6-4cee4be6dfd8 service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:10:31.688632 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1080/2154] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:10:31 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:11:02.407066 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819f373-0bcc-4cef-8ffb-d005ecdabda8 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:02.408478 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-1819f373-0bcc-4cef-8ffb-d005ecdabda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:02.470477 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819f373-0bcc-4cef-8ffb-d005ecdabda8 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:02.475072 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634ddca-e060-4363-8d24-ff9b748e11e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:02.475989 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634ddca-e060-4363-8d24-ff9b748e11e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:02.476269 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634ddca-e060-4363-8d24-ff9b748e11e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:02.476543 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634ddca-e060-4363-8d24-ff9b748e11e1 admin admin] PATH_INFO: `/v3/users/293ab89ef6454bedb8788ae6df8cefb1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:02.477766 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634ddca-e060-4363-8d24-ff9b748e11e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=293ab89ef6454bedb8788ae6df8cefb1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:02.479698 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634ddca-e060-4363-8d24-ff9b748e11e1 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:02.524101 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-2634ddca-e060-4363-8d24-ff9b748e11e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '293ab89ef6454bedb8788ae6df8cefb1'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:02.530837 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-2634ddca-e060-4363-8d24-ff9b748e11e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '293ab89ef6454bedb8788ae6df8cefb1'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:02.537802 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-2634ddca-e060-4363-8d24-ff9b748e11e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '293ab89ef6454bedb8788ae6df8cefb1'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:02.549166 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-2634ddca-e060-4363-8d24-ff9b748e11e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '293ab89ef6454bedb8788ae6df8cefb1'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:02.549801 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-2634ddca-e060-4363-8d24-ff9b748e11e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '293ab89ef6454bedb8788ae6df8cefb1'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:02.555422 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1075/2155] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:11:02 2022] DELETE /identity/v3/users/293ab89ef6454bedb8788ae6df8cefb1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:11:02.559813 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee96c0a-8242-4462-9a31-23cf07f234be None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:02.560285 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee96c0a-8242-4462-9a31-23cf07f234be None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:02.560376 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee96c0a-8242-4462-9a31-23cf07f234be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:02.578210 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-cee96c0a-8242-4462-9a31-23cf07f234be None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:11:02.579412 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-cee96c0a-8242-4462-9a31-23cf07f234be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:02.622889 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634ddca-e060-4363-8d24-ff9b748e11e1 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:02.624895 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-2634ddca-e060-4363-8d24-ff9b748e11e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:02.641054 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1081/2156] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:11:02.651864 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee96c0a-8242-4462-9a31-23cf07f234be None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:02.653759 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-cee96c0a-8242-4462-9a31-23cf07f234be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:02.699756 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634ddca-e060-4363-8d24-ff9b748e11e1 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:02.705333 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c11fb4-b511-4376-957f-23c96e4cfe0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:02.706335 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c11fb4-b511-4376-957f-23c96e4cfe0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:02.706621 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c11fb4-b511-4376-957f-23c96e4cfe0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:02.706894 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c11fb4-b511-4376-957f-23c96e4cfe0f admin admin] PATH_INFO: `/v3/users/45cf2abc0a4147ae89ffdc4489ff3a91` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:02.708127 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c11fb4-b511-4376-957f-23c96e4cfe0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=45cf2abc0a4147ae89ffdc4489ff3a91)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:02.710210 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c11fb4-b511-4376-957f-23c96e4cfe0f admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:02.720789 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee96c0a-8242-4462-9a31-23cf07f234be None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:02.725830 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18c9ba-af5c-494e-aa87-a0ee5a4c4f06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:02.730268 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18c9ba-af5c-494e-aa87-a0ee5a4c4f06 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:02.730657 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18c9ba-af5c-494e-aa87-a0ee5a4c4f06 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:02.731027 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18c9ba-af5c-494e-aa87-a0ee5a4c4f06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:02.743465 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18c9ba-af5c-494e-aa87-a0ee5a4c4f06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:02.745027 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af18c9ba-af5c-494e-aa87-a0ee5a4c4f06 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:02.755076 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1082/2157] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:11:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:11:02.762295 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b2c11fb4-b511-4376-957f-23c96e4cfe0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45cf2abc0a4147ae89ffdc4489ff3a91'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:02.769868 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b2c11fb4-b511-4376-957f-23c96e4cfe0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45cf2abc0a4147ae89ffdc4489ff3a91'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:02.778643 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b2c11fb4-b511-4376-957f-23c96e4cfe0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45cf2abc0a4147ae89ffdc4489ff3a91'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:02.795169 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b2c11fb4-b511-4376-957f-23c96e4cfe0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45cf2abc0a4147ae89ffdc4489ff3a91'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:02.796646 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b2c11fb4-b511-4376-957f-23c96e4cfe0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45cf2abc0a4147ae89ffdc4489ff3a91'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:02.803328 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1076/2158] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:11:02 2022] DELETE /identity/v3/users/45cf2abc0a4147ae89ffdc4489ff3a91 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:11:02.808297 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ae6df-dfaf-4451-babd-33522eb12358 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:02.808717 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ae6df-dfaf-4451-babd-33522eb12358 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:02.809116 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ae6df-dfaf-4451-babd-33522eb12358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:02.828333 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56194cce-fdd7-4cb8-ace1-cae03ef44d89 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:02.829679 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56194cce-fdd7-4cb8-ace1-cae03ef44d89 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:02.829679 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56194cce-fdd7-4cb8-ace1-cae03ef44d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:02.841042 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-eb1ae6df-dfaf-4451-babd-33522eb12358 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:11:02.842381 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-eb1ae6df-dfaf-4451-babd-33522eb12358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:02.850406 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-56194cce-fdd7-4cb8-ace1-cae03ef44d89 None None] MFA Rules not processed for user `5f23f76aa53f43b29425ef6b46bc41c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:11:02.851633 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-56194cce-fdd7-4cb8-ace1-cae03ef44d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:02.911240 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1077/2159] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:11:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:11:02.912873 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1083/2160] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:11:02.924608 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56194cce-fdd7-4cb8-ace1-cae03ef44d89 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:02.926055 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-56194cce-fdd7-4cb8-ace1-cae03ef44d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:02.996467 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56194cce-fdd7-4cb8-ace1-cae03ef44d89 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:03.001143 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04df886-b8bc-4b34-8831-2b2797dad114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:03.001868 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04df886-b8bc-4b34-8831-2b2797dad114 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:03.002220 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04df886-b8bc-4b34-8831-2b2797dad114 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:03.002560 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04df886-b8bc-4b34-8831-2b2797dad114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:03.014096 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04df886-b8bc-4b34-8831-2b2797dad114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:03.016127 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04df886-b8bc-4b34-8831-2b2797dad114 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:03.026994 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1078/2161] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:11:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:11:03.122923 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ae6df-dfaf-4451-babd-33522eb12358 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:03.125560 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-eb1ae6df-dfaf-4451-babd-33522eb12358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:03.138216 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ae6df-dfaf-4451-babd-33522eb12358 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:03.145631 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cf5b0-d3d4-446a-b875-70b3090230a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:03.146630 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cf5b0-d3d4-446a-b875-70b3090230a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:03.147369 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cf5b0-d3d4-446a-b875-70b3090230a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:03.147504 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cf5b0-d3d4-446a-b875-70b3090230a6 admin admin] PATH_INFO: `/v3/projects/cf0d035d2bc54ff5b6bcafa0d3833387` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:03.149271 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74cf5b0-d3d4-446a-b875-70b3090230a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf0d035d2bc54ff5b6bcafa0d3833387)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:03.151450 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74cf5b0-d3d4-446a-b875-70b3090230a6 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:03.236251 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b74cf5b0-d3d4-446a-b875-70b3090230a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf0d035d2bc54ff5b6bcafa0d3833387', 'request_id': 'req-b74cf5b0-d3d4-446a-b875-70b3090230a6'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:03.242886 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b74cf5b0-d3d4-446a-b875-70b3090230a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf0d035d2bc54ff5b6bcafa0d3833387', 'request_id': 'req-b74cf5b0-d3d4-446a-b875-70b3090230a6'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:03.253283 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b74cf5b0-d3d4-446a-b875-70b3090230a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf0d035d2bc54ff5b6bcafa0d3833387', 'request_id': 'req-b74cf5b0-d3d4-446a-b875-70b3090230a6'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:03.268523 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b74cf5b0-d3d4-446a-b875-70b3090230a6 admin admin] The token cache is being invalidate because project cf0d035d2bc54ff5b6bcafa0d3833387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:11:03.269548 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b74cf5b0-d3d4-446a-b875-70b3090230a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:03.270869 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b74cf5b0-d3d4-446a-b875-70b3090230a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:03.272891 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1084/2162] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:11:03 2022] DELETE /identity/v3/projects/cf0d035d2bc54ff5b6bcafa0d3833387 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:11:03.446749 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04df886-b8bc-4b34-8831-2b2797dad114 service neutron] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:03.448505 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-e04df886-b8bc-4b34-8831-2b2797dad114 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:03.472810 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04df886-b8bc-4b34-8831-2b2797dad114 service neutron] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:03.533450 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c38e3-cc72-4aa6-b604-d0821a1b765b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:03.534225 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c38e3-cc72-4aa6-b604-d0821a1b765b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:03.534501 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c38e3-cc72-4aa6-b604-d0821a1b765b admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:03.534770 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c38e3-cc72-4aa6-b604-d0821a1b765b admin admin] PATH_INFO: `/v3/projects/538aa8b7b9644301b438d131def60cd4` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:03.535974 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c38e3-cc72-4aa6-b604-d0821a1b765b admin admin] RBAC: Authorizing `identity:delete_project(project_id=538aa8b7b9644301b438d131def60cd4)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:03.537878 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c38e3-cc72-4aa6-b604-d0821a1b765b admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:03.583540 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-f67c38e3-cc72-4aa6-b604-d0821a1b765b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '538aa8b7b9644301b438d131def60cd4', 'request_id': 'req-f67c38e3-cc72-4aa6-b604-d0821a1b765b'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:03.590404 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-f67c38e3-cc72-4aa6-b604-d0821a1b765b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '538aa8b7b9644301b438d131def60cd4', 'request_id': 'req-f67c38e3-cc72-4aa6-b604-d0821a1b765b'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:03.597647 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-f67c38e3-cc72-4aa6-b604-d0821a1b765b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '538aa8b7b9644301b438d131def60cd4', 'request_id': 'req-f67c38e3-cc72-4aa6-b604-d0821a1b765b'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:03.609830 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-f67c38e3-cc72-4aa6-b604-d0821a1b765b admin admin] The token cache is being invalidate because project 538aa8b7b9644301b438d131def60cd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:11:03.610118 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-f67c38e3-cc72-4aa6-b604-d0821a1b765b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:03.610735 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-f67c38e3-cc72-4aa6-b604-d0821a1b765b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:03.612357 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1079/2163] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:11:03 2022] DELETE /identity/v3/projects/538aa8b7b9644301b438d131def60cd4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:11:03.617840 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c529d-3b9f-4928-af43-ea59e3743e08 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:03.618297 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c529d-3b9f-4928-af43-ea59e3743e08 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:03.618492 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c529d-3b9f-4928-af43-ea59e3743e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:03.637956 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-b03c529d-3b9f-4928-af43-ea59e3743e08 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:11:03.644364 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-b03c529d-3b9f-4928-af43-ea59e3743e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:03.718507 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1085/2164] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:11:03.726329 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7d5f6-5466-4036-ab89-d726e3f4ca70 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:03.726615 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7d5f6-5466-4036-ab89-d726e3f4ca70 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:03.726889 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7d5f6-5466-4036-ab89-d726e3f4ca70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:03.744910 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-aed7d5f6-5466-4036-ab89-d726e3f4ca70 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:11:03.746196 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-aed7d5f6-5466-4036-ab89-d726e3f4ca70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:03.756445 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1080/2165] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:11:03.760500 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c529d-3b9f-4928-af43-ea59e3743e08 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:03.770894 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c529d-3b9f-4928-af43-ea59e3743e08 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:03.775577 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9943c-a4c5-4314-8966-3c187951b106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:03.776272 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9943c-a4c5-4314-8966-3c187951b106 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:03.776555 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9943c-a4c5-4314-8966-3c187951b106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:03.776834 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9943c-a4c5-4314-8966-3c187951b106 admin admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:03.777565 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9943c-a4c5-4314-8966-3c187951b106 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:11:03.777872 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9943c-a4c5-4314-8966-3c187951b106 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:03.779484 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9943c-a4c5-4314-8966-3c187951b106 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:03.792040 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1086/2166] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:11:03.796129 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7d5f6-5466-4036-ab89-d726e3f4ca70 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:03.805676 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7d5f6-5466-4036-ab89-d726e3f4ca70 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:03.812370 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2ed66-60a9-4265-93f2-daeb039f4d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:03.813027 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2ed66-60a9-4265-93f2-daeb039f4d08 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:03.813309 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2ed66-60a9-4265-93f2-daeb039f4d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:03.813604 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2ed66-60a9-4265-93f2-daeb039f4d08 admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:03.814282 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2ed66-60a9-4265-93f2-daeb039f4d08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:03.816202 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2ed66-60a9-4265-93f2-daeb039f4d08 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:03.847728 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1081/2167] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:11:03 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:11:03.849290 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9943c-a4c5-4314-8966-3c187951b106 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:03.859496 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9943c-a4c5-4314-8966-3c187951b106 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:03.918958 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556e96f-87e2-46bc-9515-f3d6a3da10ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:03.919635 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556e96f-87e2-46bc-9515-f3d6a3da10ee admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:03.919944 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556e96f-87e2-46bc-9515-f3d6a3da10ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:03.920219 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556e96f-87e2-46bc-9515-f3d6a3da10ee admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:03.920920 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556e96f-87e2-46bc-9515-f3d6a3da10ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:03.922993 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556e96f-87e2-46bc-9515-f3d6a3da10ee admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:03.942860 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1087/2168] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:11:03 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:11:03.949498 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2ed66-60a9-4265-93f2-daeb039f4d08 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:03.961116 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2ed66-60a9-4265-93f2-daeb039f4d08 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:03.966111 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729b14c-126d-4395-afcc-9bb27a784a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:03.967115 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729b14c-126d-4395-afcc-9bb27a784a1d admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:03.967558 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729b14c-126d-4395-afcc-9bb27a784a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:03.968512 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729b14c-126d-4395-afcc-9bb27a784a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:03.969400 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729b14c-126d-4395-afcc-9bb27a784a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:03.971806 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729b14c-126d-4395-afcc-9bb27a784a1d admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:03.983587 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1082/2169] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:11:03.987808 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556e96f-87e2-46bc-9515-f3d6a3da10ee admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:03.998684 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556e96f-87e2-46bc-9515-f3d6a3da10ee admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:04.003539 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31031d79-cd45-450e-9d01-185c2def346c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:04.004308 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31031d79-cd45-450e-9d01-185c2def346c admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:04.004655 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31031d79-cd45-450e-9d01-185c2def346c admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:04.005223 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31031d79-cd45-450e-9d01-185c2def346c admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:04.006081 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31031d79-cd45-450e-9d01-185c2def346c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:04.007784 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31031d79-cd45-450e-9d01-185c2def346c admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:04.020896 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1088/2170] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:11:04.025235 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729b14c-126d-4395-afcc-9bb27a784a1d admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:04.037618 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729b14c-126d-4395-afcc-9bb27a784a1d admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:04.042394 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1b897-621c-4db0-b7e4-cb3faa0865e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:04.043449 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1b897-621c-4db0-b7e4-cb3faa0865e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:04.043777 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1b897-621c-4db0-b7e4-cb3faa0865e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:04.044059 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1b897-621c-4db0-b7e4-cb3faa0865e2 admin admin] PATH_INFO: `/v3/projects/170c79cfe27b4db1b0a3d217ce2f0526/users/04567d9e07624b67a242b6c4bf00ce0f/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:04.059069 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1b897-621c-4db0-b7e4-cb3faa0865e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=170c79cfe27b4db1b0a3d217ce2f0526, user_id=04567d9e07624b67a242b6c4bf00ce0f, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:04.062254 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1b897-621c-4db0-b7e4-cb3faa0865e2 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:04.084082 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1083/2171] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:11:04 2022] PUT /identity/v3/projects/170c79cfe27b4db1b0a3d217ce2f0526/users/04567d9e07624b67a242b6c4bf00ce0f/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:11:04.094202 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3a27b-bdf5-4e03-b2af-f524f6f31b8e None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:04.094494 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3a27b-bdf5-4e03-b2af-f524f6f31b8e None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:04.094775 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3a27b-bdf5-4e03-b2af-f524f6f31b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:04.123067 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-def3a27b-bdf5-4e03-b2af-f524f6f31b8e None None] MFA Rules not processed for user `04567d9e07624b67a242b6c4bf00ce0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:11:04.124911 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-def3a27b-bdf5-4e03-b2af-f524f6f31b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:04.191828 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1089/2172] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:11:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:11:04.204217 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1b897-621c-4db0-b7e4-cb3faa0865e2 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:04.205903 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-17c1b897-621c-4db0-b7e4-cb3faa0865e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:04.263442 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1b897-621c-4db0-b7e4-cb3faa0865e2 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:04.267030 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b663750-4999-4b07-9eab-08c99dcc9d9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:04.267670 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b663750-4999-4b07-9eab-08c99dcc9d9c service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:04.268001 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b663750-4999-4b07-9eab-08c99dcc9d9c service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:04.268279 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b663750-4999-4b07-9eab-08c99dcc9d9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:04.276947 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b663750-4999-4b07-9eab-08c99dcc9d9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:04.278408 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b663750-4999-4b07-9eab-08c99dcc9d9c service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:04.295726 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1084/2173] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:11:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:11:06.835180 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3a27b-bdf5-4e03-b2af-f524f6f31b8e None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:06.895994 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3a27b-bdf5-4e03-b2af-f524f6f31b8e None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:06.900940 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd59cfe-6172-4e4b-a960-dda32aed01d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:06.901815 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd59cfe-6172-4e4b-a960-dda32aed01d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:06.902117 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd59cfe-6172-4e4b-a960-dda32aed01d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:06.902384 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd59cfe-6172-4e4b-a960-dda32aed01d0 admin admin] PATH_INFO: `/v3/users/04567d9e07624b67a242b6c4bf00ce0f` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:06.903572 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd59cfe-6172-4e4b-a960-dda32aed01d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04567d9e07624b67a242b6c4bf00ce0f)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:06.906149 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd59cfe-6172-4e4b-a960-dda32aed01d0 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:06.954131 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-edd59cfe-6172-4e4b-a960-dda32aed01d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04567d9e07624b67a242b6c4bf00ce0f'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:06.954792 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-edd59cfe-6172-4e4b-a960-dda32aed01d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04567d9e07624b67a242b6c4bf00ce0f'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:06.961429 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-edd59cfe-6172-4e4b-a960-dda32aed01d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04567d9e07624b67a242b6c4bf00ce0f'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:06.974194 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-edd59cfe-6172-4e4b-a960-dda32aed01d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04567d9e07624b67a242b6c4bf00ce0f'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:06.974895 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-edd59cfe-6172-4e4b-a960-dda32aed01d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04567d9e07624b67a242b6c4bf00ce0f'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:06.987226 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1090/2174] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:11:06 2022] DELETE /identity/v3/users/04567d9e07624b67a242b6c4bf00ce0f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:11:06.991655 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ef581-d57b-46b3-a399-eb18d975ff91 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:06.992149 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ef581-d57b-46b3-a399-eb18d975ff91 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:06.992239 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ef581-d57b-46b3-a399-eb18d975ff91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:07.011395 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-ef6ef581-d57b-46b3-a399-eb18d975ff91 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:11:07.012825 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-ef6ef581-d57b-46b3-a399-eb18d975ff91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:07.082210 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1085/2175] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:11:07.092291 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd59cfe-6172-4e4b-a960-dda32aed01d0 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:07.093787 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-edd59cfe-6172-4e4b-a960-dda32aed01d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:07.151372 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd59cfe-6172-4e4b-a960-dda32aed01d0 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:07.155404 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bfedf-cacb-4572-be82-b4aa4ed169eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:07.156103 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bfedf-cacb-4572-be82-b4aa4ed169eb service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:07.156392 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bfedf-cacb-4572-be82-b4aa4ed169eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:07.156668 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bfedf-cacb-4572-be82-b4aa4ed169eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:07.169833 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bfedf-cacb-4572-be82-b4aa4ed169eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:07.171408 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bfedf-cacb-4572-be82-b4aa4ed169eb service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:07.181345 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1091/2176] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:11:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:11:07.439291 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ef581-d57b-46b3-a399-eb18d975ff91 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:07.440720 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-ef6ef581-d57b-46b3-a399-eb18d975ff91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:07.454790 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ef581-d57b-46b3-a399-eb18d975ff91 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:07.459510 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758a8af-149b-4a83-9589-89664c27593b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:07.460445 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758a8af-149b-4a83-9589-89664c27593b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:07.460723 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758a8af-149b-4a83-9589-89664c27593b admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:07.460994 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758a8af-149b-4a83-9589-89664c27593b admin admin] PATH_INFO: `/v3/projects/170c79cfe27b4db1b0a3d217ce2f0526` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:07.462174 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758a8af-149b-4a83-9589-89664c27593b admin admin] RBAC: Authorizing `identity:delete_project(project_id=170c79cfe27b4db1b0a3d217ce2f0526)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:07.464115 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758a8af-149b-4a83-9589-89664c27593b admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:07.513483 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-7758a8af-149b-4a83-9589-89664c27593b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '170c79cfe27b4db1b0a3d217ce2f0526', 'request_id': 'req-7758a8af-149b-4a83-9589-89664c27593b'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:07.518833 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-7758a8af-149b-4a83-9589-89664c27593b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '170c79cfe27b4db1b0a3d217ce2f0526', 'request_id': 'req-7758a8af-149b-4a83-9589-89664c27593b'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:07.525000 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-7758a8af-149b-4a83-9589-89664c27593b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '170c79cfe27b4db1b0a3d217ce2f0526', 'request_id': 'req-7758a8af-149b-4a83-9589-89664c27593b'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:07.538237 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-7758a8af-149b-4a83-9589-89664c27593b admin admin] The token cache is being invalidate because project 170c79cfe27b4db1b0a3d217ce2f0526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:11:07.538546 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-7758a8af-149b-4a83-9589-89664c27593b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:07.539161 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-7758a8af-149b-4a83-9589-89664c27593b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:07.540995 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1086/2177] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:11:07 2022] DELETE /identity/v3/projects/170c79cfe27b4db1b0a3d217ce2f0526 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:11:07.546245 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135228b-552d-4df3-b21c-ab099a2e0587 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:07.546544 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135228b-552d-4df3-b21c-ab099a2e0587 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:07.546828 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135228b-552d-4df3-b21c-ab099a2e0587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:07.564439 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-e135228b-552d-4df3-b21c-ab099a2e0587 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:11:07.565624 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-e135228b-552d-4df3-b21c-ab099a2e0587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:07.625864 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1092/2178] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:11:07.636160 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f135982-7fa6-477e-a8ed-bd84004c87a7 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:07.636458 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f135982-7fa6-477e-a8ed-bd84004c87a7 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:07.636798 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f135982-7fa6-477e-a8ed-bd84004c87a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:07.655703 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-6f135982-7fa6-477e-a8ed-bd84004c87a7 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:11:07.656938 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-6f135982-7fa6-477e-a8ed-bd84004c87a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:07.666121 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1087/2179] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:11:07.670390 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135228b-552d-4df3-b21c-ab099a2e0587 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:07.680602 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135228b-552d-4df3-b21c-ab099a2e0587 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:07.685114 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa5c99-a986-42e4-964d-e13cec4b9d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:07.685756 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa5c99-a986-42e4-964d-e13cec4b9d79 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:07.686041 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa5c99-a986-42e4-964d-e13cec4b9d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:07.686380 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa5c99-a986-42e4-964d-e13cec4b9d79 admin admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:07.687675 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa5c99-a986-42e4-964d-e13cec4b9d79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:11:07.688009 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa5c99-a986-42e4-964d-e13cec4b9d79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:07.689601 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa5c99-a986-42e4-964d-e13cec4b9d79 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:07.700970 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1093/2180] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:11:07.705250 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f135982-7fa6-477e-a8ed-bd84004c87a7 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:07.715912 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f135982-7fa6-477e-a8ed-bd84004c87a7 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:07.721084 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac1f28-d760-40d2-9d39-c2ce4614a27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:07.721741 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac1f28-d760-40d2-9d39-c2ce4614a27e admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:07.722021 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac1f28-d760-40d2-9d39-c2ce4614a27e admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:07.722295 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac1f28-d760-40d2-9d39-c2ce4614a27e admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:07.722992 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac1f28-d760-40d2-9d39-c2ce4614a27e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:07.724924 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac1f28-d760-40d2-9d39-c2ce4614a27e admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:07.750589 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1088/2181] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:11:07 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:11:07.754640 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa5c99-a986-42e4-964d-e13cec4b9d79 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:07.764404 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa5c99-a986-42e4-964d-e13cec4b9d79 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:07.819993 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd0e7e-9c52-4bc6-8c73-1001cf5ec45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:07.820660 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd0e7e-9c52-4bc6-8c73-1001cf5ec45c admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:07.820942 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd0e7e-9c52-4bc6-8c73-1001cf5ec45c admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:07.821219 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd0e7e-9c52-4bc6-8c73-1001cf5ec45c admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:07.821912 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd0e7e-9c52-4bc6-8c73-1001cf5ec45c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:07.823844 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd0e7e-9c52-4bc6-8c73-1001cf5ec45c admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:07.845160 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1094/2182] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:11:07 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:11:07.848091 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac1f28-d760-40d2-9d39-c2ce4614a27e admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:07.858203 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac1f28-d760-40d2-9d39-c2ce4614a27e admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:07.863674 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998856dd-5ba8-4267-a830-633ef7150368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:07.864379 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998856dd-5ba8-4267-a830-633ef7150368 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:07.864665 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998856dd-5ba8-4267-a830-633ef7150368 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:07.864946 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998856dd-5ba8-4267-a830-633ef7150368 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:07.865688 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998856dd-5ba8-4267-a830-633ef7150368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:07.867300 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998856dd-5ba8-4267-a830-633ef7150368 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:07.878372 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1089/2183] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:11:07.882410 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd0e7e-9c52-4bc6-8c73-1001cf5ec45c admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:07.892222 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd0e7e-9c52-4bc6-8c73-1001cf5ec45c admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:07.896725 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520644c0-2128-487c-b04c-81942be4f1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:07.897365 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520644c0-2128-487c-b04c-81942be4f1fc admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:07.897648 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520644c0-2128-487c-b04c-81942be4f1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:07.897920 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520644c0-2128-487c-b04c-81942be4f1fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:07.898638 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520644c0-2128-487c-b04c-81942be4f1fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:07.900251 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520644c0-2128-487c-b04c-81942be4f1fc admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:07.911450 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1095/2184] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:11:07.915250 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998856dd-5ba8-4267-a830-633ef7150368 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:07.925582 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998856dd-5ba8-4267-a830-633ef7150368 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:07.930103 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e11b5d-29ec-4a48-928e-fe8a9ca761ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:07.930968 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e11b5d-29ec-4a48-928e-fe8a9ca761ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:07.931250 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e11b5d-29ec-4a48-928e-fe8a9ca761ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:07.931527 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e11b5d-29ec-4a48-928e-fe8a9ca761ca admin admin] PATH_INFO: `/v3/projects/91e8c3a1fca04f8094024519d894a9a8/users/78c3042fa768466e9a519b4fdb52edd3/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:07.947081 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e11b5d-29ec-4a48-928e-fe8a9ca761ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=91e8c3a1fca04f8094024519d894a9a8, user_id=78c3042fa768466e9a519b4fdb52edd3, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:07.949755 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e11b5d-29ec-4a48-928e-fe8a9ca761ca admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:07.962371 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1090/2185] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:11:07 2022] PUT /identity/v3/projects/91e8c3a1fca04f8094024519d894a9a8/users/78c3042fa768466e9a519b4fdb52edd3/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:11:07.968392 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c79b80-ddb8-481a-ac84-ebaebc32c4fb None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:07.968678 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c79b80-ddb8-481a-ac84-ebaebc32c4fb None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:07.968956 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c79b80-ddb8-481a-ac84-ebaebc32c4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:07.987280 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-93c79b80-ddb8-481a-ac84-ebaebc32c4fb None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:11:07.989063 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-93c79b80-ddb8-481a-ac84-ebaebc32c4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:08.047467 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1096/2186] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:11:08.056806 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e11b5d-29ec-4a48-928e-fe8a9ca761ca admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:08.058513 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-18e11b5d-29ec-4a48-928e-fe8a9ca761ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:08.115097 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e11b5d-29ec-4a48-928e-fe8a9ca761ca admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:08.119257 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c5494-754a-4315-b3b1-28749fc41bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:08.119950 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c5494-754a-4315-b3b1-28749fc41bad service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:08.120233 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c5494-754a-4315-b3b1-28749fc41bad service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:08.120502 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c5494-754a-4315-b3b1-28749fc41bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:08.129967 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c5494-754a-4315-b3b1-28749fc41bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:08.131643 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c5494-754a-4315-b3b1-28749fc41bad service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:08.141372 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1091/2187] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:11:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:11:12.381640 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fa418-c3d9-4d1f-8b5c-803d084e1dee None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:12.382170 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fa418-c3d9-4d1f-8b5c-803d084e1dee None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:12.382170 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fa418-c3d9-4d1f-8b5c-803d084e1dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:12.410978 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-e54fa418-c3d9-4d1f-8b5c-803d084e1dee None None] MFA Rules not processed for user `78c3042fa768466e9a519b4fdb52edd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:11:12.414060 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-e54fa418-c3d9-4d1f-8b5c-803d084e1dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:12.484394 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1097/2188] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:11:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:11:12.488776 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c5494-754a-4315-b3b1-28749fc41bad service neutron] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:12.498459 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c5494-754a-4315-b3b1-28749fc41bad service neutron] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:12.503201 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb1066-0ff6-416e-b5ae-3e013d3fbc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:12.503896 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb1066-0ff6-416e-b5ae-3e013d3fbc8d admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:12.504178 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb1066-0ff6-416e-b5ae-3e013d3fbc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:12.504453 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb1066-0ff6-416e-b5ae-3e013d3fbc8d admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:12.505149 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb1066-0ff6-416e-b5ae-3e013d3fbc8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:12.507045 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb1066-0ff6-416e-b5ae-3e013d3fbc8d admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:12.540021 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1092/2189] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:11:12 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:11:12.541066 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fa418-c3d9-4d1f-8b5c-803d084e1dee None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:12.558556 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fa418-c3d9-4d1f-8b5c-803d084e1dee None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:12.649650 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a6e89-9ee6-46fe-8bd2-ea8ffd4a1866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:12.650336 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a6e89-9ee6-46fe-8bd2-ea8ffd4a1866 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:12.650764 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a6e89-9ee6-46fe-8bd2-ea8ffd4a1866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:12.651082 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a6e89-9ee6-46fe-8bd2-ea8ffd4a1866 admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:12.651982 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a6e89-9ee6-46fe-8bd2-ea8ffd4a1866 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:12.655833 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a6e89-9ee6-46fe-8bd2-ea8ffd4a1866 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:12.679589 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1098/2190] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:11:12 2022] POST /identity/v3/users => generated 295 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:11:12.686862 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb1066-0ff6-416e-b5ae-3e013d3fbc8d admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:12.712216 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb1066-0ff6-416e-b5ae-3e013d3fbc8d admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:12.720421 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c056f-e922-4ead-b007-5122eaa88922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:12.724490 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c056f-e922-4ead-b007-5122eaa88922 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:12.724787 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c056f-e922-4ead-b007-5122eaa88922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:12.725067 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c056f-e922-4ead-b007-5122eaa88922 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:12.725810 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c056f-e922-4ead-b007-5122eaa88922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:12.727424 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c056f-e922-4ead-b007-5122eaa88922 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:12.740820 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1093/2191] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:11:12.744559 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a6e89-9ee6-46fe-8bd2-ea8ffd4a1866 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:12.755760 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a6e89-9ee6-46fe-8bd2-ea8ffd4a1866 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:12.761076 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bf542-8e84-48b2-ab6b-8634f93657a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:12.762167 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bf542-8e84-48b2-ab6b-8634f93657a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:12.762603 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bf542-8e84-48b2-ab6b-8634f93657a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:12.763033 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bf542-8e84-48b2-ab6b-8634f93657a3 admin admin] PATH_INFO: `/v3/projects/29e5e51d084e48cdaa93eacc0c264723/users/30722537103c4596b8437efcf1faec57/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:12.797114 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bf542-8e84-48b2-ab6b-8634f93657a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29e5e51d084e48cdaa93eacc0c264723, user_id=30722537103c4596b8437efcf1faec57, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:12.801638 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bf542-8e84-48b2-ab6b-8634f93657a3 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:12.825821 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1099/2192] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:11:12 2022] PUT /identity/v3/projects/29e5e51d084e48cdaa93eacc0c264723/users/30722537103c4596b8437efcf1faec57/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:11:12.830803 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c056f-e922-4ead-b007-5122eaa88922 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:12.842103 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c056f-e922-4ead-b007-5122eaa88922 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:12.915549 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9b4bb-a7f6-448e-955e-31b354c3a629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:12.916259 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9b4bb-a7f6-448e-955e-31b354c3a629 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:12.916549 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9b4bb-a7f6-448e-955e-31b354c3a629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:12.916824 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9b4bb-a7f6-448e-955e-31b354c3a629 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:12.917547 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9b4bb-a7f6-448e-955e-31b354c3a629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:12.919129 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9b4bb-a7f6-448e-955e-31b354c3a629 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:12.928922 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1094/2193] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:11:12.932987 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bf542-8e84-48b2-ab6b-8634f93657a3 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:12.943580 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bf542-8e84-48b2-ab6b-8634f93657a3 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:12.948685 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f50b2-c326-4f8c-b448-c4eb6b08a2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:12.949636 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f50b2-c326-4f8c-b448-c4eb6b08a2de admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:12.949924 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f50b2-c326-4f8c-b448-c4eb6b08a2de admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:12.950203 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f50b2-c326-4f8c-b448-c4eb6b08a2de admin admin] PATH_INFO: `/v3/projects/29e5e51d084e48cdaa93eacc0c264723/users/30722537103c4596b8437efcf1faec57/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:12.952776 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f50b2-c326-4f8c-b448-c4eb6b08a2de admin admin] RBAC: Authorizing `identity:create_grant(project_id=29e5e51d084e48cdaa93eacc0c264723, user_id=30722537103c4596b8437efcf1faec57, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:12.955432 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f50b2-c326-4f8c-b448-c4eb6b08a2de admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:12.966272 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1100/2194] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:11:12 2022] PUT /identity/v3/projects/29e5e51d084e48cdaa93eacc0c264723/users/30722537103c4596b8437efcf1faec57/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:11:19.944952 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f1d03-5097-4d3f-b570-af2fdb122e28 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:19.946054 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f1d03-5097-4d3f-b570-af2fdb122e28 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:19.946543 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f1d03-5097-4d3f-b570-af2fdb122e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:20.001197 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-591f1d03-5097-4d3f-b570-af2fdb122e28 None None] MFA Rules not processed for user `30722537103c4596b8437efcf1faec57`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:11:20.002951 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-591f1d03-5097-4d3f-b570-af2fdb122e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:20.171722 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1095/2195] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:11:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:11:20.185268 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f50b2-c326-4f8c-b448-c4eb6b08a2de admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:20.187133 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-893f50b2-c326-4f8c-b448-c4eb6b08a2de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:20.289493 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f50b2-c326-4f8c-b448-c4eb6b08a2de admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:20.295585 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b52d03-835c-4a47-8378-82d22f8e1083 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:20.296287 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b52d03-835c-4a47-8378-82d22f8e1083 service nova] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:20.296566 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b52d03-835c-4a47-8378-82d22f8e1083 service nova] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:20.296839 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b52d03-835c-4a47-8378-82d22f8e1083 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:20.353949 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b52d03-835c-4a47-8378-82d22f8e1083 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:20.355527 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b52d03-835c-4a47-8378-82d22f8e1083 service nova] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:20.364718 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1101/2196] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:11:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:11:25.508941 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422c203-bcdb-4af7-8cdb-438c85b5600a None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:25.509357 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422c203-bcdb-4af7-8cdb-438c85b5600a None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:25.509498 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422c203-bcdb-4af7-8cdb-438c85b5600a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:25.527462 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-3422c203-bcdb-4af7-8cdb-438c85b5600a None None] MFA Rules not processed for user `7eb560db53cd4af192bb82abdfad3590`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:11:25.528718 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-3422c203-bcdb-4af7-8cdb-438c85b5600a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:25.584453 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1096/2197] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Mar 10 04:11:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:11:25.626205 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b52d03-835c-4a47-8378-82d22f8e1083 service nova] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:25.627792 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-e2b52d03-835c-4a47-8378-82d22f8e1083 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:25.696173 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b52d03-835c-4a47-8378-82d22f8e1083 service nova] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:25.701173 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21a898-1fa6-4c1a-8c94-c1bac0c4b839 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260f561c676b4d049553eac4626b5502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:25.701824 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21a898-1fa6-4c1a-8c94-c1bac0c4b839 service swift] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:25.702686 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21a898-1fa6-4c1a-8c94-c1bac0c4b839 service swift] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:25.702912 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21a898-1fa6-4c1a-8c94-c1bac0c4b839 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:25.711854 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21a898-1fa6-4c1a-8c94-c1bac0c4b839 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:25.713560 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21a898-1fa6-4c1a-8c94-c1bac0c4b839 service swift] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:25.732647 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1102/2198] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Mar 10 04:11:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 10 04:11:26.805903 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422c203-bcdb-4af7-8cdb-438c85b5600a None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:26.807583 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-3422c203-bcdb-4af7-8cdb-438c85b5600a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:26.882253 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422c203-bcdb-4af7-8cdb-438c85b5600a None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:26.887549 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5e9bc-15be-40db-a83c-9b15c5029957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:26.888683 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5e9bc-15be-40db-a83c-9b15c5029957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:26.889134 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5e9bc-15be-40db-a83c-9b15c5029957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:26.890265 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5e9bc-15be-40db-a83c-9b15c5029957 admin admin] PATH_INFO: `/v3/users/16235d3b35a04bc39fe08a4ce8cefc5d` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:26.892051 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5e9bc-15be-40db-a83c-9b15c5029957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16235d3b35a04bc39fe08a4ce8cefc5d)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:26.894320 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5e9bc-15be-40db-a83c-9b15c5029957 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:26.947014 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-bda5e9bc-15be-40db-a83c-9b15c5029957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16235d3b35a04bc39fe08a4ce8cefc5d'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:26.955474 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-bda5e9bc-15be-40db-a83c-9b15c5029957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16235d3b35a04bc39fe08a4ce8cefc5d'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:26.963877 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-bda5e9bc-15be-40db-a83c-9b15c5029957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16235d3b35a04bc39fe08a4ce8cefc5d'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:26.975596 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-bda5e9bc-15be-40db-a83c-9b15c5029957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16235d3b35a04bc39fe08a4ce8cefc5d'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:26.976269 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-bda5e9bc-15be-40db-a83c-9b15c5029957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16235d3b35a04bc39fe08a4ce8cefc5d'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:26.982346 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1097/2199] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:11:26 2022] DELETE /identity/v3/users/16235d3b35a04bc39fe08a4ce8cefc5d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:11:26.988130 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9b586-0a96-4ad1-82f1-21a2acac56ed None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:26.989160 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9b586-0a96-4ad1-82f1-21a2acac56ed None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:26.989459 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9b586-0a96-4ad1-82f1-21a2acac56ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:27.015146 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-d9b9b586-0a96-4ad1-82f1-21a2acac56ed None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:11:27.017033 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-d9b9b586-0a96-4ad1-82f1-21a2acac56ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:27.090929 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1103/2200] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:11:27.100774 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5e9bc-15be-40db-a83c-9b15c5029957 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:27.102488 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-bda5e9bc-15be-40db-a83c-9b15c5029957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:27.174017 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5e9bc-15be-40db-a83c-9b15c5029957 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:27.177695 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b08f34-d0d4-4056-ab41-508e10c02e52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:27.178378 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b08f34-d0d4-4056-ab41-508e10c02e52 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:27.178688 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b08f34-d0d4-4056-ab41-508e10c02e52 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:27.178964 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b08f34-d0d4-4056-ab41-508e10c02e52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:27.188992 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b08f34-d0d4-4056-ab41-508e10c02e52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:27.190608 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b08f34-d0d4-4056-ab41-508e10c02e52 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:27.200874 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1098/2201] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:11:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:11:27.564416 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9b586-0a96-4ad1-82f1-21a2acac56ed None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:27.566118 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-d9b9b586-0a96-4ad1-82f1-21a2acac56ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:27.582357 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9b586-0a96-4ad1-82f1-21a2acac56ed None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:27.587418 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb9a28-9e60-446c-bfaf-aca1505fae2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:27.588466 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb9a28-9e60-446c-bfaf-aca1505fae2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:27.588954 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb9a28-9e60-446c-bfaf-aca1505fae2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:27.589365 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb9a28-9e60-446c-bfaf-aca1505fae2c admin admin] PATH_INFO: `/v3/projects/45cd2870877349388ef2f5e02aff149f` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:27.590912 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb9a28-9e60-446c-bfaf-aca1505fae2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=45cd2870877349388ef2f5e02aff149f)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:27.594365 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb9a28-9e60-446c-bfaf-aca1505fae2c admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:27.677216 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-1deb9a28-9e60-446c-bfaf-aca1505fae2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45cd2870877349388ef2f5e02aff149f', 'request_id': 'req-1deb9a28-9e60-446c-bfaf-aca1505fae2c'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:27.683129 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-1deb9a28-9e60-446c-bfaf-aca1505fae2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45cd2870877349388ef2f5e02aff149f', 'request_id': 'req-1deb9a28-9e60-446c-bfaf-aca1505fae2c'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:27.691172 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-1deb9a28-9e60-446c-bfaf-aca1505fae2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45cd2870877349388ef2f5e02aff149f', 'request_id': 'req-1deb9a28-9e60-446c-bfaf-aca1505fae2c'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:27.710430 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-1deb9a28-9e60-446c-bfaf-aca1505fae2c admin admin] The token cache is being invalidate because project 45cd2870877349388ef2f5e02aff149f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:11:27.711029 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-1deb9a28-9e60-446c-bfaf-aca1505fae2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:27.711910 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-1deb9a28-9e60-446c-bfaf-aca1505fae2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:27.723135 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1104/2202] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:11:27 2022] DELETE /identity/v3/projects/45cd2870877349388ef2f5e02aff149f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:11:27.727903 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96145cf-b7cf-4824-b7c1-b117306452e0 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:27.728430 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96145cf-b7cf-4824-b7c1-b117306452e0 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:27.728903 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96145cf-b7cf-4824-b7c1-b117306452e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:27.766785 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-b96145cf-b7cf-4824-b7c1-b117306452e0 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:11:27.768420 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-b96145cf-b7cf-4824-b7c1-b117306452e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:27.861961 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1099/2203] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:11:27.867845 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09b8d9-64f7-4484-8373-013b2194779f None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:27.868150 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09b8d9-64f7-4484-8373-013b2194779f None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:27.868432 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09b8d9-64f7-4484-8373-013b2194779f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:27.899249 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-0e09b8d9-64f7-4484-8373-013b2194779f None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:11:27.900526 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-0e09b8d9-64f7-4484-8373-013b2194779f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:27.910136 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1105/2204] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:11:27.914316 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96145cf-b7cf-4824-b7c1-b117306452e0 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:27.925171 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96145cf-b7cf-4824-b7c1-b117306452e0 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:27.930438 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73752b27-a97c-4041-9080-16ee8ba772b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:27.931090 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73752b27-a97c-4041-9080-16ee8ba772b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:27.931375 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73752b27-a97c-4041-9080-16ee8ba772b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:27.931651 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73752b27-a97c-4041-9080-16ee8ba772b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:27.932403 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73752b27-a97c-4041-9080-16ee8ba772b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:11:27.932710 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73752b27-a97c-4041-9080-16ee8ba772b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:27.934649 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73752b27-a97c-4041-9080-16ee8ba772b0 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:27.947551 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1100/2205] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:11:27.951608 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09b8d9-64f7-4484-8373-013b2194779f None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:27.961784 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09b8d9-64f7-4484-8373-013b2194779f None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:27.967157 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d019e23-e6fe-4276-8d5c-5f821c903fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:27.968554 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d019e23-e6fe-4276-8d5c-5f821c903fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:27.968846 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d019e23-e6fe-4276-8d5c-5f821c903fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:27.969127 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d019e23-e6fe-4276-8d5c-5f821c903fb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:27.969942 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d019e23-e6fe-4276-8d5c-5f821c903fb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:27.973737 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d019e23-e6fe-4276-8d5c-5f821c903fb1 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:28.007309 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1106/2206] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:11:27 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:11:28.011090 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73752b27-a97c-4041-9080-16ee8ba772b0 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:28.025109 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73752b27-a97c-4041-9080-16ee8ba772b0 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:28.099856 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a0b31-dd5f-45a8-8110-17be04286388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:28.101363 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a0b31-dd5f-45a8-8110-17be04286388 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:28.101657 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a0b31-dd5f-45a8-8110-17be04286388 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:28.101923 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a0b31-dd5f-45a8-8110-17be04286388 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:28.103072 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a0b31-dd5f-45a8-8110-17be04286388 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:28.106179 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a0b31-dd5f-45a8-8110-17be04286388 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:28.136533 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1101/2207] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:11:28 2022] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:11:28.140368 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d019e23-e6fe-4276-8d5c-5f821c903fb1 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:28.152935 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d019e23-e6fe-4276-8d5c-5f821c903fb1 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:28.158775 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd667648-2165-4a1e-9525-1971689326e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:28.159438 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd667648-2165-4a1e-9525-1971689326e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:28.159923 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd667648-2165-4a1e-9525-1971689326e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:28.160370 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd667648-2165-4a1e-9525-1971689326e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:28.161102 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd667648-2165-4a1e-9525-1971689326e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:28.162705 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd667648-2165-4a1e-9525-1971689326e0 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:28.174785 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1107/2208] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:11:28.178914 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a0b31-dd5f-45a8-8110-17be04286388 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:28.189981 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a0b31-dd5f-45a8-8110-17be04286388 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:28.195620 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3307cd8-e711-4e53-a626-b6a86720e6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:28.196330 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3307cd8-e711-4e53-a626-b6a86720e6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:28.196676 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3307cd8-e711-4e53-a626-b6a86720e6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:28.196958 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3307cd8-e711-4e53-a626-b6a86720e6c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:28.197953 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3307cd8-e711-4e53-a626-b6a86720e6c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:28.199699 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3307cd8-e711-4e53-a626-b6a86720e6c4 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:28.213681 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1102/2209] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:11:28.218841 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd667648-2165-4a1e-9525-1971689326e0 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:28.230137 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd667648-2165-4a1e-9525-1971689326e0 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:28.238033 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4c616-4a59-4f6f-b8e8-a0be54030344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:28.238991 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4c616-4a59-4f6f-b8e8-a0be54030344 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:28.239314 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4c616-4a59-4f6f-b8e8-a0be54030344 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:28.239629 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4c616-4a59-4f6f-b8e8-a0be54030344 admin admin] PATH_INFO: `/v3/projects/d2a7500dc66b4cadb207e4f0fb5c3f3c/users/676f8ffe4c0f4e20827a519908747136/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:28.264541 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4c616-4a59-4f6f-b8e8-a0be54030344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2a7500dc66b4cadb207e4f0fb5c3f3c, user_id=676f8ffe4c0f4e20827a519908747136, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:28.267494 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4c616-4a59-4f6f-b8e8-a0be54030344 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:28.304569 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1108/2210] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:11:28 2022] PUT /identity/v3/projects/d2a7500dc66b4cadb207e4f0fb5c3f3c/users/676f8ffe4c0f4e20827a519908747136/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:11:28.323138 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dabbd-509d-46a6-8190-dae92e004378 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:28.323858 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dabbd-509d-46a6-8190-dae92e004378 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:28.324436 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dabbd-509d-46a6-8190-dae92e004378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:28.423378 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-d49dabbd-509d-46a6-8190-dae92e004378 None None] MFA Rules not processed for user `676f8ffe4c0f4e20827a519908747136`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:11:28.424569 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-d49dabbd-509d-46a6-8190-dae92e004378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:28.516835 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1103/2211] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:11:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:11:28.532283 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4c616-4a59-4f6f-b8e8-a0be54030344 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:28.538728 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-2fa4c616-4a59-4f6f-b8e8-a0be54030344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:28.647183 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4c616-4a59-4f6f-b8e8-a0be54030344 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:28.661008 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec943de-32ea-4c85-a91e-8bb0855ee783 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:28.663614 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec943de-32ea-4c85-a91e-8bb0855ee783 service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:28.664388 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec943de-32ea-4c85-a91e-8bb0855ee783 service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:28.664622 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec943de-32ea-4c85-a91e-8bb0855ee783 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:28.687028 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec943de-32ea-4c85-a91e-8bb0855ee783 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:28.689264 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec943de-32ea-4c85-a91e-8bb0855ee783 service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:28.708824 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1109/2212] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:11:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:11:29.789341 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b18514-68b8-4b31-9a5d-99bdcfb2c5d3 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:29.792968 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b18514-68b8-4b31-9a5d-99bdcfb2c5d3 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:29.793880 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b18514-68b8-4b31-9a5d-99bdcfb2c5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:29.821016 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-76b18514-68b8-4b31-9a5d-99bdcfb2c5d3 None None] MFA Rules not processed for user `af9aa388314f4cfca823c8d13f67a8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:11:29.822734 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-76b18514-68b8-4b31-9a5d-99bdcfb2c5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:29.889096 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1104/2213] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:11:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:11:30.231326 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7be60c-fee7-4d43-80d9-4d17a56db712 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:30.232647 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7be60c-fee7-4d43-80d9-4d17a56db712 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:30.232936 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7be60c-fee7-4d43-80d9-4d17a56db712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:30.259071 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-fe7be60c-fee7-4d43-80d9-4d17a56db712 None None] MFA Rules not processed for user `676f8ffe4c0f4e20827a519908747136`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:11:30.260233 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-fe7be60c-fee7-4d43-80d9-4d17a56db712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:30.268436 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1110/2214] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:11:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:11:42.796065 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723dba27-a83c-4bd7-bd4a-ed16a2d689c7 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:42.797629 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723dba27-a83c-4bd7-bd4a-ed16a2d689c7 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:42.798120 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723dba27-a83c-4bd7-bd4a-ed16a2d689c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:42.823718 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-723dba27-a83c-4bd7-bd4a-ed16a2d689c7 None None] MFA Rules not processed for user `7eb560db53cd4af192bb82abdfad3590`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:11:42.825398 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-723dba27-a83c-4bd7-bd4a-ed16a2d689c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:42.939189 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1105/2215] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Mar 10 04:11:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:11:42.949952 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7be60c-fee7-4d43-80d9-4d17a56db712 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:42.952073 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-fe7be60c-fee7-4d43-80d9-4d17a56db712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:43.041009 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7be60c-fee7-4d43-80d9-4d17a56db712 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:43.045272 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2795f62-7228-4d88-9365-a019ce070d07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260f561c676b4d049553eac4626b5502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:43.045931 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2795f62-7228-4d88-9365-a019ce070d07 service swift] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:43.046395 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2795f62-7228-4d88-9365-a019ce070d07 service swift] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:43.046679 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2795f62-7228-4d88-9365-a019ce070d07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:43.057259 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2795f62-7228-4d88-9365-a019ce070d07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:43.058906 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2795f62-7228-4d88-9365-a019ce070d07 service swift] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:43.072887 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1111/2216] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Mar 10 04:11:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 10 04:11:46.904144 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514939b8-2c7e-4c4f-9cd8-7f63525bba79 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:46.904599 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514939b8-2c7e-4c4f-9cd8-7f63525bba79 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:46.904690 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514939b8-2c7e-4c4f-9cd8-7f63525bba79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:46.945266 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-514939b8-2c7e-4c4f-9cd8-7f63525bba79 None None] MFA Rules not processed for user `78c3042fa768466e9a519b4fdb52edd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:11:46.946483 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-514939b8-2c7e-4c4f-9cd8-7f63525bba79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:47.173410 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1106/2217] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:11:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:11:52.930535 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2b2c9-28b6-46f3-9e37-9711ed709027 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:52.931127 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2b2c9-28b6-46f3-9e37-9711ed709027 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:52.931127 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2b2c9-28b6-46f3-9e37-9711ed709027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:52.972048 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-54d2b2c9-28b6-46f3-9e37-9711ed709027 None None] MFA Rules not processed for user `7eb560db53cd4af192bb82abdfad3590`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:11:52.974264 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-54d2b2c9-28b6-46f3-9e37-9711ed709027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:53.015593 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1112/2218] 10.222.0.15 () {58 vars in 967 bytes} [Thu Mar 10 04:11:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:11:53.032136 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514939b8-2c7e-4c4f-9cd8-7f63525bba79 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:53.089137 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514939b8-2c7e-4c4f-9cd8-7f63525bba79 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:53.098226 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0c3fc-2d48-4fdc-99ce-d94b0a40f215 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260f561c676b4d049553eac4626b5502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:53.099315 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0c3fc-2d48-4fdc-99ce-d94b0a40f215 service swift] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:53.099867 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0c3fc-2d48-4fdc-99ce-d94b0a40f215 service swift] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:53.100659 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0c3fc-2d48-4fdc-99ce-d94b0a40f215 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:53.125386 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0c3fc-2d48-4fdc-99ce-d94b0a40f215 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:53.128113 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0c3fc-2d48-4fdc-99ce-d94b0a40f215 service swift] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:53.140838 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1107/2219] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Mar 10 04:11:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 10 04:11:55.986439 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2b2c9-28b6-46f3-9e37-9711ed709027 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:55.988163 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-54d2b2c9-28b6-46f3-9e37-9711ed709027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:11:56.165654 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2b2c9-28b6-46f3-9e37-9711ed709027 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:56.170445 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1e012-5bda-4a56-97ff-c2ffb2af0bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:56.172960 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1e012-5bda-4a56-97ff-c2ffb2af0bba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:56.173436 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1e012-5bda-4a56-97ff-c2ffb2af0bba admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:56.173717 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1e012-5bda-4a56-97ff-c2ffb2af0bba admin admin] PATH_INFO: `/v3/users/5f23f76aa53f43b29425ef6b46bc41c6` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:56.175025 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1e012-5bda-4a56-97ff-c2ffb2af0bba admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f23f76aa53f43b29425ef6b46bc41c6)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:56.177839 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1e012-5bda-4a56-97ff-c2ffb2af0bba admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:56.288626 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-58f1e012-5bda-4a56-97ff-c2ffb2af0bba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f23f76aa53f43b29425ef6b46bc41c6'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:56.290413 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-58f1e012-5bda-4a56-97ff-c2ffb2af0bba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f23f76aa53f43b29425ef6b46bc41c6'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:56.306621 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-58f1e012-5bda-4a56-97ff-c2ffb2af0bba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f23f76aa53f43b29425ef6b46bc41c6'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:56.336606 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-58f1e012-5bda-4a56-97ff-c2ffb2af0bba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f23f76aa53f43b29425ef6b46bc41c6'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:56.337443 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-58f1e012-5bda-4a56-97ff-c2ffb2af0bba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f23f76aa53f43b29425ef6b46bc41c6'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:56.359409 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1113/2220] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:11:55 2022] DELETE /identity/v3/users/5f23f76aa53f43b29425ef6b46bc41c6 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:11:56.756303 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0c3fc-2d48-4fdc-99ce-d94b0a40f215 service swift] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:11:56.776338 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0c3fc-2d48-4fdc-99ce-d94b0a40f215 service swift] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:11:56.959831 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcdb48-237f-41bd-aedc-b5976220464e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:11:56.963241 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcdb48-237f-41bd-aedc-b5976220464e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:11:56.964011 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcdb48-237f-41bd-aedc-b5976220464e admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:11:56.964528 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcdb48-237f-41bd-aedc-b5976220464e admin admin] PATH_INFO: `/v3/projects/800ca3221d5c44b38dfdfca75a7cc37c` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:11:56.966718 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcdb48-237f-41bd-aedc-b5976220464e admin admin] RBAC: Authorizing `identity:delete_project(project_id=800ca3221d5c44b38dfdfca75a7cc37c)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:11:56.970707 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcdb48-237f-41bd-aedc-b5976220464e admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:11:57.084804 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-33dcdb48-237f-41bd-aedc-b5976220464e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '800ca3221d5c44b38dfdfca75a7cc37c', 'request_id': 'req-33dcdb48-237f-41bd-aedc-b5976220464e'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:57.091859 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-33dcdb48-237f-41bd-aedc-b5976220464e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '800ca3221d5c44b38dfdfca75a7cc37c', 'request_id': 'req-33dcdb48-237f-41bd-aedc-b5976220464e'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:57.099852 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-33dcdb48-237f-41bd-aedc-b5976220464e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '800ca3221d5c44b38dfdfca75a7cc37c', 'request_id': 'req-33dcdb48-237f-41bd-aedc-b5976220464e'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:57.132799 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-33dcdb48-237f-41bd-aedc-b5976220464e admin admin] The token cache is being invalidate because project 800ca3221d5c44b38dfdfca75a7cc37c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:11:57.133524 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-33dcdb48-237f-41bd-aedc-b5976220464e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:57.137700 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-33dcdb48-237f-41bd-aedc-b5976220464e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:11:57.139672 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1108/2221] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:11:56 2022] DELETE /identity/v3/projects/800ca3221d5c44b38dfdfca75a7cc37c => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:12:03.573963 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b54621-498c-40fc-a37a-f802133afef1 None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:03.574545 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b54621-498c-40fc-a37a-f802133afef1 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:03.574545 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b54621-498c-40fc-a37a-f802133afef1 None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:03.576415 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1114/2222] 10.222.0.15 () {54 vars in 921 bytes} [Thu Mar 10 04:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:12:03.584906 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd9864-418b-4646-a332-20d49058a93c None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:03.585468 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd9864-418b-4646-a332-20d49058a93c None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:03.585576 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd9864-418b-4646-a332-20d49058a93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:03.613592 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-e6cd9864-418b-4646-a332-20d49058a93c None None] MFA Rules not processed for user `fbd92bd14ed04621af06d68161798fe3`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:12:03.614992 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-e6cd9864-418b-4646-a332-20d49058a93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:03.695819 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1109/2223] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Mar 10 04:12:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:12:03.707796 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b54621-498c-40fc-a37a-f802133afef1 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:03.709868 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-a6b54621-498c-40fc-a37a-f802133afef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:03.779052 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b54621-498c-40fc-a37a-f802133afef1 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:03.783790 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1b284-7fef-42d0-9536-a32edc4dfcf3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7c195f91114855acc58163631544d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:03.784677 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1b284-7fef-42d0-9536-a32edc4dfcf3 service glance] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:03.785062 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1b284-7fef-42d0-9536-a32edc4dfcf3 service glance] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:03.785572 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1b284-7fef-42d0-9536-a32edc4dfcf3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:03.797808 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1b284-7fef-42d0-9536-a32edc4dfcf3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:03.799249 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1b284-7fef-42d0-9536-a32edc4dfcf3 service glance] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:03.810265 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1115/2224] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:12:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:12:03.877643 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b447042-800e-4f93-96ae-337dfc042e56 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:03.878198 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b447042-800e-4f93-96ae-337dfc042e56 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:03.878625 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b447042-800e-4f93-96ae-337dfc042e56 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:03.881672 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1110/2225] 10.222.0.15 () {54 vars in 921 bytes} [Thu Mar 10 04:12:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:12:03.893762 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd8c2d-0a6c-4b11-8614-f8c57def43b5 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:03.894058 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd8c2d-0a6c-4b11-8614-f8c57def43b5 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:03.894363 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd8c2d-0a6c-4b11-8614-f8c57def43b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:03.924123 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-cabd8c2d-0a6c-4b11-8614-f8c57def43b5 None None] MFA Rules not processed for user `2faf262ae9d643c0b8708dcfecd75b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:12:03.925317 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-cabd8c2d-0a6c-4b11-8614-f8c57def43b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:03.986636 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1116/2226] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Mar 10 04:12:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:12:03.999226 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b447042-800e-4f93-96ae-337dfc042e56 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:04.000947 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-3b447042-800e-4f93-96ae-337dfc042e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:04.013964 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b447042-800e-4f93-96ae-337dfc042e56 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:04.017999 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a79b7d-9681-4b22-b26b-2545d3edcec6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:04.018629 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a79b7d-9681-4b22-b26b-2545d3edcec6 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:04.018908 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a79b7d-9681-4b22-b26b-2545d3edcec6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:04.019180 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a79b7d-9681-4b22-b26b-2545d3edcec6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:04.026289 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a79b7d-9681-4b22-b26b-2545d3edcec6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:04.027720 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a79b7d-9681-4b22-b26b-2545d3edcec6 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:04.035512 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1111/2227] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:12:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:12:04.131201 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09476a4-a307-44be-bd6d-8660cb627f4c None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:04.131601 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09476a4-a307-44be-bd6d-8660cb627f4c None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:04.131975 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09476a4-a307-44be-bd6d-8660cb627f4c None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:04.133946 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1117/2228] 10.222.0.15 () {54 vars in 921 bytes} [Thu Mar 10 04:12:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:12:04.140087 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8956a7-166a-40e0-a0ac-33493dae649a None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:04.140383 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8956a7-166a-40e0-a0ac-33493dae649a None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:04.140665 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8956a7-166a-40e0-a0ac-33493dae649a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:04.158989 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-3c8956a7-166a-40e0-a0ac-33493dae649a None None] MFA Rules not processed for user `fbd92bd14ed04621af06d68161798fe3`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:12:04.160206 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-3c8956a7-166a-40e0-a0ac-33493dae649a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:04.169317 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1112/2229] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Mar 10 04:12:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:12:04.179631 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09476a4-a307-44be-bd6d-8660cb627f4c None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:04.190779 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09476a4-a307-44be-bd6d-8660cb627f4c None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:04.195050 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15dc23-f455-4543-a809-6891d3c1a26f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:04.195717 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15dc23-f455-4543-a809-6891d3c1a26f service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:04.196000 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15dc23-f455-4543-a809-6891d3c1a26f service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:04.196282 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15dc23-f455-4543-a809-6891d3c1a26f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:04.210640 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c15dc23-f455-4543-a809-6891d3c1a26f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:04.212429 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c15dc23-f455-4543-a809-6891d3c1a26f service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:04.227099 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1118/2230] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:12:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:12:07.258154 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6f08e-15d3-4822-88e6-91b5c2c8107d None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:07.258617 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6f08e-15d3-4822-88e6-91b5c2c8107d None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:07.258693 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6f08e-15d3-4822-88e6-91b5c2c8107d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:07.286698 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-edb6f08e-15d3-4822-88e6-91b5c2c8107d None None] MFA Rules not processed for user `7eb560db53cd4af192bb82abdfad3590`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:12:07.287919 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-edb6f08e-15d3-4822-88e6-91b5c2c8107d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:07.345058 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1113/2231] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Mar 10 04:12:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:12:07.357462 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15dc23-f455-4543-a809-6891d3c1a26f service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:07.359637 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-3c15dc23-f455-4543-a809-6891d3c1a26f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:07.433327 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15dc23-f455-4543-a809-6891d3c1a26f service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:07.438502 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465a078-db20-43d8-8716-33fe9b1744b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260f561c676b4d049553eac4626b5502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:07.439150 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465a078-db20-43d8-8716-33fe9b1744b1 service swift] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:07.439458 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465a078-db20-43d8-8716-33fe9b1744b1 service swift] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:07.439760 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465a078-db20-43d8-8716-33fe9b1744b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:07.448307 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6465a078-db20-43d8-8716-33fe9b1744b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:07.449887 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6465a078-db20-43d8-8716-33fe9b1744b1 service swift] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:07.459036 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1119/2232] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Mar 10 04:12:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 10 04:12:19.034250 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6f08e-15d3-4822-88e6-91b5c2c8107d None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:19.036112 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-edb6f08e-15d3-4822-88e6-91b5c2c8107d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:19.194441 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6f08e-15d3-4822-88e6-91b5c2c8107d None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:19.205058 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f0ff3-e13d-4588-ac2d-1150655e6d05 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319da006b10c41f8aa8a9d5aa2225b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:19.206022 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f0ff3-e13d-4588-ac2d-1150655e6d05 service placement] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:19.206377 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f0ff3-e13d-4588-ac2d-1150655e6d05 service placement] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:19.206724 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f0ff3-e13d-4588-ac2d-1150655e6d05 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:19.208697 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-086f0ff3-e13d-4588-ac2d-1150655e6d05 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:19.220933 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f0ff3-e13d-4588-ac2d-1150655e6d05 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:19.222616 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f0ff3-e13d-4588-ac2d-1150655e6d05 service placement] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:19.233179 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1114/2233] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:12:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:12:20.363253 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bf608-8a4b-4e4d-844e-1d88195ce05e None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:20.363880 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bf608-8a4b-4e4d-844e-1d88195ce05e None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:20.363880 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bf608-8a4b-4e4d-844e-1d88195ce05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:20.382568 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-d34bf608-8a4b-4e4d-844e-1d88195ce05e None None] MFA Rules not processed for user `7eb560db53cd4af192bb82abdfad3590`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:12:20.384009 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-d34bf608-8a4b-4e4d-844e-1d88195ce05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:20.417772 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1120/2234] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Mar 10 04:12:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:12:20.432225 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f0ff3-e13d-4588-ac2d-1150655e6d05 service placement] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:20.444036 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f0ff3-e13d-4588-ac2d-1150655e6d05 service placement] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:20.450018 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad7209-bcd0-4e6d-8dd2-7a956e53eb23 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260f561c676b4d049553eac4626b5502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:20.450699 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad7209-bcd0-4e6d-8dd2-7a956e53eb23 service swift] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:20.451467 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad7209-bcd0-4e6d-8dd2-7a956e53eb23 service swift] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:20.451802 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad7209-bcd0-4e6d-8dd2-7a956e53eb23 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:20.463456 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad7209-bcd0-4e6d-8dd2-7a956e53eb23 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:20.465027 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad7209-bcd0-4e6d-8dd2-7a956e53eb23 service swift] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:20.475444 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1115/2235] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Mar 10 04:12:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 10 04:12:21.081542 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2184d9-67ce-45dc-92b2-21f7a189b8ae None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:21.081837 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2184d9-67ce-45dc-92b2-21f7a189b8ae None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:21.082299 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2184d9-67ce-45dc-92b2-21f7a189b8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:21.102201 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-ee2184d9-67ce-45dc-92b2-21f7a189b8ae None None] MFA Rules not processed for user `7eb560db53cd4af192bb82abdfad3590`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:12:21.103400 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-ee2184d9-67ce-45dc-92b2-21f7a189b8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:21.113404 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1121/2236] 10.222.0.15 () {58 vars in 967 bytes} [Thu Mar 10 04:12:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:12:21.130352 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad7209-bcd0-4e6d-8dd2-7a956e53eb23 service swift] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:21.140911 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad7209-bcd0-4e6d-8dd2-7a956e53eb23 service swift] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:21.146007 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31280fc-ad18-422f-8a32-1f0da67f1387 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260f561c676b4d049553eac4626b5502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:21.146647 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31280fc-ad18-422f-8a32-1f0da67f1387 service swift] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:21.146929 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31280fc-ad18-422f-8a32-1f0da67f1387 service swift] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:21.147205 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31280fc-ad18-422f-8a32-1f0da67f1387 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:21.157852 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31280fc-ad18-422f-8a32-1f0da67f1387 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:21.159721 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31280fc-ad18-422f-8a32-1f0da67f1387 service swift] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:21.170456 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1116/2237] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Mar 10 04:12:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 10 04:12:21.378689 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c380ce1-ea5d-4f23-9c75-7b7f6f3af043 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:21.379146 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c380ce1-ea5d-4f23-9c75-7b7f6f3af043 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:21.379257 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c380ce1-ea5d-4f23-9c75-7b7f6f3af043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:21.396512 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-5c380ce1-ea5d-4f23-9c75-7b7f6f3af043 None None] MFA Rules not processed for user `7eb560db53cd4af192bb82abdfad3590`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:12:21.397684 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-5c380ce1-ea5d-4f23-9c75-7b7f6f3af043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:21.405820 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1122/2238] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Mar 10 04:12:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:12:21.417586 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31280fc-ad18-422f-8a32-1f0da67f1387 service swift] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:21.428476 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31280fc-ad18-422f-8a32-1f0da67f1387 service swift] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:21.433939 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82340f-b095-43fd-aa45-5e070a18289a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260f561c676b4d049553eac4626b5502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:21.435495 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82340f-b095-43fd-aa45-5e070a18289a service swift] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:21.435831 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82340f-b095-43fd-aa45-5e070a18289a service swift] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:21.436122 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82340f-b095-43fd-aa45-5e070a18289a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:21.446366 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82340f-b095-43fd-aa45-5e070a18289a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:21.448055 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82340f-b095-43fd-aa45-5e070a18289a service swift] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:21.456279 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1117/2239] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Mar 10 04:12:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 10 04:12:21.780516 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a31fc7-dfcc-4f39-a773-dd4edd0b91bb None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:21.780808 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a31fc7-dfcc-4f39-a773-dd4edd0b91bb None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:21.781087 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a31fc7-dfcc-4f39-a773-dd4edd0b91bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:21.798094 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-86a31fc7-dfcc-4f39-a773-dd4edd0b91bb None None] MFA Rules not processed for user `7eb560db53cd4af192bb82abdfad3590`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:12:21.799269 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-86a31fc7-dfcc-4f39-a773-dd4edd0b91bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:21.806242 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1123/2240] 10.222.0.15 () {58 vars in 967 bytes} [Thu Mar 10 04:12:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:12:21.818543 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82340f-b095-43fd-aa45-5e070a18289a service swift] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:21.829227 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82340f-b095-43fd-aa45-5e070a18289a service swift] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:21.834202 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e297c10-432f-4278-8f96-f0e913dd55dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260f561c676b4d049553eac4626b5502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:21.835031 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e297c10-432f-4278-8f96-f0e913dd55dc service swift] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:21.835316 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e297c10-432f-4278-8f96-f0e913dd55dc service swift] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:21.835592 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e297c10-432f-4278-8f96-f0e913dd55dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:21.844403 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e297c10-432f-4278-8f96-f0e913dd55dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:21.846206 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e297c10-432f-4278-8f96-f0e913dd55dc service swift] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:21.854645 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1118/2241] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Mar 10 04:12:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 10 04:12:21.946223 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a31fc7-dfcc-4f39-a773-dd4edd0b91bb None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:21.956726 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a31fc7-dfcc-4f39-a773-dd4edd0b91bb None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:21.970474 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128d188-8d8e-4ec4-9004-aa468137851b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:21.973573 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128d188-8d8e-4ec4-9004-aa468137851b service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:21.973863 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128d188-8d8e-4ec4-9004-aa468137851b service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:21.974144 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128d188-8d8e-4ec4-9004-aa468137851b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:21.976116 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-c128d188-8d8e-4ec4-9004-aa468137851b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:22.053923 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c128d188-8d8e-4ec4-9004-aa468137851b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:22.053923 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c128d188-8d8e-4ec4-9004-aa468137851b service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:22.065584 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1124/2242] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:12:21 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:12:23.961298 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e297c10-432f-4278-8f96-f0e913dd55dc service swift] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:23.962714 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-7e297c10-432f-4278-8f96-f0e913dd55dc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:24.033317 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e297c10-432f-4278-8f96-f0e913dd55dc service swift] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:24.037760 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18f849-75bd-44fb-9e16-5b381657f30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:24.038618 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18f849-75bd-44fb-9e16-5b381657f30f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:24.038895 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18f849-75bd-44fb-9e16-5b381657f30f admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:24.039169 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18f849-75bd-44fb-9e16-5b381657f30f admin admin] PATH_INFO: `/v3/users/676f8ffe4c0f4e20827a519908747136` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:24.040358 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18f849-75bd-44fb-9e16-5b381657f30f admin admin] RBAC: Authorizing `identity:delete_user(user_id=676f8ffe4c0f4e20827a519908747136)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:24.042252 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18f849-75bd-44fb-9e16-5b381657f30f admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:24.089358 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-4d18f849-75bd-44fb-9e16-5b381657f30f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '676f8ffe4c0f4e20827a519908747136'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:24.096108 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-4d18f849-75bd-44fb-9e16-5b381657f30f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '676f8ffe4c0f4e20827a519908747136'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:24.103297 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-4d18f849-75bd-44fb-9e16-5b381657f30f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '676f8ffe4c0f4e20827a519908747136'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:24.116985 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-4d18f849-75bd-44fb-9e16-5b381657f30f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '676f8ffe4c0f4e20827a519908747136'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:24.117695 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-4d18f849-75bd-44fb-9e16-5b381657f30f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '676f8ffe4c0f4e20827a519908747136'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:24.123978 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1119/2243] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:12:23 2022] DELETE /identity/v3/users/676f8ffe4c0f4e20827a519908747136 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:12:24.128516 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74030107-955d-4e13-8b92-f9d009fb1177 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:24.128983 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74030107-955d-4e13-8b92-f9d009fb1177 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:24.129112 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74030107-955d-4e13-8b92-f9d009fb1177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:24.154383 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-74030107-955d-4e13-8b92-f9d009fb1177 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:12:24.155586 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-74030107-955d-4e13-8b92-f9d009fb1177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:24.222929 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1125/2244] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:12:24.233780 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18f849-75bd-44fb-9e16-5b381657f30f admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:24.235193 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-4d18f849-75bd-44fb-9e16-5b381657f30f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:24.304795 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18f849-75bd-44fb-9e16-5b381657f30f admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:24.310400 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423cc0c-55b7-46b3-84fd-5ec572f08d7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:24.311293 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423cc0c-55b7-46b3-84fd-5ec572f08d7d service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:24.311660 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423cc0c-55b7-46b3-84fd-5ec572f08d7d service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:24.312043 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423cc0c-55b7-46b3-84fd-5ec572f08d7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:24.326043 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423cc0c-55b7-46b3-84fd-5ec572f08d7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:24.327510 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423cc0c-55b7-46b3-84fd-5ec572f08d7d service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:24.338205 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1120/2245] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:12:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:12:24.512453 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74030107-955d-4e13-8b92-f9d009fb1177 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:24.514202 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-74030107-955d-4e13-8b92-f9d009fb1177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:24.545918 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74030107-955d-4e13-8b92-f9d009fb1177 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:24.550825 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc84010-7ee1-439e-90c5-18af469b7ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:24.552094 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc84010-7ee1-439e-90c5-18af469b7ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:24.552367 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc84010-7ee1-439e-90c5-18af469b7ead admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:24.552839 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc84010-7ee1-439e-90c5-18af469b7ead admin admin] PATH_INFO: `/v3/projects/d2a7500dc66b4cadb207e4f0fb5c3f3c` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:24.554244 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc84010-7ee1-439e-90c5-18af469b7ead admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2a7500dc66b4cadb207e4f0fb5c3f3c)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:24.556270 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc84010-7ee1-439e-90c5-18af469b7ead admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:24.607780 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-fbc84010-7ee1-439e-90c5-18af469b7ead admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2a7500dc66b4cadb207e4f0fb5c3f3c', 'request_id': 'req-fbc84010-7ee1-439e-90c5-18af469b7ead'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:24.613524 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-fbc84010-7ee1-439e-90c5-18af469b7ead admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2a7500dc66b4cadb207e4f0fb5c3f3c', 'request_id': 'req-fbc84010-7ee1-439e-90c5-18af469b7ead'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:24.619664 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-fbc84010-7ee1-439e-90c5-18af469b7ead admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2a7500dc66b4cadb207e4f0fb5c3f3c', 'request_id': 'req-fbc84010-7ee1-439e-90c5-18af469b7ead'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:24.635962 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-fbc84010-7ee1-439e-90c5-18af469b7ead admin admin] The token cache is being invalidate because project d2a7500dc66b4cadb207e4f0fb5c3f3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:12:24.636254 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-fbc84010-7ee1-439e-90c5-18af469b7ead admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:24.636899 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-fbc84010-7ee1-439e-90c5-18af469b7ead admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:24.639265 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1126/2246] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:12:24 2022] DELETE /identity/v3/projects/d2a7500dc66b4cadb207e4f0fb5c3f3c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:12:24.644725 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9e3ba-ee2f-45fe-b3cb-fdd81944b1b9 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:24.645036 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9e3ba-ee2f-45fe-b3cb-fdd81944b1b9 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:24.645314 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9e3ba-ee2f-45fe-b3cb-fdd81944b1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:24.698348 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-34b9e3ba-ee2f-45fe-b3cb-fdd81944b1b9 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:12:24.699893 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-34b9e3ba-ee2f-45fe-b3cb-fdd81944b1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:24.770170 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1121/2247] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:12:24.771854 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44978b7a-1054-4bd2-bb61-ef7eabcf479b None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:24.772352 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44978b7a-1054-4bd2-bb61-ef7eabcf479b None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:24.772775 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44978b7a-1054-4bd2-bb61-ef7eabcf479b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:24.791561 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-44978b7a-1054-4bd2-bb61-ef7eabcf479b None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:12:24.793077 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-44978b7a-1054-4bd2-bb61-ef7eabcf479b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:24.801256 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1127/2248] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:12:24.805665 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9e3ba-ee2f-45fe-b3cb-fdd81944b1b9 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:24.817658 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9e3ba-ee2f-45fe-b3cb-fdd81944b1b9 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:24.824128 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64662e-6dec-4cbf-80b6-d261419658a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:24.825393 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64662e-6dec-4cbf-80b6-d261419658a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:24.826330 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64662e-6dec-4cbf-80b6-d261419658a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:24.826827 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64662e-6dec-4cbf-80b6-d261419658a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:24.827738 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64662e-6dec-4cbf-80b6-d261419658a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:12:24.828112 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64662e-6dec-4cbf-80b6-d261419658a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:24.829884 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64662e-6dec-4cbf-80b6-d261419658a6 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:24.844430 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1122/2249] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:12:24.848398 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44978b7a-1054-4bd2-bb61-ef7eabcf479b None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:24.858010 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44978b7a-1054-4bd2-bb61-ef7eabcf479b None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:24.862830 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595f6d9-598b-48fd-935b-a90994409043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:24.863601 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595f6d9-598b-48fd-935b-a90994409043 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:24.864015 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595f6d9-598b-48fd-935b-a90994409043 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:24.864386 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595f6d9-598b-48fd-935b-a90994409043 admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:24.865211 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4595f6d9-598b-48fd-935b-a90994409043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:24.867195 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4595f6d9-598b-48fd-935b-a90994409043 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:24.895392 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1128/2250] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:12:24 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:12:24.899505 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64662e-6dec-4cbf-80b6-d261419658a6 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:24.910574 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64662e-6dec-4cbf-80b6-d261419658a6 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:24.974858 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60959fe3-fc24-4532-b30a-2b70e1bc9627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:24.975623 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60959fe3-fc24-4532-b30a-2b70e1bc9627 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:24.976005 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60959fe3-fc24-4532-b30a-2b70e1bc9627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:24.976365 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60959fe3-fc24-4532-b30a-2b70e1bc9627 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:24.977125 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60959fe3-fc24-4532-b30a-2b70e1bc9627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:24.979371 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60959fe3-fc24-4532-b30a-2b70e1bc9627 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:25.005842 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1123/2251] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:12:24 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:12:25.009880 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595f6d9-598b-48fd-935b-a90994409043 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:25.026374 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595f6d9-598b-48fd-935b-a90994409043 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:25.031413 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5752dc9-6102-430e-b3e9-adac4f5a39a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:25.032156 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5752dc9-6102-430e-b3e9-adac4f5a39a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:25.032438 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5752dc9-6102-430e-b3e9-adac4f5a39a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:25.032704 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5752dc9-6102-430e-b3e9-adac4f5a39a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:25.033435 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5752dc9-6102-430e-b3e9-adac4f5a39a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:25.035169 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5752dc9-6102-430e-b3e9-adac4f5a39a5 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:25.051417 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1129/2252] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:12:25.053907 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60959fe3-fc24-4532-b30a-2b70e1bc9627 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:25.069163 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60959fe3-fc24-4532-b30a-2b70e1bc9627 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:25.077401 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf28b4-87e1-4012-a069-05b586abe349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:25.078232 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf28b4-87e1-4012-a069-05b586abe349 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:25.078522 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf28b4-87e1-4012-a069-05b586abe349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:25.078865 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf28b4-87e1-4012-a069-05b586abe349 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:25.079532 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf28b4-87e1-4012-a069-05b586abe349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:25.081231 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf28b4-87e1-4012-a069-05b586abe349 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:25.095673 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1124/2253] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:12:25.096377 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5752dc9-6102-430e-b3e9-adac4f5a39a5 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:25.107089 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5752dc9-6102-430e-b3e9-adac4f5a39a5 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:25.111808 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146f2ef-a0c8-4a15-9565-10527baa8cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:25.115314 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146f2ef-a0c8-4a15-9565-10527baa8cec admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:25.115314 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146f2ef-a0c8-4a15-9565-10527baa8cec admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:25.115314 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146f2ef-a0c8-4a15-9565-10527baa8cec admin admin] PATH_INFO: `/v3/projects/868940effa2e4040bd16a5555c56acf1/users/baef6e80a6844993ad8cdf07ab106f37/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:25.129567 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146f2ef-a0c8-4a15-9565-10527baa8cec admin admin] RBAC: Authorizing `identity:create_grant(project_id=868940effa2e4040bd16a5555c56acf1, user_id=baef6e80a6844993ad8cdf07ab106f37, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:25.132299 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146f2ef-a0c8-4a15-9565-10527baa8cec admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:25.149573 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1130/2254] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:12:25 2022] PUT /identity/v3/projects/868940effa2e4040bd16a5555c56acf1/users/baef6e80a6844993ad8cdf07ab106f37/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:12:25.159742 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40851a81-5db1-426f-bac0-b23b94235aa9 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:25.160041 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40851a81-5db1-426f-bac0-b23b94235aa9 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:25.160321 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40851a81-5db1-426f-bac0-b23b94235aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:25.193389 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-40851a81-5db1-426f-bac0-b23b94235aa9 None None] MFA Rules not processed for user `baef6e80a6844993ad8cdf07ab106f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:12:25.194595 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-40851a81-5db1-426f-bac0-b23b94235aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:25.262339 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1125/2255] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:12:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:12:25.273814 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146f2ef-a0c8-4a15-9565-10527baa8cec admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:25.275575 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-4146f2ef-a0c8-4a15-9565-10527baa8cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:25.352941 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146f2ef-a0c8-4a15-9565-10527baa8cec admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:25.356512 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea80000-2c46-4d48-9b4b-9a302a812688 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:25.357156 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea80000-2c46-4d48-9b4b-9a302a812688 service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:25.357435 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea80000-2c46-4d48-9b4b-9a302a812688 service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:25.357712 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea80000-2c46-4d48-9b4b-9a302a812688 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:25.368428 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea80000-2c46-4d48-9b4b-9a302a812688 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:25.369866 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea80000-2c46-4d48-9b4b-9a302a812688 service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:25.380570 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1131/2256] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:12:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:12:37.054319 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40851a81-5db1-426f-bac0-b23b94235aa9 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:37.056469 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-40851a81-5db1-426f-bac0-b23b94235aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:37.129946 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40851a81-5db1-426f-bac0-b23b94235aa9 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:37.134424 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7d36c-46a4-4b94-900e-6f3b9c797a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:37.135352 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7d36c-46a4-4b94-900e-6f3b9c797a6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:37.135624 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7d36c-46a4-4b94-900e-6f3b9c797a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:37.135925 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7d36c-46a4-4b94-900e-6f3b9c797a6d admin admin] PATH_INFO: `/v3/users/b96ee0c3a9e44e14bf62619829b0acd9` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:37.137122 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7d36c-46a4-4b94-900e-6f3b9c797a6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b96ee0c3a9e44e14bf62619829b0acd9)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:37.139075 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7d36c-46a4-4b94-900e-6f3b9c797a6d admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:37.187617 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-9eb7d36c-46a4-4b94-900e-6f3b9c797a6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b96ee0c3a9e44e14bf62619829b0acd9'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:37.193859 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-9eb7d36c-46a4-4b94-900e-6f3b9c797a6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b96ee0c3a9e44e14bf62619829b0acd9'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:37.200113 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-9eb7d36c-46a4-4b94-900e-6f3b9c797a6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b96ee0c3a9e44e14bf62619829b0acd9'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:37.211349 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-9eb7d36c-46a4-4b94-900e-6f3b9c797a6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b96ee0c3a9e44e14bf62619829b0acd9'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:37.212000 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-9eb7d36c-46a4-4b94-900e-6f3b9c797a6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b96ee0c3a9e44e14bf62619829b0acd9'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:37.218104 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1126/2257] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:12:37 2022] DELETE /identity/v3/users/b96ee0c3a9e44e14bf62619829b0acd9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:12:37.378828 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea80000-2c46-4d48-9b4b-9a302a812688 service cinder] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:37.390676 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea80000-2c46-4d48-9b4b-9a302a812688 service cinder] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:37.447882 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0884c-8163-411a-ac9b-25d664c355db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:37.448745 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0884c-8163-411a-ac9b-25d664c355db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:37.449027 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0884c-8163-411a-ac9b-25d664c355db admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:37.449301 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0884c-8163-411a-ac9b-25d664c355db admin admin] PATH_INFO: `/v3/projects/c83ea9d1851f48939afa94258e6af2fc` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:37.450488 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0884c-8163-411a-ac9b-25d664c355db admin admin] RBAC: Authorizing `identity:delete_project(project_id=c83ea9d1851f48939afa94258e6af2fc)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:37.452902 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0884c-8163-411a-ac9b-25d664c355db admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:37.498591 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-13c0884c-8163-411a-ac9b-25d664c355db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c83ea9d1851f48939afa94258e6af2fc', 'request_id': 'req-13c0884c-8163-411a-ac9b-25d664c355db'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:37.503779 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-13c0884c-8163-411a-ac9b-25d664c355db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c83ea9d1851f48939afa94258e6af2fc', 'request_id': 'req-13c0884c-8163-411a-ac9b-25d664c355db'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:37.509606 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-13c0884c-8163-411a-ac9b-25d664c355db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c83ea9d1851f48939afa94258e6af2fc', 'request_id': 'req-13c0884c-8163-411a-ac9b-25d664c355db'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:37.521255 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-13c0884c-8163-411a-ac9b-25d664c355db admin admin] The token cache is being invalidate because project c83ea9d1851f48939afa94258e6af2fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:12:37.521561 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-13c0884c-8163-411a-ac9b-25d664c355db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:37.522217 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-13c0884c-8163-411a-ac9b-25d664c355db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:37.523763 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1132/2258] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:12:37 2022] DELETE /identity/v3/projects/c83ea9d1851f48939afa94258e6af2fc => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:12:37.529466 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a8aec-57e1-4c9a-a79c-e75de474ad37 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:37.529769 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a8aec-57e1-4c9a-a79c-e75de474ad37 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:37.530152 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a8aec-57e1-4c9a-a79c-e75de474ad37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:37.547501 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-db0a8aec-57e1-4c9a-a79c-e75de474ad37 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:12:37.548708 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-db0a8aec-57e1-4c9a-a79c-e75de474ad37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:37.609343 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1127/2259] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:12:37.617194 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b079a05-e1f3-4809-a725-0e924fd09ff3 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:37.617486 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b079a05-e1f3-4809-a725-0e924fd09ff3 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:37.617763 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b079a05-e1f3-4809-a725-0e924fd09ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:37.636209 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-0b079a05-e1f3-4809-a725-0e924fd09ff3 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:12:37.637617 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-0b079a05-e1f3-4809-a725-0e924fd09ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:37.646542 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1133/2260] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:12:37.650789 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a8aec-57e1-4c9a-a79c-e75de474ad37 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:37.661711 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a8aec-57e1-4c9a-a79c-e75de474ad37 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:37.666227 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ac2cb-6f92-47ec-b8af-8b282a1ead38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:37.666869 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ac2cb-6f92-47ec-b8af-8b282a1ead38 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:37.667148 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ac2cb-6f92-47ec-b8af-8b282a1ead38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:37.667420 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ac2cb-6f92-47ec-b8af-8b282a1ead38 admin admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:37.668168 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ac2cb-6f92-47ec-b8af-8b282a1ead38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:12:37.668470 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ac2cb-6f92-47ec-b8af-8b282a1ead38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:37.670086 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ac2cb-6f92-47ec-b8af-8b282a1ead38 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:37.681029 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1128/2261] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:12:37.685441 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b079a05-e1f3-4809-a725-0e924fd09ff3 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:37.694851 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b079a05-e1f3-4809-a725-0e924fd09ff3 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:37.699365 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75384318-896f-47b1-af04-55ae0598fc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:37.700042 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75384318-896f-47b1-af04-55ae0598fc76 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:37.700326 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75384318-896f-47b1-af04-55ae0598fc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:37.700605 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75384318-896f-47b1-af04-55ae0598fc76 admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:37.701787 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75384318-896f-47b1-af04-55ae0598fc76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:37.703703 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75384318-896f-47b1-af04-55ae0598fc76 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:37.729015 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1134/2262] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:12:37 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:12:37.733124 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ac2cb-6f92-47ec-b8af-8b282a1ead38 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:37.742812 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ac2cb-6f92-47ec-b8af-8b282a1ead38 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:37.796202 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c54912-ac4b-4517-88fc-a3d3bc98943b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:37.796864 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c54912-ac4b-4517-88fc-a3d3bc98943b admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:37.797146 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c54912-ac4b-4517-88fc-a3d3bc98943b admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:37.797424 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c54912-ac4b-4517-88fc-a3d3bc98943b admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:37.798115 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c54912-ac4b-4517-88fc-a3d3bc98943b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:37.800046 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c54912-ac4b-4517-88fc-a3d3bc98943b admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:37.818763 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1129/2263] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:12:37 2022] POST /identity/v3/users => generated 292 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:12:37.822843 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75384318-896f-47b1-af04-55ae0598fc76 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:37.833577 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75384318-896f-47b1-af04-55ae0598fc76 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:37.838127 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2a3e8-acd6-4dba-8bb8-0771366ed0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:37.838770 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2a3e8-acd6-4dba-8bb8-0771366ed0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:37.839054 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2a3e8-acd6-4dba-8bb8-0771366ed0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:37.839333 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2a3e8-acd6-4dba-8bb8-0771366ed0c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:37.840098 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2a3e8-acd6-4dba-8bb8-0771366ed0c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:37.841681 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2a3e8-acd6-4dba-8bb8-0771366ed0c8 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:37.851675 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1135/2264] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:12:37.855305 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c54912-ac4b-4517-88fc-a3d3bc98943b admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:37.864913 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c54912-ac4b-4517-88fc-a3d3bc98943b admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:37.869456 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29688db-a3dc-4272-85d4-a21af682e059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:37.870102 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29688db-a3dc-4272-85d4-a21af682e059 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:37.870384 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29688db-a3dc-4272-85d4-a21af682e059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:37.870661 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29688db-a3dc-4272-85d4-a21af682e059 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:37.871372 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29688db-a3dc-4272-85d4-a21af682e059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:37.873475 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29688db-a3dc-4272-85d4-a21af682e059 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:37.882936 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1130/2265] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:12:37.886798 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2a3e8-acd6-4dba-8bb8-0771366ed0c8 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:37.897179 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2a3e8-acd6-4dba-8bb8-0771366ed0c8 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:37.901736 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e5ed4-7a51-4aa3-9928-170a55788844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:37.902588 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e5ed4-7a51-4aa3-9928-170a55788844 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:37.902863 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e5ed4-7a51-4aa3-9928-170a55788844 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:37.903133 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e5ed4-7a51-4aa3-9928-170a55788844 admin admin] PATH_INFO: `/v3/projects/8381ec3378ab4e32b4bfc07e8a1fb9cb/users/cce4d3037fb54e9385f3f45b056f9f34/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:37.917897 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e5ed4-7a51-4aa3-9928-170a55788844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8381ec3378ab4e32b4bfc07e8a1fb9cb, user_id=cce4d3037fb54e9385f3f45b056f9f34, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:37.920530 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e5ed4-7a51-4aa3-9928-170a55788844 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:37.932949 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1136/2266] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:12:37 2022] PUT /identity/v3/projects/8381ec3378ab4e32b4bfc07e8a1fb9cb/users/cce4d3037fb54e9385f3f45b056f9f34/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:12:37.943473 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f70b69-3215-410b-9125-5d2f415f8f4f None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:37.943806 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f70b69-3215-410b-9125-5d2f415f8f4f None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:37.944096 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f70b69-3215-410b-9125-5d2f415f8f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:37.969991 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-46f70b69-3215-410b-9125-5d2f415f8f4f None None] MFA Rules not processed for user `cce4d3037fb54e9385f3f45b056f9f34`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:12:37.971188 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-46f70b69-3215-410b-9125-5d2f415f8f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:38.033227 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1131/2267] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:12:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:12:38.045697 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e5ed4-7a51-4aa3-9928-170a55788844 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:38.047388 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-b55e5ed4-7a51-4aa3-9928-170a55788844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:38.145410 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e5ed4-7a51-4aa3-9928-170a55788844 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:38.151148 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fcf89f-5741-4838-8f9c-9d3b9b6c915b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:38.151848 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcf89f-5741-4838-8f9c-9d3b9b6c915b service nova] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:38.152131 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcf89f-5741-4838-8f9c-9d3b9b6c915b service nova] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:38.152404 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcf89f-5741-4838-8f9c-9d3b9b6c915b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:38.160242 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fcf89f-5741-4838-8f9c-9d3b9b6c915b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:38.161806 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fcf89f-5741-4838-8f9c-9d3b9b6c915b service nova] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:38.170844 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1137/2268] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:12:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:12:38.282084 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0371d8-9cc5-4a45-aa67-62075b77ac5b None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:38.282544 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0371d8-9cc5-4a45-aa67-62075b77ac5b None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:38.282636 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0371d8-9cc5-4a45-aa67-62075b77ac5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:38.300479 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-0e0371d8-9cc5-4a45-aa67-62075b77ac5b None None] MFA Rules not processed for user `7eb560db53cd4af192bb82abdfad3590`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:12:38.301701 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-0e0371d8-9cc5-4a45-aa67-62075b77ac5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:38.356246 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1132/2269] 10.222.0.15 () {58 vars in 967 bytes} [Thu Mar 10 04:12:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:12:38.385800 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fcf89f-5741-4838-8f9c-9d3b9b6c915b service nova] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:38.387285 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-18fcf89f-5741-4838-8f9c-9d3b9b6c915b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:38.479919 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fcf89f-5741-4838-8f9c-9d3b9b6c915b service nova] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:38.485704 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8c37d-b8fe-43a5-a8e2-052ceab608bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260f561c676b4d049553eac4626b5502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:38.486445 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8c37d-b8fe-43a5-a8e2-052ceab608bb service swift] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:38.486608 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8c37d-b8fe-43a5-a8e2-052ceab608bb service swift] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:38.486885 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8c37d-b8fe-43a5-a8e2-052ceab608bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:38.496148 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8c37d-b8fe-43a5-a8e2-052ceab608bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:38.498446 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8c37d-b8fe-43a5-a8e2-052ceab608bb service swift] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:38.514816 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1138/2270] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Mar 10 04:12:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 10 04:12:45.364328 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0371d8-9cc5-4a45-aa67-62075b77ac5b None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:45.424638 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0371d8-9cc5-4a45-aa67-62075b77ac5b None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:45.429063 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d0030-f862-4d90-8762-1060665ae6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:45.429930 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d0030-f862-4d90-8762-1060665ae6e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:45.430218 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d0030-f862-4d90-8762-1060665ae6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:45.430502 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d0030-f862-4d90-8762-1060665ae6e3 admin admin] PATH_INFO: `/v3/users/cce4d3037fb54e9385f3f45b056f9f34` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:45.431708 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d0030-f862-4d90-8762-1060665ae6e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cce4d3037fb54e9385f3f45b056f9f34)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:45.433697 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d0030-f862-4d90-8762-1060665ae6e3 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:45.477466 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-ba3d0030-f862-4d90-8762-1060665ae6e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cce4d3037fb54e9385f3f45b056f9f34'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:45.484478 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-ba3d0030-f862-4d90-8762-1060665ae6e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cce4d3037fb54e9385f3f45b056f9f34'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:45.491156 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-ba3d0030-f862-4d90-8762-1060665ae6e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cce4d3037fb54e9385f3f45b056f9f34'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:45.502368 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-ba3d0030-f862-4d90-8762-1060665ae6e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cce4d3037fb54e9385f3f45b056f9f34'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:45.503038 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-ba3d0030-f862-4d90-8762-1060665ae6e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cce4d3037fb54e9385f3f45b056f9f34'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:45.508753 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1133/2271] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:12:45 2022] DELETE /identity/v3/users/cce4d3037fb54e9385f3f45b056f9f34 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:12:45.513252 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b85d33-8698-4af7-9a8b-0da0cc1dfc0d None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:45.513742 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b85d33-8698-4af7-9a8b-0da0cc1dfc0d None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:45.513836 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b85d33-8698-4af7-9a8b-0da0cc1dfc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:45.530571 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-46b85d33-8698-4af7-9a8b-0da0cc1dfc0d None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:12:45.531781 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-46b85d33-8698-4af7-9a8b-0da0cc1dfc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:45.583114 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d0030-f862-4d90-8762-1060665ae6e3 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:45.584600 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-ba3d0030-f862-4d90-8762-1060665ae6e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:45.589436 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1139/2272] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:12:45.598803 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d0030-f862-4d90-8762-1060665ae6e3 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:45.599517 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b85d33-8698-4af7-9a8b-0da0cc1dfc0d None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:45.600929 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-46b85d33-8698-4af7-9a8b-0da0cc1dfc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:45.603525 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7db0ac-ffa7-42d0-9c33-23ba597a9cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:45.604432 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7db0ac-ffa7-42d0-9c33-23ba597a9cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:45.604718 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7db0ac-ffa7-42d0-9c33-23ba597a9cce admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:45.604996 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7db0ac-ffa7-42d0-9c33-23ba597a9cce admin admin] PATH_INFO: `/v3/users/baef6e80a6844993ad8cdf07ab106f37` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:45.606321 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7db0ac-ffa7-42d0-9c33-23ba597a9cce admin admin] RBAC: Authorizing `identity:delete_user(user_id=baef6e80a6844993ad8cdf07ab106f37)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:45.609111 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7db0ac-ffa7-42d0-9c33-23ba597a9cce admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:45.656816 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-2e7db0ac-ffa7-42d0-9c33-23ba597a9cce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baef6e80a6844993ad8cdf07ab106f37'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:45.657832 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b85d33-8698-4af7-9a8b-0da0cc1dfc0d None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:45.661489 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4ce4e-ea01-405c-a79f-7c0d266bd5f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:45.662129 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4ce4e-ea01-405c-a79f-7c0d266bd5f5 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:45.662408 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4ce4e-ea01-405c-a79f-7c0d266bd5f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:45.662683 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4ce4e-ea01-405c-a79f-7c0d266bd5f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:45.663519 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-2e7db0ac-ffa7-42d0-9c33-23ba597a9cce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baef6e80a6844993ad8cdf07ab106f37'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:45.670758 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-2e7db0ac-ffa7-42d0-9c33-23ba597a9cce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baef6e80a6844993ad8cdf07ab106f37'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:45.671802 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4ce4e-ea01-405c-a79f-7c0d266bd5f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:45.673147 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4ce4e-ea01-405c-a79f-7c0d266bd5f5 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:45.682213 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-2e7db0ac-ffa7-42d0-9c33-23ba597a9cce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baef6e80a6844993ad8cdf07ab106f37'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:45.682500 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1140/2273] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:12:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:12:45.683056 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-2e7db0ac-ffa7-42d0-9c33-23ba597a9cce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baef6e80a6844993ad8cdf07ab106f37'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:45.689849 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1134/2274] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:12:45 2022] DELETE /identity/v3/users/baef6e80a6844993ad8cdf07ab106f37 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:12:45.699299 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f9977-5c55-41ed-9d67-4943a6517f3b None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:45.699590 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f9977-5c55-41ed-9d67-4943a6517f3b None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:45.699896 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f9977-5c55-41ed-9d67-4943a6517f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:45.717454 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-947f9977-5c55-41ed-9d67-4943a6517f3b None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:12:45.718648 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-947f9977-5c55-41ed-9d67-4943a6517f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:45.777420 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1141/2275] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:12:45.788607 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7db0ac-ffa7-42d0-9c33-23ba597a9cce admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:45.790141 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-2e7db0ac-ffa7-42d0-9c33-23ba597a9cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:45.850255 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7db0ac-ffa7-42d0-9c33-23ba597a9cce admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:45.853910 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5bd14-2e9d-416e-9843-6df9233983c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:45.854548 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5bd14-2e9d-416e-9843-6df9233983c9 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:45.854831 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5bd14-2e9d-416e-9843-6df9233983c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:45.855140 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5bd14-2e9d-416e-9843-6df9233983c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:45.864005 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5bd14-2e9d-416e-9843-6df9233983c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:45.865420 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5bd14-2e9d-416e-9843-6df9233983c9 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:45.874595 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1135/2276] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:12:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:12:46.012218 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f9977-5c55-41ed-9d67-4943a6517f3b None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:46.014451 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-947f9977-5c55-41ed-9d67-4943a6517f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:46.026898 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f9977-5c55-41ed-9d67-4943a6517f3b None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:46.032186 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a42603-f034-4ef0-b8fd-bbdb6d20ad06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:46.034019 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a42603-f034-4ef0-b8fd-bbdb6d20ad06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:46.034431 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a42603-f034-4ef0-b8fd-bbdb6d20ad06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:46.034715 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a42603-f034-4ef0-b8fd-bbdb6d20ad06 admin admin] PATH_INFO: `/v3/projects/8381ec3378ab4e32b4bfc07e8a1fb9cb` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:46.036036 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a42603-f034-4ef0-b8fd-bbdb6d20ad06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8381ec3378ab4e32b4bfc07e8a1fb9cb)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:46.038014 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a42603-f034-4ef0-b8fd-bbdb6d20ad06 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:46.096417 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-e4a42603-f034-4ef0-b8fd-bbdb6d20ad06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8381ec3378ab4e32b4bfc07e8a1fb9cb', 'request_id': 'req-e4a42603-f034-4ef0-b8fd-bbdb6d20ad06'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:46.102049 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-e4a42603-f034-4ef0-b8fd-bbdb6d20ad06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8381ec3378ab4e32b4bfc07e8a1fb9cb', 'request_id': 'req-e4a42603-f034-4ef0-b8fd-bbdb6d20ad06'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:46.108269 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-e4a42603-f034-4ef0-b8fd-bbdb6d20ad06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8381ec3378ab4e32b4bfc07e8a1fb9cb', 'request_id': 'req-e4a42603-f034-4ef0-b8fd-bbdb6d20ad06'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:46.121272 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-e4a42603-f034-4ef0-b8fd-bbdb6d20ad06 admin admin] The token cache is being invalidate because project 8381ec3378ab4e32b4bfc07e8a1fb9cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:12:46.121580 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-e4a42603-f034-4ef0-b8fd-bbdb6d20ad06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:46.122719 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-e4a42603-f034-4ef0-b8fd-bbdb6d20ad06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:46.124422 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1142/2277] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:12:46 2022] DELETE /identity/v3/projects/8381ec3378ab4e32b4bfc07e8a1fb9cb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:12:46.129437 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5ea4c-366a-417c-844b-78b8282eae7f None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:46.129731 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5ea4c-366a-417c-844b-78b8282eae7f None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:46.130012 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5ea4c-366a-417c-844b-78b8282eae7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:46.148694 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-e7d5ea4c-366a-417c-844b-78b8282eae7f None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:12:46.149920 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-e7d5ea4c-366a-417c-844b-78b8282eae7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:46.192111 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a42603-f034-4ef0-b8fd-bbdb6d20ad06 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:46.193586 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-e4a42603-f034-4ef0-b8fd-bbdb6d20ad06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:46.223750 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1136/2278] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:12:46.226479 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931b102-894c-45f9-a0d6-623af3cc704b None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:46.226796 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931b102-894c-45f9-a0d6-623af3cc704b None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:46.227073 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931b102-894c-45f9-a0d6-623af3cc704b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:46.244582 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-b931b102-894c-45f9-a0d6-623af3cc704b None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:12:46.245764 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-b931b102-894c-45f9-a0d6-623af3cc704b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:46.254083 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1137/2279] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:12:46.258171 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931b102-894c-45f9-a0d6-623af3cc704b None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:46.267236 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931b102-894c-45f9-a0d6-623af3cc704b None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:46.269680 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a42603-f034-4ef0-b8fd-bbdb6d20ad06 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:46.271904 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee0a9b-e75e-496a-a20a-06cd9fad09a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:46.272528 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee0a9b-e75e-496a-a20a-06cd9fad09a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:46.272808 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee0a9b-e75e-496a-a20a-06cd9fad09a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:46.273083 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee0a9b-e75e-496a-a20a-06cd9fad09a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:46.273789 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee0a9b-e75e-496a-a20a-06cd9fad09a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:12:46.274101 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee0a9b-e75e-496a-a20a-06cd9fad09a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:46.274510 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b23ae8-0ec7-44aa-ad45-ea8b9e55dd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:46.275408 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b23ae8-0ec7-44aa-ad45-ea8b9e55dd23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:46.275676 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee0a9b-e75e-496a-a20a-06cd9fad09a7 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:46.275790 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b23ae8-0ec7-44aa-ad45-ea8b9e55dd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:46.275997 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b23ae8-0ec7-44aa-ad45-ea8b9e55dd23 admin admin] PATH_INFO: `/v3/projects/868940effa2e4040bd16a5555c56acf1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:46.277186 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b23ae8-0ec7-44aa-ad45-ea8b9e55dd23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=868940effa2e4040bd16a5555c56acf1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:46.279115 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b23ae8-0ec7-44aa-ad45-ea8b9e55dd23 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:46.286806 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1138/2280] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:12:46.291183 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee0a9b-e75e-496a-a20a-06cd9fad09a7 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:46.300366 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee0a9b-e75e-496a-a20a-06cd9fad09a7 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:46.305407 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a47b7-f370-4942-8da3-015a7d01c9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:46.306150 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a47b7-f370-4942-8da3-015a7d01c9be admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:46.306475 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a47b7-f370-4942-8da3-015a7d01c9be admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:46.306795 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a47b7-f370-4942-8da3-015a7d01c9be admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:46.307753 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a47b7-f370-4942-8da3-015a7d01c9be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:46.310334 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a47b7-f370-4942-8da3-015a7d01c9be admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:46.326485 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-55b23ae8-0ec7-44aa-ad45-ea8b9e55dd23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '868940effa2e4040bd16a5555c56acf1', 'request_id': 'req-55b23ae8-0ec7-44aa-ad45-ea8b9e55dd23'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:46.331925 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-55b23ae8-0ec7-44aa-ad45-ea8b9e55dd23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '868940effa2e4040bd16a5555c56acf1', 'request_id': 'req-55b23ae8-0ec7-44aa-ad45-ea8b9e55dd23'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:46.337051 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1139/2281] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:12:46 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:12:46.338008 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-55b23ae8-0ec7-44aa-ad45-ea8b9e55dd23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '868940effa2e4040bd16a5555c56acf1', 'request_id': 'req-55b23ae8-0ec7-44aa-ad45-ea8b9e55dd23'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:46.340924 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a47b7-f370-4942-8da3-015a7d01c9be admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:46.350218 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-55b23ae8-0ec7-44aa-ad45-ea8b9e55dd23 admin admin] The token cache is being invalidate because project 868940effa2e4040bd16a5555c56acf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:12:46.350218 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-55b23ae8-0ec7-44aa-ad45-ea8b9e55dd23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:46.350916 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-55b23ae8-0ec7-44aa-ad45-ea8b9e55dd23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:46.352892 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1143/2282] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:12:46 2022] DELETE /identity/v3/projects/868940effa2e4040bd16a5555c56acf1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:12:46.357731 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9856df-c698-434c-b771-c3776941f38a None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:46.358017 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9856df-c698-434c-b771-c3776941f38a None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:46.358441 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9856df-c698-434c-b771-c3776941f38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:46.376692 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-5e9856df-c698-434c-b771-c3776941f38a None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:12:46.377943 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-5e9856df-c698-434c-b771-c3776941f38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:46.399853 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a47b7-f370-4942-8da3-015a7d01c9be admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:46.404511 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc40d4-21e9-40a0-bbfe-b9c218f08e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:46.405166 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc40d4-21e9-40a0-bbfe-b9c218f08e9e admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:46.405516 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc40d4-21e9-40a0-bbfe-b9c218f08e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:46.405792 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc40d4-21e9-40a0-bbfe-b9c218f08e9e admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:46.406471 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc40d4-21e9-40a0-bbfe-b9c218f08e9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:46.408404 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc40d4-21e9-40a0-bbfe-b9c218f08e9e admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:46.428163 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1140/2283] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:12:46 2022] POST /identity/v3/users => generated 284 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:12:46.432243 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc40d4-21e9-40a0-bbfe-b9c218f08e9e admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:46.433875 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-94bc40d4-21e9-40a0-bbfe-b9c218f08e9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:46.444754 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1144/2284] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:12:46.446396 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc40d4-21e9-40a0-bbfe-b9c218f08e9e admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:46.451223 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d582479-557c-4a49-acff-cabcdc03bd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:46.451905 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d582479-557c-4a49-acff-cabcdc03bd2d admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:46.452193 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d582479-557c-4a49-acff-cabcdc03bd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:46.452485 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d582479-557c-4a49-acff-cabcdc03bd2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:46.452833 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a60e8-bd6e-4d05-b313-9e5cfd8b72f8 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:46.453136 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a60e8-bd6e-4d05-b313-9e5cfd8b72f8 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:46.453238 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d582479-557c-4a49-acff-cabcdc03bd2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:46.453426 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a60e8-bd6e-4d05-b313-9e5cfd8b72f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:46.454823 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d582479-557c-4a49-acff-cabcdc03bd2d admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:46.467364 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1141/2285] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:12:46.468593 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d582479-557c-4a49-acff-cabcdc03bd2d admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:46.470860 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-524a60e8-bd6e-4d05-b313-9e5cfd8b72f8 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:12:46.472113 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-524a60e8-bd6e-4d05-b313-9e5cfd8b72f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:46.478062 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d582479-557c-4a49-acff-cabcdc03bd2d admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:46.480284 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1145/2286] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:12:46.483238 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebacb49-1715-4916-bef8-9b539e7f64d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:46.484188 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebacb49-1715-4916-bef8-9b539e7f64d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:46.484469 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebacb49-1715-4916-bef8-9b539e7f64d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:46.484745 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebacb49-1715-4916-bef8-9b539e7f64d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:46.484927 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a60e8-bd6e-4d05-b313-9e5cfd8b72f8 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:46.485448 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebacb49-1715-4916-bef8-9b539e7f64d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:46.487017 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebacb49-1715-4916-bef8-9b539e7f64d9 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:46.494078 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a60e8-bd6e-4d05-b313-9e5cfd8b72f8 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:46.496737 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1142/2287] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:12:46.500643 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50438b09-c595-4c1e-970b-f016d341fbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:46.501296 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50438b09-c595-4c1e-970b-f016d341fbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:46.501580 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50438b09-c595-4c1e-970b-f016d341fbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:46.501851 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50438b09-c595-4c1e-970b-f016d341fbb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:46.502039 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebacb49-1715-4916-bef8-9b539e7f64d9 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:46.502575 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50438b09-c595-4c1e-970b-f016d341fbb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:12:46.502908 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50438b09-c595-4c1e-970b-f016d341fbb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:46.504582 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50438b09-c595-4c1e-970b-f016d341fbb7 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:46.511814 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebacb49-1715-4916-bef8-9b539e7f64d9 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:46.516022 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1146/2288] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 04:12:46.519616 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7e42b-797a-4094-baa0-2b19ef95ad11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:46.520164 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50438b09-c595-4c1e-970b-f016d341fbb7 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:46.520627 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7e42b-797a-4094-baa0-2b19ef95ad11 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:46.520913 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7e42b-797a-4094-baa0-2b19ef95ad11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:46.521192 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7e42b-797a-4094-baa0-2b19ef95ad11 admin admin] PATH_INFO: `/v3/projects/70b71a8eb30b499fb44441aefc4ba83c/users/83254b7430914209a94a6d03948fa257/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:46.529317 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50438b09-c595-4c1e-970b-f016d341fbb7 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:46.533875 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad5c05-50d0-44f5-96b3-e5525a5f6de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:46.534491 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad5c05-50d0-44f5-96b3-e5525a5f6de1 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:46.534774 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad5c05-50d0-44f5-96b3-e5525a5f6de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:46.535046 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad5c05-50d0-44f5-96b3-e5525a5f6de1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:46.535740 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad5c05-50d0-44f5-96b3-e5525a5f6de1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:46.536054 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7e42b-797a-4094-baa0-2b19ef95ad11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70b71a8eb30b499fb44441aefc4ba83c, user_id=83254b7430914209a94a6d03948fa257, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:46.537620 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad5c05-50d0-44f5-96b3-e5525a5f6de1 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:46.538722 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7e42b-797a-4094-baa0-2b19ef95ad11 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:46.553556 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1143/2289] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:12:46 2022] PUT /identity/v3/projects/70b71a8eb30b499fb44441aefc4ba83c/users/83254b7430914209a94a6d03948fa257/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:12:46.564844 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a052b4e-2316-4530-a8ef-9f43e2a97e59 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:46.565165 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a052b4e-2316-4530-a8ef-9f43e2a97e59 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:46.565495 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a052b4e-2316-4530-a8ef-9f43e2a97e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:46.572697 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1147/2290] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:12:46 2022] POST /identity/v3/projects => generated 397 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:12:46.577290 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad5c05-50d0-44f5-96b3-e5525a5f6de1 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:46.591731 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-9a052b4e-2316-4530-a8ef-9f43e2a97e59 None None] MFA Rules not processed for user `83254b7430914209a94a6d03948fa257`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:12:46.592930 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-9a052b4e-2316-4530-a8ef-9f43e2a97e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:46.640900 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad5c05-50d0-44f5-96b3-e5525a5f6de1 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:46.645487 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e9460-02ce-425c-90a5-289209c68734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:46.646150 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e9460-02ce-425c-90a5-289209c68734 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:46.646437 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e9460-02ce-425c-90a5-289209c68734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:46.646717 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e9460-02ce-425c-90a5-289209c68734 admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:46.647406 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e9460-02ce-425c-90a5-289209c68734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:46.649360 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e9460-02ce-425c-90a5-289209c68734 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:46.655575 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1144/2291] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:12:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:12:46.667359 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a052b4e-2316-4530-a8ef-9f43e2a97e59 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:46.668760 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-9a052b4e-2316-4530-a8ef-9f43e2a97e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:46.673724 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1148/2292] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:12:46 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:12:46.674706 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e9460-02ce-425c-90a5-289209c68734 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:46.683927 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e9460-02ce-425c-90a5-289209c68734 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:46.689564 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fc048-4be5-4e7d-a24e-0bfcb15716bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:46.690242 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fc048-4be5-4e7d-a24e-0bfcb15716bd admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:46.690530 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fc048-4be5-4e7d-a24e-0bfcb15716bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:46.690809 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fc048-4be5-4e7d-a24e-0bfcb15716bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:46.691832 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358fc048-4be5-4e7d-a24e-0bfcb15716bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:46.693413 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358fc048-4be5-4e7d-a24e-0bfcb15716bd admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:46.703358 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1149/2293] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:12:46.707150 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fc048-4be5-4e7d-a24e-0bfcb15716bd admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:46.716382 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fc048-4be5-4e7d-a24e-0bfcb15716bd admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:46.720880 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03de5f-972b-4988-84f3-5b0f8a768347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:46.721490 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03de5f-972b-4988-84f3-5b0f8a768347 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:46.721777 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03de5f-972b-4988-84f3-5b0f8a768347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:46.722049 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03de5f-972b-4988-84f3-5b0f8a768347 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:46.722782 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03de5f-972b-4988-84f3-5b0f8a768347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:46.724578 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03de5f-972b-4988-84f3-5b0f8a768347 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:46.726575 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a052b4e-2316-4530-a8ef-9f43e2a97e59 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:46.730374 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c53257-8291-4f65-afa4-0c9cdc402707 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:46.731098 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c53257-8291-4f65-afa4-0c9cdc402707 service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:46.731286 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c53257-8291-4f65-afa4-0c9cdc402707 service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:46.732128 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c53257-8291-4f65-afa4-0c9cdc402707 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:46.734984 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1150/2294] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:12:46.738664 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03de5f-972b-4988-84f3-5b0f8a768347 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:46.741053 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c53257-8291-4f65-afa4-0c9cdc402707 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:46.742509 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c53257-8291-4f65-afa4-0c9cdc402707 service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:46.749520 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03de5f-972b-4988-84f3-5b0f8a768347 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:46.751956 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1145/2295] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:12:46 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:12:46.754261 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a326d9-a9b0-447b-85b5-160ed42e2990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:46.755138 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a326d9-a9b0-447b-85b5-160ed42e2990 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:46.755425 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a326d9-a9b0-447b-85b5-160ed42e2990 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:46.755725 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a326d9-a9b0-447b-85b5-160ed42e2990 admin admin] PATH_INFO: `/v3/projects/5fdda36907314afeb519b1e04d64c071/users/b7cac32a8585434a8d71dd8192c3bbe6/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:46.770558 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a326d9-a9b0-447b-85b5-160ed42e2990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fdda36907314afeb519b1e04d64c071, user_id=b7cac32a8585434a8d71dd8192c3bbe6, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:46.773226 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a326d9-a9b0-447b-85b5-160ed42e2990 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:46.786603 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1151/2296] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:12:46 2022] PUT /identity/v3/projects/5fdda36907314afeb519b1e04d64c071/users/b7cac32a8585434a8d71dd8192c3bbe6/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:12:46.798239 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bec6c4-eedb-4ab2-89e4-c5541e4fd782 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:46.798553 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bec6c4-eedb-4ab2-89e4-c5541e4fd782 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:46.798834 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bec6c4-eedb-4ab2-89e4-c5541e4fd782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:46.824219 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-34bec6c4-eedb-4ab2-89e4-c5541e4fd782 None None] MFA Rules not processed for user `b7cac32a8585434a8d71dd8192c3bbe6`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:12:46.825417 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-34bec6c4-eedb-4ab2-89e4-c5541e4fd782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:46.892765 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1146/2297] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:12:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:12:46.900685 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a326d9-a9b0-447b-85b5-160ed42e2990 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:46.902434 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-13a326d9-a9b0-447b-85b5-160ed42e2990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:46.961214 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a326d9-a9b0-447b-85b5-160ed42e2990 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:46.965071 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac48cac-d9fb-4d10-a792-773d88323338 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:46.966453 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac48cac-d9fb-4d10-a792-773d88323338 service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:46.966641 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac48cac-d9fb-4d10-a792-773d88323338 service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:46.967047 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac48cac-d9fb-4d10-a792-773d88323338 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:46.975942 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac48cac-d9fb-4d10-a792-773d88323338 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:46.977282 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac48cac-d9fb-4d10-a792-773d88323338 service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:46.987004 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1152/2298] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:12:46 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:12:55.149948 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bec6c4-eedb-4ab2-89e4-c5541e4fd782 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:55.210135 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bec6c4-eedb-4ab2-89e4-c5541e4fd782 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:55.214642 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc7f28-c689-4eca-890c-de05f7afc767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:55.215481 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc7f28-c689-4eca-890c-de05f7afc767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:55.216285 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc7f28-c689-4eca-890c-de05f7afc767 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:55.216569 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc7f28-c689-4eca-890c-de05f7afc767 admin admin] PATH_INFO: `/v3/users/b7cac32a8585434a8d71dd8192c3bbe6` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:55.217934 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc7f28-c689-4eca-890c-de05f7afc767 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7cac32a8585434a8d71dd8192c3bbe6)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:55.219874 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc7f28-c689-4eca-890c-de05f7afc767 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:55.264637 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-26bc7f28-c689-4eca-890c-de05f7afc767 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7cac32a8585434a8d71dd8192c3bbe6'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:55.270990 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-26bc7f28-c689-4eca-890c-de05f7afc767 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7cac32a8585434a8d71dd8192c3bbe6'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:55.277916 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-26bc7f28-c689-4eca-890c-de05f7afc767 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7cac32a8585434a8d71dd8192c3bbe6'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:55.289371 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-26bc7f28-c689-4eca-890c-de05f7afc767 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7cac32a8585434a8d71dd8192c3bbe6'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:55.290004 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-26bc7f28-c689-4eca-890c-de05f7afc767 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7cac32a8585434a8d71dd8192c3bbe6'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:55.296155 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1147/2299] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:12:55 2022] DELETE /identity/v3/users/b7cac32a8585434a8d71dd8192c3bbe6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:12:55.305912 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d16f4-a6db-4144-b02d-06a08f25aa32 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:55.306450 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d16f4-a6db-4144-b02d-06a08f25aa32 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:55.306450 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d16f4-a6db-4144-b02d-06a08f25aa32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:55.323107 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-c65d16f4-a6db-4144-b02d-06a08f25aa32 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:12:55.324327 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-c65d16f4-a6db-4144-b02d-06a08f25aa32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:55.379589 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1153/2300] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:12:55.389533 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc7f28-c689-4eca-890c-de05f7afc767 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:55.390933 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-26bc7f28-c689-4eca-890c-de05f7afc767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:55.445243 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc7f28-c689-4eca-890c-de05f7afc767 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:55.448848 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3746a4d-a9bb-45e2-a571-085e66e32307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:55.449479 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3746a4d-a9bb-45e2-a571-085e66e32307 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:55.449759 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3746a4d-a9bb-45e2-a571-085e66e32307 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:55.450527 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3746a4d-a9bb-45e2-a571-085e66e32307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:55.459132 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3746a4d-a9bb-45e2-a571-085e66e32307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:55.460603 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3746a4d-a9bb-45e2-a571-085e66e32307 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:55.470185 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1148/2301] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:12:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:12:55.723664 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d16f4-a6db-4144-b02d-06a08f25aa32 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:55.725109 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-c65d16f4-a6db-4144-b02d-06a08f25aa32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:55.738523 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d16f4-a6db-4144-b02d-06a08f25aa32 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:55.743872 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba14b8-fc2b-4f15-a558-d8a939d72f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:55.744731 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba14b8-fc2b-4f15-a558-d8a939d72f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:55.745028 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba14b8-fc2b-4f15-a558-d8a939d72f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:55.745265 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba14b8-fc2b-4f15-a558-d8a939d72f45 admin admin] PATH_INFO: `/v3/projects/5fdda36907314afeb519b1e04d64c071` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:55.746522 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba14b8-fc2b-4f15-a558-d8a939d72f45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fdda36907314afeb519b1e04d64c071)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:55.749227 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba14b8-fc2b-4f15-a558-d8a939d72f45 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:55.797862 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-4bba14b8-fc2b-4f15-a558-d8a939d72f45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fdda36907314afeb519b1e04d64c071', 'request_id': 'req-4bba14b8-fc2b-4f15-a558-d8a939d72f45'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:55.803214 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-4bba14b8-fc2b-4f15-a558-d8a939d72f45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fdda36907314afeb519b1e04d64c071', 'request_id': 'req-4bba14b8-fc2b-4f15-a558-d8a939d72f45'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:55.809771 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-4bba14b8-fc2b-4f15-a558-d8a939d72f45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fdda36907314afeb519b1e04d64c071', 'request_id': 'req-4bba14b8-fc2b-4f15-a558-d8a939d72f45'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:55.821684 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-4bba14b8-fc2b-4f15-a558-d8a939d72f45 admin admin] The token cache is being invalidate because project 5fdda36907314afeb519b1e04d64c071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:12:55.821974 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-4bba14b8-fc2b-4f15-a558-d8a939d72f45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:55.822593 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-4bba14b8-fc2b-4f15-a558-d8a939d72f45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:55.824143 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1154/2302] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:12:55 2022] DELETE /identity/v3/projects/5fdda36907314afeb519b1e04d64c071 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:12:55.985610 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3746a4d-a9bb-45e2-a571-085e66e32307 service neutron] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:55.987161 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-b3746a4d-a9bb-45e2-a571-085e66e32307 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:56.005550 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3746a4d-a9bb-45e2-a571-085e66e32307 service neutron] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:56.058317 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826c3db-4a53-4025-969a-363b17fb1688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:56.059177 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826c3db-4a53-4025-969a-363b17fb1688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:56.059987 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826c3db-4a53-4025-969a-363b17fb1688 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:56.060260 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826c3db-4a53-4025-969a-363b17fb1688 admin admin] PATH_INFO: `/v3/users/83254b7430914209a94a6d03948fa257` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:56.061422 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826c3db-4a53-4025-969a-363b17fb1688 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83254b7430914209a94a6d03948fa257)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:56.063302 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826c3db-4a53-4025-969a-363b17fb1688 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:56.107254 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-a826c3db-4a53-4025-969a-363b17fb1688 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83254b7430914209a94a6d03948fa257'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:56.113689 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-a826c3db-4a53-4025-969a-363b17fb1688 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83254b7430914209a94a6d03948fa257'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:56.120810 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-a826c3db-4a53-4025-969a-363b17fb1688 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83254b7430914209a94a6d03948fa257'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:56.132843 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-a826c3db-4a53-4025-969a-363b17fb1688 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83254b7430914209a94a6d03948fa257'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:56.133475 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-a826c3db-4a53-4025-969a-363b17fb1688 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83254b7430914209a94a6d03948fa257'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:56.139106 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1149/2303] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:12:55 2022] DELETE /identity/v3/users/83254b7430914209a94a6d03948fa257 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:12:56.143603 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873586c6-b027-4c2e-a129-4f89ef075e5d None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:56.143942 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873586c6-b027-4c2e-a129-4f89ef075e5d None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:56.144207 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873586c6-b027-4c2e-a129-4f89ef075e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:56.161278 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-873586c6-b027-4c2e-a129-4f89ef075e5d None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:12:56.162464 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-873586c6-b027-4c2e-a129-4f89ef075e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:56.217726 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1155/2304] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:12:56.227051 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826c3db-4a53-4025-969a-363b17fb1688 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:56.228473 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-a826c3db-4a53-4025-969a-363b17fb1688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:56.282729 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826c3db-4a53-4025-969a-363b17fb1688 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:56.286335 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8a85d-b857-435a-938c-237d4645cced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:56.286964 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8a85d-b857-435a-938c-237d4645cced service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:56.287242 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8a85d-b857-435a-938c-237d4645cced service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:56.287514 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8a85d-b857-435a-938c-237d4645cced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:56.296620 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8a85d-b857-435a-938c-237d4645cced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:56.298019 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8a85d-b857-435a-938c-237d4645cced service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:56.307018 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1150/2305] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:12:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:12:56.569352 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873586c6-b027-4c2e-a129-4f89ef075e5d None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:56.570832 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-873586c6-b027-4c2e-a129-4f89ef075e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:56.583992 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873586c6-b027-4c2e-a129-4f89ef075e5d None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:56.588605 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a61a1-d716-44a6-95e0-b7b2c7896156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:56.589462 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a61a1-d716-44a6-95e0-b7b2c7896156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:56.589748 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a61a1-d716-44a6-95e0-b7b2c7896156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:56.590060 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a61a1-d716-44a6-95e0-b7b2c7896156 admin admin] PATH_INFO: `/v3/projects/70b71a8eb30b499fb44441aefc4ba83c` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:56.592189 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a61a1-d716-44a6-95e0-b7b2c7896156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70b71a8eb30b499fb44441aefc4ba83c)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:56.594106 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a61a1-d716-44a6-95e0-b7b2c7896156 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:56.640071 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-148a61a1-d716-44a6-95e0-b7b2c7896156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70b71a8eb30b499fb44441aefc4ba83c', 'request_id': 'req-148a61a1-d716-44a6-95e0-b7b2c7896156'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:56.645861 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-148a61a1-d716-44a6-95e0-b7b2c7896156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70b71a8eb30b499fb44441aefc4ba83c', 'request_id': 'req-148a61a1-d716-44a6-95e0-b7b2c7896156'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:56.651909 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-148a61a1-d716-44a6-95e0-b7b2c7896156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70b71a8eb30b499fb44441aefc4ba83c', 'request_id': 'req-148a61a1-d716-44a6-95e0-b7b2c7896156'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:56.664275 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-148a61a1-d716-44a6-95e0-b7b2c7896156 admin admin] The token cache is being invalidate because project 70b71a8eb30b499fb44441aefc4ba83c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:12:56.664567 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-148a61a1-d716-44a6-95e0-b7b2c7896156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:56.665200 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-148a61a1-d716-44a6-95e0-b7b2c7896156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:12:56.666712 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1156/2306] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:12:56 2022] DELETE /identity/v3/projects/70b71a8eb30b499fb44441aefc4ba83c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:12:56.672188 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3614886-4eab-412d-ac9d-a87373b9d0ea None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:56.672476 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3614886-4eab-412d-ac9d-a87373b9d0ea None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:56.672754 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3614886-4eab-412d-ac9d-a87373b9d0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:56.690185 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-c3614886-4eab-412d-ac9d-a87373b9d0ea None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:12:56.691628 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-c3614886-4eab-412d-ac9d-a87373b9d0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:56.750315 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1151/2307] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:12:56.758156 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4590c-0c54-4988-8b8a-76d3f16219b9 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:56.758450 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4590c-0c54-4988-8b8a-76d3f16219b9 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:56.758731 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4590c-0c54-4988-8b8a-76d3f16219b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:56.777579 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-d1b4590c-0c54-4988-8b8a-76d3f16219b9 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:12:56.779263 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-d1b4590c-0c54-4988-8b8a-76d3f16219b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:56.788049 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1157/2308] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:12:56.792163 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3614886-4eab-412d-ac9d-a87373b9d0ea None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:56.803170 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3614886-4eab-412d-ac9d-a87373b9d0ea None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:56.808194 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8c3a2-3878-4d27-8762-6f5f19548a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:56.808837 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8c3a2-3878-4d27-8762-6f5f19548a92 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:56.809123 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8c3a2-3878-4d27-8762-6f5f19548a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:56.809428 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8c3a2-3878-4d27-8762-6f5f19548a92 admin admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:56.810149 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8c3a2-3878-4d27-8762-6f5f19548a92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:12:56.810456 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8c3a2-3878-4d27-8762-6f5f19548a92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:56.812110 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8c3a2-3878-4d27-8762-6f5f19548a92 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:56.824223 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1152/2309] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:12:56.828486 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4590c-0c54-4988-8b8a-76d3f16219b9 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:56.837596 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4590c-0c54-4988-8b8a-76d3f16219b9 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:56.843987 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1767f-6c35-4292-95b8-a6350b4a981b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:56.845072 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1767f-6c35-4292-95b8-a6350b4a981b admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:56.845582 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1767f-6c35-4292-95b8-a6350b4a981b admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:56.846076 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1767f-6c35-4292-95b8-a6350b4a981b admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:56.847355 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1767f-6c35-4292-95b8-a6350b4a981b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:56.851176 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1767f-6c35-4292-95b8-a6350b4a981b admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:56.876971 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1158/2310] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:12:56 2022] POST /identity/v3/projects => generated 355 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:12:56.881179 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8c3a2-3878-4d27-8762-6f5f19548a92 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:56.891257 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8c3a2-3878-4d27-8762-6f5f19548a92 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:56.943516 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bbc67-745e-4389-8408-6afb4da2afe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:56.944196 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bbc67-745e-4389-8408-6afb4da2afe6 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:56.944477 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bbc67-745e-4389-8408-6afb4da2afe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:56.944750 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bbc67-745e-4389-8408-6afb4da2afe6 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:56.945422 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bbc67-745e-4389-8408-6afb4da2afe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:56.947431 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bbc67-745e-4389-8408-6afb4da2afe6 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:56.967182 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1153/2311] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:12:56 2022] POST /identity/v3/users => generated 278 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:12:56.971336 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1767f-6c35-4292-95b8-a6350b4a981b admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:56.981850 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1767f-6c35-4292-95b8-a6350b4a981b admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:56.986401 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578d89d-272f-46ea-b571-201243ae4aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:56.987045 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578d89d-272f-46ea-b571-201243ae4aab admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:56.987329 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578d89d-272f-46ea-b571-201243ae4aab admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:56.987606 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578d89d-272f-46ea-b571-201243ae4aab admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:56.988366 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d578d89d-272f-46ea-b571-201243ae4aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:56.989961 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d578d89d-272f-46ea-b571-201243ae4aab admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:57.000740 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1159/2312] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:12:57.004550 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bbc67-745e-4389-8408-6afb4da2afe6 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:57.014961 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bbc67-745e-4389-8408-6afb4da2afe6 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:57.019500 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec7468-251e-41cf-bb58-27ba2138d92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:57.020180 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec7468-251e-41cf-bb58-27ba2138d92f admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:57.020461 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec7468-251e-41cf-bb58-27ba2138d92f admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:57.020736 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec7468-251e-41cf-bb58-27ba2138d92f admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:57.021449 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec7468-251e-41cf-bb58-27ba2138d92f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:57.023037 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec7468-251e-41cf-bb58-27ba2138d92f admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:57.032657 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1154/2313] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:12:57.036621 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578d89d-272f-46ea-b571-201243ae4aab admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:57.046750 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578d89d-272f-46ea-b571-201243ae4aab admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:57.051376 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d71210-66c6-4f74-85d8-bfe9638e0461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:57.052287 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d71210-66c6-4f74-85d8-bfe9638e0461 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:57.052563 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d71210-66c6-4f74-85d8-bfe9638e0461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:57.052835 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d71210-66c6-4f74-85d8-bfe9638e0461 admin admin] PATH_INFO: `/v3/projects/edb1218a02e14a508e1c2f41803cf86c/users/d1f638d79d704321a3c53618207a0d57/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:57.067762 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d71210-66c6-4f74-85d8-bfe9638e0461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edb1218a02e14a508e1c2f41803cf86c, user_id=d1f638d79d704321a3c53618207a0d57, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:57.070431 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d71210-66c6-4f74-85d8-bfe9638e0461 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:57.083465 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1160/2314] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:12:57 2022] PUT /identity/v3/projects/edb1218a02e14a508e1c2f41803cf86c/users/d1f638d79d704321a3c53618207a0d57/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:12:57.094979 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902e8d2-8f56-46d9-a830-78687033ceed None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:57.095268 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902e8d2-8f56-46d9-a830-78687033ceed None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:57.095546 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902e8d2-8f56-46d9-a830-78687033ceed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:57.128479 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-2902e8d2-8f56-46d9-a830-78687033ceed None None] MFA Rules not processed for user `d1f638d79d704321a3c53618207a0d57`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:12:57.129680 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-2902e8d2-8f56-46d9-a830-78687033ceed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:57.191487 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1155/2315] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:12:57 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:12:57.195929 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d71210-66c6-4f74-85d8-bfe9638e0461 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:57.254606 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d71210-66c6-4f74-85d8-bfe9638e0461 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:57.259038 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e3687-0fdd-4a7c-9ab4-9388d313613f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:57.259676 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e3687-0fdd-4a7c-9ab4-9388d313613f admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:57.259986 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e3687-0fdd-4a7c-9ab4-9388d313613f admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:57.260262 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e3687-0fdd-4a7c-9ab4-9388d313613f admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:57.260944 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e3687-0fdd-4a7c-9ab4-9388d313613f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:57.262871 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064e3687-0fdd-4a7c-9ab4-9388d313613f admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:57.286976 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1161/2316] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:12:57 2022] POST /identity/v3/projects => generated 355 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:12:57.291052 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902e8d2-8f56-46d9-a830-78687033ceed None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:57.302783 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902e8d2-8f56-46d9-a830-78687033ceed None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:57.355930 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19406636-d1a3-48e7-842b-536250bdc249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:57.357139 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19406636-d1a3-48e7-842b-536250bdc249 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:57.357424 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19406636-d1a3-48e7-842b-536250bdc249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:57.357702 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19406636-d1a3-48e7-842b-536250bdc249 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:57.358379 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19406636-d1a3-48e7-842b-536250bdc249 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:57.360410 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19406636-d1a3-48e7-842b-536250bdc249 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:57.379163 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1156/2317] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:12:57 2022] POST /identity/v3/users => generated 284 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:12:57.383034 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e3687-0fdd-4a7c-9ab4-9388d313613f admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:57.393363 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e3687-0fdd-4a7c-9ab4-9388d313613f admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:57.398027 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c58bfb-c02a-4ab4-8dcb-9326d7a78b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:57.398678 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c58bfb-c02a-4ab4-8dcb-9326d7a78b8a admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:57.398961 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c58bfb-c02a-4ab4-8dcb-9326d7a78b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:57.399238 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c58bfb-c02a-4ab4-8dcb-9326d7a78b8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:57.399997 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c58bfb-c02a-4ab4-8dcb-9326d7a78b8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:57.401563 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c58bfb-c02a-4ab4-8dcb-9326d7a78b8a admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:57.411987 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1162/2318] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:12:57.415875 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19406636-d1a3-48e7-842b-536250bdc249 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:57.425938 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19406636-d1a3-48e7-842b-536250bdc249 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:57.430379 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f8f27-cf84-42aa-973f-66ee7d463ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:57.431237 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f8f27-cf84-42aa-973f-66ee7d463ce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:57.431520 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f8f27-cf84-42aa-973f-66ee7d463ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:57.431827 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f8f27-cf84-42aa-973f-66ee7d463ce3 admin admin] PATH_INFO: `/v3/projects/0c91485de57043c5a5a6f3d4560e6c09/users/f10bc2ed8ede49f0a93418a1852c18ab/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:57.446384 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f8f27-cf84-42aa-973f-66ee7d463ce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c91485de57043c5a5a6f3d4560e6c09, user_id=f10bc2ed8ede49f0a93418a1852c18ab, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:57.449130 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f8f27-cf84-42aa-973f-66ee7d463ce3 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:57.461510 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1157/2319] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:12:57 2022] PUT /identity/v3/projects/0c91485de57043c5a5a6f3d4560e6c09/users/f10bc2ed8ede49f0a93418a1852c18ab/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:12:57.466022 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c58bfb-c02a-4ab4-8dcb-9326d7a78b8a admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:57.475952 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c58bfb-c02a-4ab4-8dcb-9326d7a78b8a admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:57.529036 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44108cc-250f-4f77-98e9-d1056b815da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:57.529617 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44108cc-250f-4f77-98e9-d1056b815da4 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:57.529896 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44108cc-250f-4f77-98e9-d1056b815da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:57.530169 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44108cc-250f-4f77-98e9-d1056b815da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:57.530885 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44108cc-250f-4f77-98e9-d1056b815da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:57.532496 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44108cc-250f-4f77-98e9-d1056b815da4 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:57.541701 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1163/2320] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:12:57.546399 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f8f27-cf84-42aa-973f-66ee7d463ce3 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:57.556421 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f8f27-cf84-42aa-973f-66ee7d463ce3 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:57.560946 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f7263-8596-4d21-a4a7-49f22ae39512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:57.561825 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f7263-8596-4d21-a4a7-49f22ae39512 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:57.562103 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f7263-8596-4d21-a4a7-49f22ae39512 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:57.562373 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f7263-8596-4d21-a4a7-49f22ae39512 admin admin] PATH_INFO: `/v3/projects/0c91485de57043c5a5a6f3d4560e6c09/users/f10bc2ed8ede49f0a93418a1852c18ab/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:57.564529 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f7263-8596-4d21-a4a7-49f22ae39512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c91485de57043c5a5a6f3d4560e6c09, user_id=f10bc2ed8ede49f0a93418a1852c18ab, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:57.567404 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f7263-8596-4d21-a4a7-49f22ae39512 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:57.577213 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1158/2321] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:12:57 2022] PUT /identity/v3/projects/0c91485de57043c5a5a6f3d4560e6c09/users/f10bc2ed8ede49f0a93418a1852c18ab/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:12:57.586876 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422043a-09c4-42fa-badb-ff4cb537c681 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:57.587379 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422043a-09c4-42fa-badb-ff4cb537c681 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:57.587489 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422043a-09c4-42fa-badb-ff4cb537c681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:57.613593 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-5422043a-09c4-42fa-badb-ff4cb537c681 None None] MFA Rules not processed for user `f10bc2ed8ede49f0a93418a1852c18ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:12:57.614805 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-5422043a-09c4-42fa-badb-ff4cb537c681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:57.679988 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1164/2322] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:12:57 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:12:57.691438 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f7263-8596-4d21-a4a7-49f22ae39512 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:57.693118 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-a69f7263-8596-4d21-a4a7-49f22ae39512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:12:57.746806 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f7263-8596-4d21-a4a7-49f22ae39512 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:57.750409 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591662a-f49c-4c5e-98f1-6591943d2515 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:57.751033 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591662a-f49c-4c5e-98f1-6591943d2515 service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:57.751319 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591662a-f49c-4c5e-98f1-6591943d2515 service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:57.751585 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591662a-f49c-4c5e-98f1-6591943d2515 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:57.760331 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591662a-f49c-4c5e-98f1-6591943d2515 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:57.761737 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591662a-f49c-4c5e-98f1-6591943d2515 service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:57.771340 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1159/2323] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:12:57 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:12:57.843713 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422043a-09c4-42fa-badb-ff4cb537c681 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:12:57.853034 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422043a-09c4-42fa-badb-ff4cb537c681 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:12:57.856713 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa8d390-19e1-4793-955c-e5f0e69903be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:12:57.857343 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8d390-19e1-4793-955c-e5f0e69903be service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:12:57.857624 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8d390-19e1-4793-955c-e5f0e69903be service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:12:57.857903 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8d390-19e1-4793-955c-e5f0e69903be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:12:57.912479 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa8d390-19e1-4793-955c-e5f0e69903be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:12:57.913906 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa8d390-19e1-4793-955c-e5f0e69903be service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:12:57.922725 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1165/2324] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:12:57 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:13:11.571798 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50221e83-b6e8-44a1-9ee8-08c87e5965f4 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:11.572266 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50221e83-b6e8-44a1-9ee8-08c87e5965f4 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:11.572368 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50221e83-b6e8-44a1-9ee8-08c87e5965f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:11.591323 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-50221e83-b6e8-44a1-9ee8-08c87e5965f4 None None] MFA Rules not processed for user `af9aa388314f4cfca823c8d13f67a8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:13:11.592575 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-50221e83-b6e8-44a1-9ee8-08c87e5965f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:11.646892 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1160/2325] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:13:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:13:12.772906 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa8d390-19e1-4793-955c-e5f0e69903be service cinder] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:12.834853 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa8d390-19e1-4793-955c-e5f0e69903be service cinder] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:12.839398 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1137973-3c41-473f-8b5e-e6f51b6867a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:12.840913 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1137973-3c41-473f-8b5e-e6f51b6867a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:12.841193 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1137973-3c41-473f-8b5e-e6f51b6867a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:12.841467 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1137973-3c41-473f-8b5e-e6f51b6867a7 admin admin] PATH_INFO: `/v3/users/d1f638d79d704321a3c53618207a0d57` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:12.842657 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1137973-3c41-473f-8b5e-e6f51b6867a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1f638d79d704321a3c53618207a0d57)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:12.844620 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1137973-3c41-473f-8b5e-e6f51b6867a7 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:12.889650 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-d1137973-3c41-473f-8b5e-e6f51b6867a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1f638d79d704321a3c53618207a0d57'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:12.890368 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-d1137973-3c41-473f-8b5e-e6f51b6867a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1f638d79d704321a3c53618207a0d57'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:12.897243 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-d1137973-3c41-473f-8b5e-e6f51b6867a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1f638d79d704321a3c53618207a0d57'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:12.909156 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-d1137973-3c41-473f-8b5e-e6f51b6867a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1f638d79d704321a3c53618207a0d57'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:12.909786 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-d1137973-3c41-473f-8b5e-e6f51b6867a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1f638d79d704321a3c53618207a0d57'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:12.921952 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1166/2326] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:13:12 2022] DELETE /identity/v3/users/d1f638d79d704321a3c53618207a0d57 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:13:12.926653 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef559e0-a033-47a1-bf4d-7ed76213be07 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:12.927140 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef559e0-a033-47a1-bf4d-7ed76213be07 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:12.927252 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef559e0-a033-47a1-bf4d-7ed76213be07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:12.944564 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-5ef559e0-a033-47a1-bf4d-7ed76213be07 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:13:12.945751 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-5ef559e0-a033-47a1-bf4d-7ed76213be07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:13.001363 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1161/2327] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:13:13.010836 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1137973-3c41-473f-8b5e-e6f51b6867a7 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:13.012914 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-d1137973-3c41-473f-8b5e-e6f51b6867a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:13.066820 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1137973-3c41-473f-8b5e-e6f51b6867a7 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:13.070509 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731b779-b204-4d75-9db2-0c34bce3f9b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:13.071152 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731b779-b204-4d75-9db2-0c34bce3f9b3 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:13.071450 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731b779-b204-4d75-9db2-0c34bce3f9b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:13.071761 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731b779-b204-4d75-9db2-0c34bce3f9b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:13.081557 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731b779-b204-4d75-9db2-0c34bce3f9b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:13.082988 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731b779-b204-4d75-9db2-0c34bce3f9b3 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:13.092350 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1167/2328] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:13:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:13:13.452639 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef559e0-a033-47a1-bf4d-7ed76213be07 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:13.454329 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-5ef559e0-a033-47a1-bf4d-7ed76213be07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:13.468884 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef559e0-a033-47a1-bf4d-7ed76213be07 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:13.474379 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c661c5-a4c2-40ad-826f-88b3890e6ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:13.475249 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c661c5-a4c2-40ad-826f-88b3890e6ebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:13.482452 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c661c5-a4c2-40ad-826f-88b3890e6ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:13.485701 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c661c5-a4c2-40ad-826f-88b3890e6ebd admin admin] PATH_INFO: `/v3/projects/edb1218a02e14a508e1c2f41803cf86c` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:13.489812 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c661c5-a4c2-40ad-826f-88b3890e6ebd admin admin] RBAC: Authorizing `identity:delete_project(project_id=edb1218a02e14a508e1c2f41803cf86c)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:13.491769 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c661c5-a4c2-40ad-826f-88b3890e6ebd admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:13.538805 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-c6c661c5-a4c2-40ad-826f-88b3890e6ebd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edb1218a02e14a508e1c2f41803cf86c', 'request_id': 'req-c6c661c5-a4c2-40ad-826f-88b3890e6ebd'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:13.545882 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-c6c661c5-a4c2-40ad-826f-88b3890e6ebd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edb1218a02e14a508e1c2f41803cf86c', 'request_id': 'req-c6c661c5-a4c2-40ad-826f-88b3890e6ebd'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:13.552173 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-c6c661c5-a4c2-40ad-826f-88b3890e6ebd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edb1218a02e14a508e1c2f41803cf86c', 'request_id': 'req-c6c661c5-a4c2-40ad-826f-88b3890e6ebd'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:13.564640 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-c6c661c5-a4c2-40ad-826f-88b3890e6ebd admin admin] The token cache is being invalidate because project edb1218a02e14a508e1c2f41803cf86c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:13:13.564956 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-c6c661c5-a4c2-40ad-826f-88b3890e6ebd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:13.565593 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-c6c661c5-a4c2-40ad-826f-88b3890e6ebd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:13.567836 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1162/2329] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:13:13 2022] DELETE /identity/v3/projects/edb1218a02e14a508e1c2f41803cf86c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:13:13.571520 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731b779-b204-4d75-9db2-0c34bce3f9b3 service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:13.581288 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731b779-b204-4d75-9db2-0c34bce3f9b3 service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:13.637992 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d87d56-0384-461f-8cbb-4a624db38118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:13.638977 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d87d56-0384-461f-8cbb-4a624db38118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:13.639493 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d87d56-0384-461f-8cbb-4a624db38118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:13.639838 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d87d56-0384-461f-8cbb-4a624db38118 admin admin] PATH_INFO: `/v3/users/f10bc2ed8ede49f0a93418a1852c18ab` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:13.641040 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d87d56-0384-461f-8cbb-4a624db38118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f10bc2ed8ede49f0a93418a1852c18ab)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:13.642975 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d87d56-0384-461f-8cbb-4a624db38118 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:13.688672 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-46d87d56-0384-461f-8cbb-4a624db38118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f10bc2ed8ede49f0a93418a1852c18ab'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:13.689332 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-46d87d56-0384-461f-8cbb-4a624db38118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f10bc2ed8ede49f0a93418a1852c18ab'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:13.696408 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-46d87d56-0384-461f-8cbb-4a624db38118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f10bc2ed8ede49f0a93418a1852c18ab'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:13.707916 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-46d87d56-0384-461f-8cbb-4a624db38118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f10bc2ed8ede49f0a93418a1852c18ab'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:13.708585 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-46d87d56-0384-461f-8cbb-4a624db38118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f10bc2ed8ede49f0a93418a1852c18ab'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:13.721097 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1168/2330] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:13:13 2022] DELETE /identity/v3/users/f10bc2ed8ede49f0a93418a1852c18ab => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:13:13.990260 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c661c5-a4c2-40ad-826f-88b3890e6ebd admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:13.992566 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-c6c661c5-a4c2-40ad-826f-88b3890e6ebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:14.017807 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c661c5-a4c2-40ad-826f-88b3890e6ebd admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:14.080918 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6841c0-24a7-44fb-ae3d-411d9d22d55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:14.081959 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6841c0-24a7-44fb-ae3d-411d9d22d55e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:14.082433 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6841c0-24a7-44fb-ae3d-411d9d22d55e admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:14.082712 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6841c0-24a7-44fb-ae3d-411d9d22d55e admin admin] PATH_INFO: `/v3/projects/0c91485de57043c5a5a6f3d4560e6c09` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:14.083981 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6841c0-24a7-44fb-ae3d-411d9d22d55e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c91485de57043c5a5a6f3d4560e6c09)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:14.086075 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6841c0-24a7-44fb-ae3d-411d9d22d55e admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:14.141271 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-4e6841c0-24a7-44fb-ae3d-411d9d22d55e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c91485de57043c5a5a6f3d4560e6c09', 'request_id': 'req-4e6841c0-24a7-44fb-ae3d-411d9d22d55e'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:14.147645 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-4e6841c0-24a7-44fb-ae3d-411d9d22d55e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c91485de57043c5a5a6f3d4560e6c09', 'request_id': 'req-4e6841c0-24a7-44fb-ae3d-411d9d22d55e'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:14.154794 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-4e6841c0-24a7-44fb-ae3d-411d9d22d55e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c91485de57043c5a5a6f3d4560e6c09', 'request_id': 'req-4e6841c0-24a7-44fb-ae3d-411d9d22d55e'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:14.168788 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-4e6841c0-24a7-44fb-ae3d-411d9d22d55e admin admin] The token cache is being invalidate because project 0c91485de57043c5a5a6f3d4560e6c09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:13:14.169075 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-4e6841c0-24a7-44fb-ae3d-411d9d22d55e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:14.169913 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-4e6841c0-24a7-44fb-ae3d-411d9d22d55e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:14.172028 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1163/2331] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:13:13 2022] DELETE /identity/v3/projects/0c91485de57043c5a5a6f3d4560e6c09 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:13:14.176904 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ba6c2-e4f0-44f1-91a3-c2cb4884e9b4 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:14.177390 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ba6c2-e4f0-44f1-91a3-c2cb4884e9b4 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:14.177616 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ba6c2-e4f0-44f1-91a3-c2cb4884e9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:14.196739 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-248ba6c2-e4f0-44f1-91a3-c2cb4884e9b4 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:13:14.197961 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-248ba6c2-e4f0-44f1-91a3-c2cb4884e9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:14.270606 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1169/2332] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:13:14.272317 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7432ec-d801-46c9-aeeb-cb50b70b46ab None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:14.272614 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7432ec-d801-46c9-aeeb-cb50b70b46ab None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:14.272899 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7432ec-d801-46c9-aeeb-cb50b70b46ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:14.291415 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-cb7432ec-d801-46c9-aeeb-cb50b70b46ab None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:13:14.292656 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-cb7432ec-d801-46c9-aeeb-cb50b70b46ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:14.300662 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1164/2333] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:13:14.304921 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ba6c2-e4f0-44f1-91a3-c2cb4884e9b4 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:14.315280 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ba6c2-e4f0-44f1-91a3-c2cb4884e9b4 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:14.320295 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36051a10-1a59-484d-915a-69c68f55b660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:14.320952 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36051a10-1a59-484d-915a-69c68f55b660 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:14.321239 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36051a10-1a59-484d-915a-69c68f55b660 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:14.321522 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36051a10-1a59-484d-915a-69c68f55b660 admin admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:14.322258 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36051a10-1a59-484d-915a-69c68f55b660 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:13:14.322570 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36051a10-1a59-484d-915a-69c68f55b660 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:14.324770 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36051a10-1a59-484d-915a-69c68f55b660 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:14.336478 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1170/2334] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 04:13:14.341306 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7432ec-d801-46c9-aeeb-cb50b70b46ab None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:14.350440 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7432ec-d801-46c9-aeeb-cb50b70b46ab None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:14.355193 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362809b1-bf9c-4f52-91ed-bd8324a1de57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:14.355947 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362809b1-bf9c-4f52-91ed-bd8324a1de57 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:14.356224 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362809b1-bf9c-4f52-91ed-bd8324a1de57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:14.356497 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362809b1-bf9c-4f52-91ed-bd8324a1de57 admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:14.357180 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362809b1-bf9c-4f52-91ed-bd8324a1de57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:14.359060 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362809b1-bf9c-4f52-91ed-bd8324a1de57 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:14.384664 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1165/2335] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:13:14 2022] POST /identity/v3/projects => generated 391 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:13:14.389280 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36051a10-1a59-484d-915a-69c68f55b660 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:14.399394 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36051a10-1a59-484d-915a-69c68f55b660 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:14.461120 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33023f2b-c080-493b-9a91-1828e8c32a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:14.462446 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33023f2b-c080-493b-9a91-1828e8c32a44 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:14.462744 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33023f2b-c080-493b-9a91-1828e8c32a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:14.463094 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33023f2b-c080-493b-9a91-1828e8c32a44 admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:14.463819 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33023f2b-c080-493b-9a91-1828e8c32a44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:14.466567 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33023f2b-c080-493b-9a91-1828e8c32a44 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:14.488551 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1171/2336] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:13:14 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:13:14.493443 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362809b1-bf9c-4f52-91ed-bd8324a1de57 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:14.508318 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362809b1-bf9c-4f52-91ed-bd8324a1de57 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:14.532095 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169ca79-6e2c-4312-a424-c3a135fdd3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:14.533339 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169ca79-6e2c-4312-a424-c3a135fdd3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:14.533633 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169ca79-6e2c-4312-a424-c3a135fdd3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:14.533918 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169ca79-6e2c-4312-a424-c3a135fdd3a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:14.534664 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169ca79-6e2c-4312-a424-c3a135fdd3a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:14.536730 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169ca79-6e2c-4312-a424-c3a135fdd3a6 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:14.548661 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1166/2337] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:13:14.552980 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33023f2b-c080-493b-9a91-1828e8c32a44 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:14.566234 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33023f2b-c080-493b-9a91-1828e8c32a44 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:14.577259 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d2250-b444-4120-888c-95fa8b04b494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:14.578031 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d2250-b444-4120-888c-95fa8b04b494 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:14.578362 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d2250-b444-4120-888c-95fa8b04b494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:14.578634 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d2250-b444-4120-888c-95fa8b04b494 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:14.579374 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d2250-b444-4120-888c-95fa8b04b494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:14.581147 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d2250-b444-4120-888c-95fa8b04b494 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:14.595514 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1172/2338] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:13:14.597557 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169ca79-6e2c-4312-a424-c3a135fdd3a6 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:14.608293 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169ca79-6e2c-4312-a424-c3a135fdd3a6 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:14.613221 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266edb2-f517-446d-b3a4-732abf88385f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:14.614125 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266edb2-f517-446d-b3a4-732abf88385f admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:14.614541 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266edb2-f517-446d-b3a4-732abf88385f admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:14.614833 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266edb2-f517-446d-b3a4-732abf88385f admin admin] PATH_INFO: `/v3/projects/709ad225de71489eaca6f1cfdc1da2c1/users/bcb3728640634a83a4ff046c2606154c/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:14.631875 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266edb2-f517-446d-b3a4-732abf88385f admin admin] RBAC: Authorizing `identity:create_grant(project_id=709ad225de71489eaca6f1cfdc1da2c1, user_id=bcb3728640634a83a4ff046c2606154c, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:14.634971 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266edb2-f517-446d-b3a4-732abf88385f admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:14.650012 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1167/2339] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:13:14 2022] PUT /identity/v3/projects/709ad225de71489eaca6f1cfdc1da2c1/users/bcb3728640634a83a4ff046c2606154c/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:13:14.660366 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c711e-638d-4fce-a8b7-c852eda3ca09 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:14.660659 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c711e-638d-4fce-a8b7-c852eda3ca09 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:14.660964 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c711e-638d-4fce-a8b7-c852eda3ca09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:14.689686 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-d43c711e-638d-4fce-a8b7-c852eda3ca09 None None] MFA Rules not processed for user `bcb3728640634a83a4ff046c2606154c`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:13:14.692119 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-d43c711e-638d-4fce-a8b7-c852eda3ca09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:14.783420 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1173/2340] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:13:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:13:14.786048 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266edb2-f517-446d-b3a4-732abf88385f admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:14.864335 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266edb2-f517-446d-b3a4-732abf88385f admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:14.870447 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13022af6-162e-460b-88f0-cd110d7011bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:14.871805 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13022af6-162e-460b-88f0-cd110d7011bf admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:14.872720 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13022af6-162e-460b-88f0-cd110d7011bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:14.873118 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13022af6-162e-460b-88f0-cd110d7011bf admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:14.873831 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13022af6-162e-460b-88f0-cd110d7011bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:14.875789 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13022af6-162e-460b-88f0-cd110d7011bf admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:14.905216 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1168/2341] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:13:14 2022] POST /identity/v3/projects => generated 391 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:13:14.906800 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c711e-638d-4fce-a8b7-c852eda3ca09 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:14.922331 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c711e-638d-4fce-a8b7-c852eda3ca09 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:15.002713 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276a20a-b01f-47ed-9d45-f046ee01d74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:15.003482 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276a20a-b01f-47ed-9d45-f046ee01d74f admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:15.003897 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276a20a-b01f-47ed-9d45-f046ee01d74f admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:15.004327 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276a20a-b01f-47ed-9d45-f046ee01d74f admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:15.005048 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276a20a-b01f-47ed-9d45-f046ee01d74f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:15.007167 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276a20a-b01f-47ed-9d45-f046ee01d74f admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:15.029167 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1174/2342] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:13:14 2022] POST /identity/v3/users => generated 302 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:13:15.033172 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13022af6-162e-460b-88f0-cd110d7011bf admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:15.044173 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13022af6-162e-460b-88f0-cd110d7011bf admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:15.048822 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1fc37d-c301-4c2d-86ee-9225abf47c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:15.049488 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fc37d-c301-4c2d-86ee-9225abf47c9c admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:15.049776 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fc37d-c301-4c2d-86ee-9225abf47c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:15.050066 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fc37d-c301-4c2d-86ee-9225abf47c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:15.050796 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1fc37d-c301-4c2d-86ee-9225abf47c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:15.052430 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1fc37d-c301-4c2d-86ee-9225abf47c9c admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:15.063709 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1169/2343] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:13:15.068284 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276a20a-b01f-47ed-9d45-f046ee01d74f admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:15.078086 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276a20a-b01f-47ed-9d45-f046ee01d74f admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:15.082720 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a6fdb-e487-4c56-9bf8-408e8812da87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:15.083592 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a6fdb-e487-4c56-9bf8-408e8812da87 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:15.083913 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a6fdb-e487-4c56-9bf8-408e8812da87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:15.084189 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a6fdb-e487-4c56-9bf8-408e8812da87 admin admin] PATH_INFO: `/v3/projects/f1c1c517a2e64fe484854b6911eb4d38/users/dc1a4f6bcff344f8b3eb30db7bfae686/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:15.098637 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a6fdb-e487-4c56-9bf8-408e8812da87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1c1c517a2e64fe484854b6911eb4d38, user_id=dc1a4f6bcff344f8b3eb30db7bfae686, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:15.101406 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a6fdb-e487-4c56-9bf8-408e8812da87 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:15.124933 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1175/2344] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:13:15 2022] PUT /identity/v3/projects/f1c1c517a2e64fe484854b6911eb4d38/users/dc1a4f6bcff344f8b3eb30db7bfae686/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:13:15.129175 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1fc37d-c301-4c2d-86ee-9225abf47c9c admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:15.139597 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1fc37d-c301-4c2d-86ee-9225abf47c9c admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:15.197881 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38107b60-88c7-458b-812c-a843635eb252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:15.198567 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38107b60-88c7-458b-812c-a843635eb252 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:15.198855 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38107b60-88c7-458b-812c-a843635eb252 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:15.199183 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38107b60-88c7-458b-812c-a843635eb252 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:15.199965 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38107b60-88c7-458b-812c-a843635eb252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:15.201580 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38107b60-88c7-458b-812c-a843635eb252 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:15.212145 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1170/2345] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:13:15.216615 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a6fdb-e487-4c56-9bf8-408e8812da87 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:15.227394 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a6fdb-e487-4c56-9bf8-408e8812da87 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:15.233697 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc1a20-8c60-4799-91a4-a423978d474f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:15.234607 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc1a20-8c60-4799-91a4-a423978d474f admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:15.234895 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc1a20-8c60-4799-91a4-a423978d474f admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:15.235177 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc1a20-8c60-4799-91a4-a423978d474f admin admin] PATH_INFO: `/v3/projects/f1c1c517a2e64fe484854b6911eb4d38/users/dc1a4f6bcff344f8b3eb30db7bfae686/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:15.237268 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc1a20-8c60-4799-91a4-a423978d474f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1c1c517a2e64fe484854b6911eb4d38, user_id=dc1a4f6bcff344f8b3eb30db7bfae686, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:15.240003 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc1a20-8c60-4799-91a4-a423978d474f admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:15.251620 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1176/2346] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:13:15 2022] PUT /identity/v3/projects/f1c1c517a2e64fe484854b6911eb4d38/users/dc1a4f6bcff344f8b3eb30db7bfae686/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:13:15.262400 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e258d44-3096-4447-9c05-673016c10c4b None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:15.262770 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e258d44-3096-4447-9c05-673016c10c4b None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:15.263108 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e258d44-3096-4447-9c05-673016c10c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:15.291607 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-6e258d44-3096-4447-9c05-673016c10c4b None None] MFA Rules not processed for user `dc1a4f6bcff344f8b3eb30db7bfae686`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:13:15.293506 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-6e258d44-3096-4447-9c05-673016c10c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:15.363097 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1171/2347] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:13:15 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:13:15.374016 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc1a20-8c60-4799-91a4-a423978d474f admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:15.375748 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-2acc1a20-8c60-4799-91a4-a423978d474f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:15.432559 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc1a20-8c60-4799-91a4-a423978d474f admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:15.436241 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a65ed-921f-47af-b606-0605a506823f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:15.436891 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a65ed-921f-47af-b606-0605a506823f service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:15.437178 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a65ed-921f-47af-b606-0605a506823f service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:15.437459 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a65ed-921f-47af-b606-0605a506823f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:15.446714 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a65ed-921f-47af-b606-0605a506823f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:15.448238 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a65ed-921f-47af-b606-0605a506823f service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:15.458342 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1177/2348] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:13:15 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:13:15.502527 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e258d44-3096-4447-9c05-673016c10c4b None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:15.504146 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-6e258d44-3096-4447-9c05-673016c10c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:15.516204 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e258d44-3096-4447-9c05-673016c10c4b None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:15.519742 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55422bb-99fd-42c8-95fb-81e4b7eb7d9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:15.520387 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55422bb-99fd-42c8-95fb-81e4b7eb7d9f service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:15.520670 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55422bb-99fd-42c8-95fb-81e4b7eb7d9f service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:15.520948 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55422bb-99fd-42c8-95fb-81e4b7eb7d9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:15.582196 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55422bb-99fd-42c8-95fb-81e4b7eb7d9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:15.583722 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55422bb-99fd-42c8-95fb-81e4b7eb7d9f service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:15.593284 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1172/2349] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:13:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:13:18.765030 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a65ed-921f-47af-b606-0605a506823f service cinder] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:18.824360 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a65ed-921f-47af-b606-0605a506823f service cinder] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:18.828918 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a6276-c229-447d-b873-b2772cee7fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:18.829838 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a6276-c229-447d-b873-b2772cee7fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:18.830152 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a6276-c229-447d-b873-b2772cee7fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:18.830422 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a6276-c229-447d-b873-b2772cee7fd6 admin admin] PATH_INFO: `/v3/users/bcb3728640634a83a4ff046c2606154c` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:18.831842 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88a6276-c229-447d-b873-b2772cee7fd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcb3728640634a83a4ff046c2606154c)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:18.833785 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88a6276-c229-447d-b873-b2772cee7fd6 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:18.876059 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c88a6276-c229-447d-b873-b2772cee7fd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcb3728640634a83a4ff046c2606154c'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:18.876632 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c88a6276-c229-447d-b873-b2772cee7fd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcb3728640634a83a4ff046c2606154c'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:18.883394 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c88a6276-c229-447d-b873-b2772cee7fd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcb3728640634a83a4ff046c2606154c'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:18.895082 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c88a6276-c229-447d-b873-b2772cee7fd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcb3728640634a83a4ff046c2606154c'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:18.895733 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c88a6276-c229-447d-b873-b2772cee7fd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcb3728640634a83a4ff046c2606154c'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:18.910812 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1178/2350] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:13:18 2022] DELETE /identity/v3/users/bcb3728640634a83a4ff046c2606154c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:13:18.920258 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25088673-d566-4d55-b962-f8299795f2cd None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:18.920849 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25088673-d566-4d55-b962-f8299795f2cd None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:18.920849 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25088673-d566-4d55-b962-f8299795f2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:18.937715 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-25088673-d566-4d55-b962-f8299795f2cd None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:13:18.938915 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-25088673-d566-4d55-b962-f8299795f2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:18.994208 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1173/2351] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:13:19.004468 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a6276-c229-447d-b873-b2772cee7fd6 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:19.005849 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-c88a6276-c229-447d-b873-b2772cee7fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:19.060277 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a6276-c229-447d-b873-b2772cee7fd6 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:19.063944 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf0c9c-eadf-4161-a433-f6699939e869 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:19.064590 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf0c9c-eadf-4161-a433-f6699939e869 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:19.064874 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf0c9c-eadf-4161-a433-f6699939e869 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:19.065155 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf0c9c-eadf-4161-a433-f6699939e869 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:19.075112 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf0c9c-eadf-4161-a433-f6699939e869 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:19.076579 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf0c9c-eadf-4161-a433-f6699939e869 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:19.085983 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1179/2352] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:13:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:13:19.332594 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25088673-d566-4d55-b962-f8299795f2cd None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:19.334181 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-25088673-d566-4d55-b962-f8299795f2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:19.346293 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25088673-d566-4d55-b962-f8299795f2cd None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:19.352570 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6a8bc-e0e4-408d-9398-8c54286f325b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:19.353449 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6a8bc-e0e4-408d-9398-8c54286f325b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:19.353731 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6a8bc-e0e4-408d-9398-8c54286f325b admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:19.354008 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6a8bc-e0e4-408d-9398-8c54286f325b admin admin] PATH_INFO: `/v3/projects/709ad225de71489eaca6f1cfdc1da2c1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:19.355746 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc6a8bc-e0e4-408d-9398-8c54286f325b admin admin] RBAC: Authorizing `identity:delete_project(project_id=709ad225de71489eaca6f1cfdc1da2c1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:19.357662 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc6a8bc-e0e4-408d-9398-8c54286f325b admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:19.403320 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-1dc6a8bc-e0e4-408d-9398-8c54286f325b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '709ad225de71489eaca6f1cfdc1da2c1', 'request_id': 'req-1dc6a8bc-e0e4-408d-9398-8c54286f325b'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:19.408474 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-1dc6a8bc-e0e4-408d-9398-8c54286f325b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '709ad225de71489eaca6f1cfdc1da2c1', 'request_id': 'req-1dc6a8bc-e0e4-408d-9398-8c54286f325b'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:19.414311 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-1dc6a8bc-e0e4-408d-9398-8c54286f325b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '709ad225de71489eaca6f1cfdc1da2c1', 'request_id': 'req-1dc6a8bc-e0e4-408d-9398-8c54286f325b'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:19.427883 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-1dc6a8bc-e0e4-408d-9398-8c54286f325b admin admin] The token cache is being invalidate because project 709ad225de71489eaca6f1cfdc1da2c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:13:19.428105 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-1dc6a8bc-e0e4-408d-9398-8c54286f325b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:19.428776 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-1dc6a8bc-e0e4-408d-9398-8c54286f325b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:19.430414 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1174/2353] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:13:19 2022] DELETE /identity/v3/projects/709ad225de71489eaca6f1cfdc1da2c1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:13:19.435120 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf0c9c-eadf-4161-a433-f6699939e869 service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:19.444755 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf0c9c-eadf-4161-a433-f6699939e869 service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:19.498928 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1ba41-71d5-4730-8cdf-36521c30cd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:19.499862 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1ba41-71d5-4730-8cdf-36521c30cd5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:19.500146 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1ba41-71d5-4730-8cdf-36521c30cd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:19.500421 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1ba41-71d5-4730-8cdf-36521c30cd5a admin admin] PATH_INFO: `/v3/users/dc1a4f6bcff344f8b3eb30db7bfae686` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:19.501600 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1ba41-71d5-4730-8cdf-36521c30cd5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc1a4f6bcff344f8b3eb30db7bfae686)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:19.503530 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1ba41-71d5-4730-8cdf-36521c30cd5a admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:19.546417 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-08a1ba41-71d5-4730-8cdf-36521c30cd5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc1a4f6bcff344f8b3eb30db7bfae686'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:19.547054 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-08a1ba41-71d5-4730-8cdf-36521c30cd5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc1a4f6bcff344f8b3eb30db7bfae686'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:19.553562 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-08a1ba41-71d5-4730-8cdf-36521c30cd5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc1a4f6bcff344f8b3eb30db7bfae686'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:19.565043 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-08a1ba41-71d5-4730-8cdf-36521c30cd5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc1a4f6bcff344f8b3eb30db7bfae686'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:19.565917 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-08a1ba41-71d5-4730-8cdf-36521c30cd5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc1a4f6bcff344f8b3eb30db7bfae686'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:19.577957 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1180/2354] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:13:19 2022] DELETE /identity/v3/users/dc1a4f6bcff344f8b3eb30db7bfae686 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:13:19.864026 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6a8bc-e0e4-408d-9398-8c54286f325b admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:19.865547 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-1dc6a8bc-e0e4-408d-9398-8c54286f325b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:19.883347 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6a8bc-e0e4-408d-9398-8c54286f325b admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:19.945303 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41504d-1d34-47a2-a86f-f764a2506a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:19.946297 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41504d-1d34-47a2-a86f-f764a2506a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:19.946581 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41504d-1d34-47a2-a86f-f764a2506a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:19.946853 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41504d-1d34-47a2-a86f-f764a2506a3b admin admin] PATH_INFO: `/v3/projects/f1c1c517a2e64fe484854b6911eb4d38` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:19.948155 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f41504d-1d34-47a2-a86f-f764a2506a3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1c1c517a2e64fe484854b6911eb4d38)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:19.950094 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f41504d-1d34-47a2-a86f-f764a2506a3b admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:19.995806 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-6f41504d-1d34-47a2-a86f-f764a2506a3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1c1c517a2e64fe484854b6911eb4d38', 'request_id': 'req-6f41504d-1d34-47a2-a86f-f764a2506a3b'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:20.004437 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-6f41504d-1d34-47a2-a86f-f764a2506a3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1c1c517a2e64fe484854b6911eb4d38', 'request_id': 'req-6f41504d-1d34-47a2-a86f-f764a2506a3b'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:20.011840 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-6f41504d-1d34-47a2-a86f-f764a2506a3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1c1c517a2e64fe484854b6911eb4d38', 'request_id': 'req-6f41504d-1d34-47a2-a86f-f764a2506a3b'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:20.025906 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-6f41504d-1d34-47a2-a86f-f764a2506a3b admin admin] The token cache is being invalidate because project f1c1c517a2e64fe484854b6911eb4d38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:13:20.026864 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-6f41504d-1d34-47a2-a86f-f764a2506a3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:20.028087 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-6f41504d-1d34-47a2-a86f-f764a2506a3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:20.029658 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1175/2355] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:13:19 2022] DELETE /identity/v3/projects/f1c1c517a2e64fe484854b6911eb4d38 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:13:20.035676 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c787f-7419-48ac-97e9-41e5dc4058d8 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:20.036221 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c787f-7419-48ac-97e9-41e5dc4058d8 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:20.036561 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c787f-7419-48ac-97e9-41e5dc4058d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:20.056220 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-e35c787f-7419-48ac-97e9-41e5dc4058d8 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:13:20.057437 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-e35c787f-7419-48ac-97e9-41e5dc4058d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:20.130034 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1181/2356] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:13:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:13:20.139653 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4e248-9048-4c0c-ae3a-ea1a8611fa9a None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:20.140039 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4e248-9048-4c0c-ae3a-ea1a8611fa9a None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:20.140390 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4e248-9048-4c0c-ae3a-ea1a8611fa9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:20.166561 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-f7b4e248-9048-4c0c-ae3a-ea1a8611fa9a None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:13:20.167839 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-f7b4e248-9048-4c0c-ae3a-ea1a8611fa9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:20.175870 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1176/2357] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:13:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:13:20.179913 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c787f-7419-48ac-97e9-41e5dc4058d8 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:20.193460 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c787f-7419-48ac-97e9-41e5dc4058d8 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:20.200330 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e6a6e-2f98-4021-8cae-ad411d5350e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:20.200929 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e6a6e-2f98-4021-8cae-ad411d5350e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:20.201551 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e6a6e-2f98-4021-8cae-ad411d5350e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:20.201551 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e6a6e-2f98-4021-8cae-ad411d5350e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:20.202208 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e6a6e-2f98-4021-8cae-ad411d5350e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:13:20.202518 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e6a6e-2f98-4021-8cae-ad411d5350e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:20.204237 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e6a6e-2f98-4021-8cae-ad411d5350e2 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:20.219809 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1182/2358] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:13:20.221082 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4e248-9048-4c0c-ae3a-ea1a8611fa9a None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:20.230193 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4e248-9048-4c0c-ae3a-ea1a8611fa9a None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:20.235281 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b2121-d85b-478d-9b08-a1a421fa10fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:20.236123 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b2121-d85b-478d-9b08-a1a421fa10fb admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:20.236523 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b2121-d85b-478d-9b08-a1a421fa10fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:20.236807 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b2121-d85b-478d-9b08-a1a421fa10fb admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:20.237602 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b2121-d85b-478d-9b08-a1a421fa10fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:20.240084 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b2121-d85b-478d-9b08-a1a421fa10fb admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:20.267142 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1177/2359] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:13:20 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:13:20.271098 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e6a6e-2f98-4021-8cae-ad411d5350e2 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:20.281898 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e6a6e-2f98-4021-8cae-ad411d5350e2 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:20.338052 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbb2cc-d9d9-4cab-804f-ca159eccbd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:20.338714 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbb2cc-d9d9-4cab-804f-ca159eccbd26 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:20.338995 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbb2cc-d9d9-4cab-804f-ca159eccbd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:20.339269 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbb2cc-d9d9-4cab-804f-ca159eccbd26 admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:20.340558 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbbb2cc-d9d9-4cab-804f-ca159eccbd26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:20.342776 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbbb2cc-d9d9-4cab-804f-ca159eccbd26 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:20.364599 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1183/2360] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:13:20 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:13:20.365775 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b2121-d85b-478d-9b08-a1a421fa10fb admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:20.376160 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b2121-d85b-478d-9b08-a1a421fa10fb admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:20.380893 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b0d56-c4bb-4592-afd5-acc48882ddb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:20.381619 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b0d56-c4bb-4592-afd5-acc48882ddb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:20.381990 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b0d56-c4bb-4592-afd5-acc48882ddb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:20.382331 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b0d56-c4bb-4592-afd5-acc48882ddb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:20.383155 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b0d56-c4bb-4592-afd5-acc48882ddb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:20.384875 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b0d56-c4bb-4592-afd5-acc48882ddb1 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:20.395650 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1178/2361] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:13:20.399493 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbb2cc-d9d9-4cab-804f-ca159eccbd26 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:20.409890 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbb2cc-d9d9-4cab-804f-ca159eccbd26 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:20.414373 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914297d6-681d-456e-b1f6-8e4a649c3f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:20.415013 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914297d6-681d-456e-b1f6-8e4a649c3f93 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:20.415310 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914297d6-681d-456e-b1f6-8e4a649c3f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:20.415576 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914297d6-681d-456e-b1f6-8e4a649c3f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:20.416355 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914297d6-681d-456e-b1f6-8e4a649c3f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:20.417998 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914297d6-681d-456e-b1f6-8e4a649c3f93 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:20.427497 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1184/2362] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:13:20.431334 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b0d56-c4bb-4592-afd5-acc48882ddb1 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:20.441335 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b0d56-c4bb-4592-afd5-acc48882ddb1 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:20.445983 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d64fb5-83dd-40cd-8744-eea1b5a8eb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:20.446840 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d64fb5-83dd-40cd-8744-eea1b5a8eb8c admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:20.447116 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d64fb5-83dd-40cd-8744-eea1b5a8eb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:20.447385 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d64fb5-83dd-40cd-8744-eea1b5a8eb8c admin admin] PATH_INFO: `/v3/projects/036e4e7be0b84609acbcd95b208010cc/users/04b2df0a2f4c4c7e81fb742e91d0d374/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:20.461901 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d64fb5-83dd-40cd-8744-eea1b5a8eb8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=036e4e7be0b84609acbcd95b208010cc, user_id=04b2df0a2f4c4c7e81fb742e91d0d374, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:20.465182 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d64fb5-83dd-40cd-8744-eea1b5a8eb8c admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:20.477852 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1179/2363] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:13:20 2022] PUT /identity/v3/projects/036e4e7be0b84609acbcd95b208010cc/users/04b2df0a2f4c4c7e81fb742e91d0d374/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:13:20.488022 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3769346-50e2-4a09-a29f-bcbafd52610d None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:20.488312 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3769346-50e2-4a09-a29f-bcbafd52610d None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:20.488591 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3769346-50e2-4a09-a29f-bcbafd52610d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:20.514549 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-a3769346-50e2-4a09-a29f-bcbafd52610d None None] MFA Rules not processed for user `04b2df0a2f4c4c7e81fb742e91d0d374`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:13:20.515754 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-a3769346-50e2-4a09-a29f-bcbafd52610d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:20.580524 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1185/2364] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:13:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:13:20.591061 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d64fb5-83dd-40cd-8744-eea1b5a8eb8c admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:20.592772 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-e5d64fb5-83dd-40cd-8744-eea1b5a8eb8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:20.647860 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d64fb5-83dd-40cd-8744-eea1b5a8eb8c admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:20.651477 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a18ad8-e8e7-42fa-9298-71087030b04b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:20.652143 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a18ad8-e8e7-42fa-9298-71087030b04b service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:20.652426 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a18ad8-e8e7-42fa-9298-71087030b04b service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:20.652701 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a18ad8-e8e7-42fa-9298-71087030b04b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:20.660976 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a18ad8-e8e7-42fa-9298-71087030b04b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:20.662384 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a18ad8-e8e7-42fa-9298-71087030b04b service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:20.670939 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1180/2365] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:13:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:13:23.772119 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3769346-50e2-4a09-a29f-bcbafd52610d None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:23.833111 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3769346-50e2-4a09-a29f-bcbafd52610d None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:23.838073 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6529e-6e2c-4a31-b0a4-f7a00b051ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:23.838959 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6529e-6e2c-4a31-b0a4-f7a00b051ae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:23.839246 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6529e-6e2c-4a31-b0a4-f7a00b051ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:23.839524 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6529e-6e2c-4a31-b0a4-f7a00b051ae1 admin admin] PATH_INFO: `/v3/users/04b2df0a2f4c4c7e81fb742e91d0d374` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:23.840779 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c6529e-6e2c-4a31-b0a4-f7a00b051ae1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04b2df0a2f4c4c7e81fb742e91d0d374)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:23.842722 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c6529e-6e2c-4a31-b0a4-f7a00b051ae1 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:23.890463 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-04c6529e-6e2c-4a31-b0a4-f7a00b051ae1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04b2df0a2f4c4c7e81fb742e91d0d374'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:23.891136 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-04c6529e-6e2c-4a31-b0a4-f7a00b051ae1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04b2df0a2f4c4c7e81fb742e91d0d374'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:23.898634 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-04c6529e-6e2c-4a31-b0a4-f7a00b051ae1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04b2df0a2f4c4c7e81fb742e91d0d374'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:23.910365 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-04c6529e-6e2c-4a31-b0a4-f7a00b051ae1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04b2df0a2f4c4c7e81fb742e91d0d374'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:23.911103 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-04c6529e-6e2c-4a31-b0a4-f7a00b051ae1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04b2df0a2f4c4c7e81fb742e91d0d374'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:23.925037 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1186/2366] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:13:23 2022] DELETE /identity/v3/users/04b2df0a2f4c4c7e81fb742e91d0d374 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:13:23.929760 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514659ad-8ee7-4375-abc8-9e0ef9c23236 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:23.930278 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514659ad-8ee7-4375-abc8-9e0ef9c23236 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:23.930452 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514659ad-8ee7-4375-abc8-9e0ef9c23236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:23.949443 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-514659ad-8ee7-4375-abc8-9e0ef9c23236 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:13:23.950671 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-514659ad-8ee7-4375-abc8-9e0ef9c23236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:24.028627 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1181/2367] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:13:24.038741 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6529e-6e2c-4a31-b0a4-f7a00b051ae1 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:24.040534 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-04c6529e-6e2c-4a31-b0a4-f7a00b051ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:24.100304 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6529e-6e2c-4a31-b0a4-f7a00b051ae1 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:24.103917 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a369e-7e26-4e20-ac68-43e719584b1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:24.105382 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a369e-7e26-4e20-ac68-43e719584b1d service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:24.105382 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a369e-7e26-4e20-ac68-43e719584b1d service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:24.105613 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a369e-7e26-4e20-ac68-43e719584b1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:24.115235 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a369e-7e26-4e20-ac68-43e719584b1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:24.116956 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a369e-7e26-4e20-ac68-43e719584b1d service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:24.127623 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1187/2368] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:13:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:13:24.409479 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514659ad-8ee7-4375-abc8-9e0ef9c23236 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:24.411592 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-514659ad-8ee7-4375-abc8-9e0ef9c23236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:24.424049 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514659ad-8ee7-4375-abc8-9e0ef9c23236 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:24.428973 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e6fca-7adb-434e-aed0-4a77425918ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:24.429920 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e6fca-7adb-434e-aed0-4a77425918ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:24.430276 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e6fca-7adb-434e-aed0-4a77425918ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:24.430612 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e6fca-7adb-434e-aed0-4a77425918ae admin admin] PATH_INFO: `/v3/projects/036e4e7be0b84609acbcd95b208010cc` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:24.432546 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e6fca-7adb-434e-aed0-4a77425918ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=036e4e7be0b84609acbcd95b208010cc)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:24.435140 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e6fca-7adb-434e-aed0-4a77425918ae admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:24.490420 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-485e6fca-7adb-434e-aed0-4a77425918ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '036e4e7be0b84609acbcd95b208010cc', 'request_id': 'req-485e6fca-7adb-434e-aed0-4a77425918ae'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:24.496427 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-485e6fca-7adb-434e-aed0-4a77425918ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '036e4e7be0b84609acbcd95b208010cc', 'request_id': 'req-485e6fca-7adb-434e-aed0-4a77425918ae'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:24.502675 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-485e6fca-7adb-434e-aed0-4a77425918ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '036e4e7be0b84609acbcd95b208010cc', 'request_id': 'req-485e6fca-7adb-434e-aed0-4a77425918ae'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:24.515944 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-485e6fca-7adb-434e-aed0-4a77425918ae admin admin] The token cache is being invalidate because project 036e4e7be0b84609acbcd95b208010cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:13:24.516240 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-485e6fca-7adb-434e-aed0-4a77425918ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:24.516979 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-485e6fca-7adb-434e-aed0-4a77425918ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:24.518699 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1182/2369] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:13:24 2022] DELETE /identity/v3/projects/036e4e7be0b84609acbcd95b208010cc => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:13:24.523533 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366bb23e-f019-49db-b2a8-cbbc93d18274 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:24.523936 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366bb23e-f019-49db-b2a8-cbbc93d18274 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:24.524286 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366bb23e-f019-49db-b2a8-cbbc93d18274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:24.542591 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-366bb23e-f019-49db-b2a8-cbbc93d18274 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:13:24.544159 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-366bb23e-f019-49db-b2a8-cbbc93d18274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:24.611618 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1188/2370] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:13:24.619253 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01883bb9-3ed3-4587-8616-f18aa769cf1b None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:24.619860 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01883bb9-3ed3-4587-8616-f18aa769cf1b None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:24.620208 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01883bb9-3ed3-4587-8616-f18aa769cf1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:24.641562 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-01883bb9-3ed3-4587-8616-f18aa769cf1b None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:13:24.643022 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-01883bb9-3ed3-4587-8616-f18aa769cf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:24.655280 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1183/2371] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:13:24.659426 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366bb23e-f019-49db-b2a8-cbbc93d18274 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:24.669795 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366bb23e-f019-49db-b2a8-cbbc93d18274 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:24.675131 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38383b-52e2-4863-b991-0e4ad4d88424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:24.675824 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38383b-52e2-4863-b991-0e4ad4d88424 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:24.676108 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38383b-52e2-4863-b991-0e4ad4d88424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:24.676383 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38383b-52e2-4863-b991-0e4ad4d88424 admin admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:24.677110 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a38383b-52e2-4863-b991-0e4ad4d88424 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:13:24.677416 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a38383b-52e2-4863-b991-0e4ad4d88424 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:24.679014 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a38383b-52e2-4863-b991-0e4ad4d88424 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:24.694185 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1189/2372] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:13:24.698620 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01883bb9-3ed3-4587-8616-f18aa769cf1b None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:24.708500 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01883bb9-3ed3-4587-8616-f18aa769cf1b None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:24.714755 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f22b0-1e69-42c9-b81a-191056e6114b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:24.715406 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f22b0-1e69-42c9-b81a-191056e6114b admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:24.715915 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f22b0-1e69-42c9-b81a-191056e6114b admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:24.716531 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f22b0-1e69-42c9-b81a-191056e6114b admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:24.717588 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f22b0-1e69-42c9-b81a-191056e6114b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:24.719677 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f22b0-1e69-42c9-b81a-191056e6114b admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:24.765247 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1184/2373] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:13:24 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:13:24.769506 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38383b-52e2-4863-b991-0e4ad4d88424 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:24.780677 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38383b-52e2-4863-b991-0e4ad4d88424 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:24.844756 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c7387-e785-4605-ae2e-4a48377f6d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:24.845448 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c7387-e785-4605-ae2e-4a48377f6d2b admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:24.845741 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c7387-e785-4605-ae2e-4a48377f6d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:24.846019 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c7387-e785-4605-ae2e-4a48377f6d2b admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:24.846770 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c7387-e785-4605-ae2e-4a48377f6d2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:24.848960 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c7387-e785-4605-ae2e-4a48377f6d2b admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:24.877960 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1190/2374] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:13:24 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:13:24.879165 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f22b0-1e69-42c9-b81a-191056e6114b admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:24.893404 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f22b0-1e69-42c9-b81a-191056e6114b admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:24.908637 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d316af-0de9-4030-93c2-b533e7bb0d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:24.910856 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d316af-0de9-4030-93c2-b533e7bb0d2e admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:24.911291 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d316af-0de9-4030-93c2-b533e7bb0d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:24.912391 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d316af-0de9-4030-93c2-b533e7bb0d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:24.914032 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d316af-0de9-4030-93c2-b533e7bb0d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:24.916710 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d316af-0de9-4030-93c2-b533e7bb0d2e admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:24.932853 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1185/2375] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:13:24.937218 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c7387-e785-4605-ae2e-4a48377f6d2b admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:24.948302 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c7387-e785-4605-ae2e-4a48377f6d2b admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:24.959244 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920603b6-c78b-4135-8116-ee08325473f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:24.960207 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920603b6-c78b-4135-8116-ee08325473f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:24.960813 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920603b6-c78b-4135-8116-ee08325473f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:24.961197 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920603b6-c78b-4135-8116-ee08325473f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:24.962040 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920603b6-c78b-4135-8116-ee08325473f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:24.964227 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920603b6-c78b-4135-8116-ee08325473f0 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:24.978085 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1191/2376] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:13:24.982210 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d316af-0de9-4030-93c2-b533e7bb0d2e admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:24.998871 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d316af-0de9-4030-93c2-b533e7bb0d2e admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:25.008320 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cbeaf7-d469-4506-9ea8-0ff6701abdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:25.009475 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbeaf7-d469-4506-9ea8-0ff6701abdca admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:25.009909 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbeaf7-d469-4506-9ea8-0ff6701abdca admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:25.010330 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cbeaf7-d469-4506-9ea8-0ff6701abdca admin admin] PATH_INFO: `/v3/projects/5975562540d3403e8461f1f7513949c8/users/0db617ccddf74bdda791e0fa90aace07/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:25.027286 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cbeaf7-d469-4506-9ea8-0ff6701abdca admin admin] RBAC: Authorizing `identity:create_grant(project_id=5975562540d3403e8461f1f7513949c8, user_id=0db617ccddf74bdda791e0fa90aace07, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:25.030293 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cbeaf7-d469-4506-9ea8-0ff6701abdca admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:25.055945 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1186/2377] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:13:24 2022] PUT /identity/v3/projects/5975562540d3403e8461f1f7513949c8/users/0db617ccddf74bdda791e0fa90aace07/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:13:25.064411 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35397b-72ed-4f9f-b960-b336e147f149 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:25.064963 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35397b-72ed-4f9f-b960-b336e147f149 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:25.065394 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35397b-72ed-4f9f-b960-b336e147f149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:25.099763 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-0a35397b-72ed-4f9f-b960-b336e147f149 None None] MFA Rules not processed for user `0db617ccddf74bdda791e0fa90aace07`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:13:25.101045 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-0a35397b-72ed-4f9f-b960-b336e147f149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:25.203209 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1192/2378] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:13:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:13:25.209933 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cbeaf7-d469-4506-9ea8-0ff6701abdca admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:25.211966 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-a6cbeaf7-d469-4506-9ea8-0ff6701abdca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:25.302976 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cbeaf7-d469-4506-9ea8-0ff6701abdca admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:25.309536 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18f8da-b15f-4f02-8ea1-4779321c1d04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:25.310579 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18f8da-b15f-4f02-8ea1-4779321c1d04 service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:25.310973 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18f8da-b15f-4f02-8ea1-4779321c1d04 service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:25.311479 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18f8da-b15f-4f02-8ea1-4779321c1d04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:25.322033 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18f8da-b15f-4f02-8ea1-4779321c1d04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:25.323834 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18f8da-b15f-4f02-8ea1-4779321c1d04 service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:25.334766 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1187/2379] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:13:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:13:25.362045 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35397b-72ed-4f9f-b960-b336e147f149 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:25.444985 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35397b-72ed-4f9f-b960-b336e147f149 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:25.453075 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf7bd6-5415-423d-b9c8-2a4f39a8eb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:25.453950 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf7bd6-5415-423d-b9c8-2a4f39a8eb34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:25.454240 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf7bd6-5415-423d-b9c8-2a4f39a8eb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:25.454515 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf7bd6-5415-423d-b9c8-2a4f39a8eb34 admin admin] PATH_INFO: `/v3/users/0db617ccddf74bdda791e0fa90aace07` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:25.455782 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf7bd6-5415-423d-b9c8-2a4f39a8eb34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0db617ccddf74bdda791e0fa90aace07)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:25.457734 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf7bd6-5415-423d-b9c8-2a4f39a8eb34 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:25.516161 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-23cf7bd6-5415-423d-b9c8-2a4f39a8eb34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0db617ccddf74bdda791e0fa90aace07'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:25.516928 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-23cf7bd6-5415-423d-b9c8-2a4f39a8eb34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0db617ccddf74bdda791e0fa90aace07'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:25.525307 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-23cf7bd6-5415-423d-b9c8-2a4f39a8eb34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0db617ccddf74bdda791e0fa90aace07'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:25.549223 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-23cf7bd6-5415-423d-b9c8-2a4f39a8eb34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0db617ccddf74bdda791e0fa90aace07'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:25.550103 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-23cf7bd6-5415-423d-b9c8-2a4f39a8eb34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0db617ccddf74bdda791e0fa90aace07'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:25.568895 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1193/2380] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:13:25 2022] DELETE /identity/v3/users/0db617ccddf74bdda791e0fa90aace07 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:13:25.573129 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27756277-1848-4be1-9c67-b0a8b503877d None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:25.573579 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27756277-1848-4be1-9c67-b0a8b503877d None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:25.574650 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27756277-1848-4be1-9c67-b0a8b503877d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:25.598995 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-27756277-1848-4be1-9c67-b0a8b503877d None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:13:25.600526 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-27756277-1848-4be1-9c67-b0a8b503877d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:25.781107 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1188/2381] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:13:25.796208 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf7bd6-5415-423d-b9c8-2a4f39a8eb34 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:25.798811 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-23cf7bd6-5415-423d-b9c8-2a4f39a8eb34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:25.883476 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf7bd6-5415-423d-b9c8-2a4f39a8eb34 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:25.887561 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9dafb-fd3f-44bf-8ca3-b91b95b467b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:25.888446 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9dafb-fd3f-44bf-8ca3-b91b95b467b7 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:25.889403 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9dafb-fd3f-44bf-8ca3-b91b95b467b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:25.889833 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9dafb-fd3f-44bf-8ca3-b91b95b467b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:25.909051 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f9dafb-fd3f-44bf-8ca3-b91b95b467b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:25.910787 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f9dafb-fd3f-44bf-8ca3-b91b95b467b7 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:25.922547 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1194/2382] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:13:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:13:26.240620 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27756277-1848-4be1-9c67-b0a8b503877d None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:26.242618 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-27756277-1848-4be1-9c67-b0a8b503877d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:26.260563 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27756277-1848-4be1-9c67-b0a8b503877d None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:26.266958 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a92a88-415c-45bb-aec7-403b37804e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:26.267902 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a92a88-415c-45bb-aec7-403b37804e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:26.268194 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a92a88-415c-45bb-aec7-403b37804e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:26.268467 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a92a88-415c-45bb-aec7-403b37804e9f admin admin] PATH_INFO: `/v3/projects/5975562540d3403e8461f1f7513949c8` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:26.269820 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a92a88-415c-45bb-aec7-403b37804e9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5975562540d3403e8461f1f7513949c8)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:26.271740 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a92a88-415c-45bb-aec7-403b37804e9f admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:26.329118 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-50a92a88-415c-45bb-aec7-403b37804e9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5975562540d3403e8461f1f7513949c8', 'request_id': 'req-50a92a88-415c-45bb-aec7-403b37804e9f'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:26.334852 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-50a92a88-415c-45bb-aec7-403b37804e9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5975562540d3403e8461f1f7513949c8', 'request_id': 'req-50a92a88-415c-45bb-aec7-403b37804e9f'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:26.342323 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-50a92a88-415c-45bb-aec7-403b37804e9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5975562540d3403e8461f1f7513949c8', 'request_id': 'req-50a92a88-415c-45bb-aec7-403b37804e9f'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:26.354972 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-50a92a88-415c-45bb-aec7-403b37804e9f admin admin] The token cache is being invalidate because project 5975562540d3403e8461f1f7513949c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:13:26.355264 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-50a92a88-415c-45bb-aec7-403b37804e9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:26.360537 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-50a92a88-415c-45bb-aec7-403b37804e9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:13:26.362582 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1189/2383] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:13:26 2022] DELETE /identity/v3/projects/5975562540d3403e8461f1f7513949c8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:13:26.367266 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f5e40-5f31-43fe-a6d3-07d5f9324489 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:26.367564 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f5e40-5f31-43fe-a6d3-07d5f9324489 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:26.367876 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f5e40-5f31-43fe-a6d3-07d5f9324489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:26.386884 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-d39f5e40-5f31-43fe-a6d3-07d5f9324489 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:13:26.388134 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-d39f5e40-5f31-43fe-a6d3-07d5f9324489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:26.448296 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1195/2384] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:13:26.456815 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67440df8-581b-442b-961a-92d5269cdd81 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:26.457093 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67440df8-581b-442b-961a-92d5269cdd81 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:26.457375 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67440df8-581b-442b-961a-92d5269cdd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:26.476396 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-67440df8-581b-442b-961a-92d5269cdd81 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:13:26.477588 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-67440df8-581b-442b-961a-92d5269cdd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:26.485373 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1190/2385] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:13:26.489676 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f5e40-5f31-43fe-a6d3-07d5f9324489 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:26.502196 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f5e40-5f31-43fe-a6d3-07d5f9324489 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:26.506901 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af43c5-98dd-4f1e-8791-a62105bed778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:26.507556 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af43c5-98dd-4f1e-8791-a62105bed778 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:26.507880 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af43c5-98dd-4f1e-8791-a62105bed778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:26.508159 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af43c5-98dd-4f1e-8791-a62105bed778 admin admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:26.508924 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af43c5-98dd-4f1e-8791-a62105bed778 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:13:26.509228 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af43c5-98dd-4f1e-8791-a62105bed778 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:26.510960 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af43c5-98dd-4f1e-8791-a62105bed778 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:26.523803 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1196/2386] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:13:26.528097 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67440df8-581b-442b-961a-92d5269cdd81 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:26.537694 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67440df8-581b-442b-961a-92d5269cdd81 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:26.542532 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ba215-5f08-41a1-957e-92de82f258c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:26.543319 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ba215-5f08-41a1-957e-92de82f258c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:26.543667 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ba215-5f08-41a1-957e-92de82f258c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:26.544043 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ba215-5f08-41a1-957e-92de82f258c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:26.544816 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ba215-5f08-41a1-957e-92de82f258c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:26.546731 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ba215-5f08-41a1-957e-92de82f258c2 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:26.577494 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1191/2387] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:13:26 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:13:26.581545 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af43c5-98dd-4f1e-8791-a62105bed778 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:26.592014 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af43c5-98dd-4f1e-8791-a62105bed778 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:26.652768 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f00445-02e9-48d2-95c7-50b95f49cc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:26.653753 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f00445-02e9-48d2-95c7-50b95f49cc55 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:26.654174 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f00445-02e9-48d2-95c7-50b95f49cc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:26.654591 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f00445-02e9-48d2-95c7-50b95f49cc55 admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:26.655629 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f00445-02e9-48d2-95c7-50b95f49cc55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:26.658087 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f00445-02e9-48d2-95c7-50b95f49cc55 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:26.679928 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1197/2388] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:13:26 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:13:26.684573 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ba215-5f08-41a1-957e-92de82f258c2 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:26.694863 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ba215-5f08-41a1-957e-92de82f258c2 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:26.700253 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b42a6-6caf-4469-9601-213619edbb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:26.700861 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b42a6-6caf-4469-9601-213619edbb4e admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:26.701148 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b42a6-6caf-4469-9601-213619edbb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:26.701427 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b42a6-6caf-4469-9601-213619edbb4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:26.702152 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b42a6-6caf-4469-9601-213619edbb4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:26.703777 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066b42a6-6caf-4469-9601-213619edbb4e admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:26.714108 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1192/2389] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:13:26.718022 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f00445-02e9-48d2-95c7-50b95f49cc55 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:26.727980 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f00445-02e9-48d2-95c7-50b95f49cc55 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:26.732642 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e9bd6-945f-4a26-88f5-1a2e242925b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:26.733327 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e9bd6-945f-4a26-88f5-1a2e242925b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:26.733611 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e9bd6-945f-4a26-88f5-1a2e242925b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:26.733890 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e9bd6-945f-4a26-88f5-1a2e242925b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:26.734622 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e9bd6-945f-4a26-88f5-1a2e242925b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:26.736310 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e9bd6-945f-4a26-88f5-1a2e242925b6 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:26.747534 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1198/2390] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:13:26.752586 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b42a6-6caf-4469-9601-213619edbb4e admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:26.763644 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066b42a6-6caf-4469-9601-213619edbb4e admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:26.768685 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd9f1d-f559-436a-bec9-a45fd41f4610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:26.769280 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd9f1d-f559-436a-bec9-a45fd41f4610 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:26.769566 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd9f1d-f559-436a-bec9-a45fd41f4610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:26.769841 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd9f1d-f559-436a-bec9-a45fd41f4610 admin admin] PATH_INFO: `/v3/projects/8147c8a0a0e84e209d510fa08576189e/users/01285d0eaa394db3900074a9ee48e784/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:26.784991 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd9f1d-f559-436a-bec9-a45fd41f4610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8147c8a0a0e84e209d510fa08576189e, user_id=01285d0eaa394db3900074a9ee48e784, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:26.787716 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd9f1d-f559-436a-bec9-a45fd41f4610 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:26.802106 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1193/2391] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:13:26 2022] PUT /identity/v3/projects/8147c8a0a0e84e209d510fa08576189e/users/01285d0eaa394db3900074a9ee48e784/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:13:26.807397 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e938d-a3be-4b6b-bfac-02594c80868b None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:26.808427 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e938d-a3be-4b6b-bfac-02594c80868b None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:26.808526 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e938d-a3be-4b6b-bfac-02594c80868b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:26.826715 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-904e938d-a3be-4b6b-bfac-02594c80868b None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:13:26.827952 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-904e938d-a3be-4b6b-bfac-02594c80868b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:26.883288 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1199/2392] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:13:26.892787 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd9f1d-f559-436a-bec9-a45fd41f4610 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:26.894501 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-53fd9f1d-f559-436a-bec9-a45fd41f4610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:26.951384 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd9f1d-f559-436a-bec9-a45fd41f4610 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:26.955349 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee0d35-e0e2-46c9-a553-ad775eb44ca1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:26.956031 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee0d35-e0e2-46c9-a553-ad775eb44ca1 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:26.956316 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee0d35-e0e2-46c9-a553-ad775eb44ca1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:26.956598 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee0d35-e0e2-46c9-a553-ad775eb44ca1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:26.970421 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee0d35-e0e2-46c9-a553-ad775eb44ca1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:26.971910 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee0d35-e0e2-46c9-a553-ad775eb44ca1 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:26.982420 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1194/2393] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:13:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:13:29.325704 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687247d4-743f-488b-8ef3-86052394a7bd None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:29.326756 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687247d4-743f-488b-8ef3-86052394a7bd None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:29.327108 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687247d4-743f-488b-8ef3-86052394a7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:29.346256 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-687247d4-743f-488b-8ef3-86052394a7bd None None] MFA Rules not processed for user `382fc34b389c4338b8e9fcae2b4d89e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:13:29.348176 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-687247d4-743f-488b-8ef3-86052394a7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:29.407630 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1200/2394] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:13:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:13:31.718252 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ac5ef-2287-4047-b845-467e1c3ddc76 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:31.718757 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ac5ef-2287-4047-b845-467e1c3ddc76 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:31.718863 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ac5ef-2287-4047-b845-467e1c3ddc76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:31.764431 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-3c5ac5ef-2287-4047-b845-467e1c3ddc76 None None] MFA Rules not processed for user `01285d0eaa394db3900074a9ee48e784`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:13:31.765924 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-3c5ac5ef-2287-4047-b845-467e1c3ddc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:31.873215 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1195/2395] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:13:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:13:31.877419 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687247d4-743f-488b-8ef3-86052394a7bd None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:31.889631 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687247d4-743f-488b-8ef3-86052394a7bd None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:31.894851 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5c56f-d494-4e3a-b9c8-9af32ef4cf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:31.895786 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5c56f-d494-4e3a-b9c8-9af32ef4cf26 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:31.896071 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5c56f-d494-4e3a-b9c8-9af32ef4cf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:31.896345 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5c56f-d494-4e3a-b9c8-9af32ef4cf26 admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:31.897216 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5c56f-d494-4e3a-b9c8-9af32ef4cf26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:31.899299 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5c56f-d494-4e3a-b9c8-9af32ef4cf26 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:31.927353 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1201/2396] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:13:31 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:13:31.939486 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ac5ef-2287-4047-b845-467e1c3ddc76 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:31.951986 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ac5ef-2287-4047-b845-467e1c3ddc76 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:32.014971 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fef2af-2b88-4337-b1e3-18fbe6b18ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:32.015654 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fef2af-2b88-4337-b1e3-18fbe6b18ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:32.015968 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fef2af-2b88-4337-b1e3-18fbe6b18ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:32.016249 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fef2af-2b88-4337-b1e3-18fbe6b18ae1 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:32.016960 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fef2af-2b88-4337-b1e3-18fbe6b18ae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:32.018888 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fef2af-2b88-4337-b1e3-18fbe6b18ae1 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:32.046434 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5c56f-d494-4e3a-b9c8-9af32ef4cf26 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:32.047198 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1196/2397] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:13:31 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:13:32.057417 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5c56f-d494-4e3a-b9c8-9af32ef4cf26 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:32.063211 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c906f-0039-4765-86ea-9ba2215b3269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:32.064461 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c906f-0039-4765-86ea-9ba2215b3269 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:32.064790 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c906f-0039-4765-86ea-9ba2215b3269 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:32.065031 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c906f-0039-4765-86ea-9ba2215b3269 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:32.066023 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c906f-0039-4765-86ea-9ba2215b3269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:32.067643 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c906f-0039-4765-86ea-9ba2215b3269 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:32.083775 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1202/2398] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:13:32.083959 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fef2af-2b88-4337-b1e3-18fbe6b18ae1 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:32.097433 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fef2af-2b88-4337-b1e3-18fbe6b18ae1 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:32.104335 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9223f4-158d-4c70-8c67-9fdf771c3a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:32.105915 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9223f4-158d-4c70-8c67-9fdf771c3a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:32.106297 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9223f4-158d-4c70-8c67-9fdf771c3a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:32.106649 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9223f4-158d-4c70-8c67-9fdf771c3a1c admin admin] PATH_INFO: `/v3/projects/7f2da1ebe03a4aa1ba7a099897e07957/users/6efe0911e4bf427288ae51f3aa85bcbc/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:32.123953 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9223f4-158d-4c70-8c67-9fdf771c3a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f2da1ebe03a4aa1ba7a099897e07957, user_id=6efe0911e4bf427288ae51f3aa85bcbc, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:32.126783 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9223f4-158d-4c70-8c67-9fdf771c3a1c admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:32.145847 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1197/2399] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:13:32 2022] PUT /identity/v3/projects/7f2da1ebe03a4aa1ba7a099897e07957/users/6efe0911e4bf427288ae51f3aa85bcbc/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:13:32.147728 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c906f-0039-4765-86ea-9ba2215b3269 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:32.161613 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c906f-0039-4765-86ea-9ba2215b3269 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:32.258166 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49b260-28a2-4d57-9503-9a42c4346a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:32.259138 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49b260-28a2-4d57-9503-9a42c4346a97 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:32.259623 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49b260-28a2-4d57-9503-9a42c4346a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:32.260100 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49b260-28a2-4d57-9503-9a42c4346a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:32.261043 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd49b260-28a2-4d57-9503-9a42c4346a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:32.262944 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd49b260-28a2-4d57-9503-9a42c4346a97 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:32.277236 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1203/2400] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:13:32.281666 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9223f4-158d-4c70-8c67-9fdf771c3a1c admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:32.308836 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9223f4-158d-4c70-8c67-9fdf771c3a1c admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:32.321557 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc334b9-ce56-4b39-9e93-33edc60322bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:32.322563 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc334b9-ce56-4b39-9e93-33edc60322bd admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:32.323067 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc334b9-ce56-4b39-9e93-33edc60322bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:32.323202 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc334b9-ce56-4b39-9e93-33edc60322bd admin admin] PATH_INFO: `/v3/projects/7f2da1ebe03a4aa1ba7a099897e07957/users/6efe0911e4bf427288ae51f3aa85bcbc/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:32.327712 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc334b9-ce56-4b39-9e93-33edc60322bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f2da1ebe03a4aa1ba7a099897e07957, user_id=6efe0911e4bf427288ae51f3aa85bcbc, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:32.328655 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc334b9-ce56-4b39-9e93-33edc60322bd admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:32.342348 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1198/2401] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:13:32 2022] PUT /identity/v3/projects/7f2da1ebe03a4aa1ba7a099897e07957/users/6efe0911e4bf427288ae51f3aa85bcbc/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:13:37.259568 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8952aeb-3cff-4600-a902-3cebcc6bdbe1 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:37.260123 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8952aeb-3cff-4600-a902-3cebcc6bdbe1 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:37.260360 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8952aeb-3cff-4600-a902-3cebcc6bdbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:37.286714 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-e8952aeb-3cff-4600-a902-3cebcc6bdbe1 None None] MFA Rules not processed for user `6efe0911e4bf427288ae51f3aa85bcbc`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:13:37.287978 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-e8952aeb-3cff-4600-a902-3cebcc6bdbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:37.355733 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1204/2402] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:13:37 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:13:37.366648 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc334b9-ce56-4b39-9e93-33edc60322bd admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:13:37.368433 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-8bc334b9-ce56-4b39-9e93-33edc60322bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:37.441285 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc334b9-ce56-4b39-9e93-33edc60322bd admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:13:37.447432 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214579bb-0e6f-4b0e-a69f-fc09bcd3b84b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:13:37.448154 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214579bb-0e6f-4b0e-a69f-fc09bcd3b84b service nova] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:37.448438 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214579bb-0e6f-4b0e-a69f-fc09bcd3b84b service nova] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:37.448720 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214579bb-0e6f-4b0e-a69f-fc09bcd3b84b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:37.506624 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214579bb-0e6f-4b0e-a69f-fc09bcd3b84b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:13:37.508247 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214579bb-0e6f-4b0e-a69f-fc09bcd3b84b service nova] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:13:37.517291 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1199/2403] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:13:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:13:38.821838 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9dc0d-32c8-46e8-a59c-a2ed6df11f85 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:13:38.822393 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9dc0d-32c8-46e8-a59c-a2ed6df11f85 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:13:38.822513 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9dc0d-32c8-46e8-a59c-a2ed6df11f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:13:38.841848 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-11d9dc0d-32c8-46e8-a59c-a2ed6df11f85 None None] MFA Rules not processed for user `01285d0eaa394db3900074a9ee48e784`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:13:38.843046 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-11d9dc0d-32c8-46e8-a59c-a2ed6df11f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:13:38.850177 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1205/2404] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:13:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:14:08.217126 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214579bb-0e6f-4b0e-a69f-fc09bcd3b84b service nova] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:14:08.219334 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-214579bb-0e6f-4b0e-a69f-fc09bcd3b84b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:14:08.254312 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aae80c-3b9a-49fb-ba06-e241186c8c85 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:14:08.254824 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aae80c-3b9a-49fb-ba06-e241186c8c85 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:14:08.255007 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aae80c-3b9a-49fb-ba06-e241186c8c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:14:08.272522 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-22aae80c-3b9a-49fb-ba06-e241186c8c85 None None] MFA Rules not processed for user `d78a9f8d6fa54845a68972977d13109b`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:14:08.273711 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-22aae80c-3b9a-49fb-ba06-e241186c8c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:14:08.288514 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214579bb-0e6f-4b0e-a69f-fc09bcd3b84b service nova] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:14:08.292338 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49c664-a389-47f9-9cde-66c537d496a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:14:08.293114 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49c664-a389-47f9-9cde-66c537d496a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:14:08.293392 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49c664-a389-47f9-9cde-66c537d496a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:14:08.294177 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49c664-a389-47f9-9cde-66c537d496a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:14:08.303126 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49c664-a389-47f9-9cde-66c537d496a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:14:08.304605 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49c664-a389-47f9-9cde-66c537d496a7 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:14:08.314518 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1200/2405] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:14:08 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:14:08.329139 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1206/2406] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:14:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:14:11.437493 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49c664-a389-47f9-9cde-66c537d496a7 service neutron] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:14:11.446282 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49c664-a389-47f9-9cde-66c537d496a7 service neutron] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:14:11.450779 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd024af-a734-46b7-9268-a185b283f9dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:14:11.451622 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd024af-a734-46b7-9268-a185b283f9dd service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:14:11.452111 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd024af-a734-46b7-9268-a185b283f9dd service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:14:11.452553 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd024af-a734-46b7-9268-a185b283f9dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:14:11.454608 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-bfd024af-a734-46b7-9268-a185b283f9dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:14:11.469529 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd024af-a734-46b7-9268-a185b283f9dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:14:11.471222 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd024af-a734-46b7-9268-a185b283f9dd service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:14:11.486778 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1201/2407] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:14:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:14:12.207975 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aae80c-3b9a-49fb-ba06-e241186c8c85 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:14:12.219165 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aae80c-3b9a-49fb-ba06-e241186c8c85 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:14:12.223345 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f45fcd-caa9-4fdc-bda6-984e537a9a71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:14:12.224197 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f45fcd-caa9-4fdc-bda6-984e537a9a71 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:14:12.224685 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f45fcd-caa9-4fdc-bda6-984e537a9a71 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:14:12.224948 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f45fcd-caa9-4fdc-bda6-984e537a9a71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:14:12.226834 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-50f45fcd-caa9-4fdc-bda6-984e537a9a71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:14:12.242038 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f45fcd-caa9-4fdc-bda6-984e537a9a71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:14:12.243675 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f45fcd-caa9-4fdc-bda6-984e537a9a71 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:14:12.258547 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1207/2408] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:14:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:14:18.516867 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fd6ba-56df-4d1a-b79f-3607c5a9423a None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:14:18.517399 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fd6ba-56df-4d1a-b79f-3607c5a9423a None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:14:18.517785 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fd6ba-56df-4d1a-b79f-3607c5a9423a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:14:18.534848 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-8b1fd6ba-56df-4d1a-b79f-3607c5a9423a None None] MFA Rules not processed for user `af9aa388314f4cfca823c8d13f67a8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:14:18.536092 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-8b1fd6ba-56df-4d1a-b79f-3607c5a9423a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:14:18.590205 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1202/2409] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:14:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:14:18.890460 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f45fcd-caa9-4fdc-bda6-984e537a9a71 service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:14:18.898856 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f45fcd-caa9-4fdc-bda6-984e537a9a71 service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:14:18.903154 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ca42c-7829-42da-ba64-fdb39ad6e0c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:14:18.903817 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ca42c-7829-42da-ba64-fdb39ad6e0c5 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:14:18.904104 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ca42c-7829-42da-ba64-fdb39ad6e0c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:14:18.904382 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ca42c-7829-42da-ba64-fdb39ad6e0c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:14:18.906331 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-e20ca42c-7829-42da-ba64-fdb39ad6e0c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:14:18.916120 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ca42c-7829-42da-ba64-fdb39ad6e0c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:14:18.917548 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ca42c-7829-42da-ba64-fdb39ad6e0c5 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:14:18.926115 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1208/2410] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:14:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:14:19.278855 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fd6ba-56df-4d1a-b79f-3607c5a9423a None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:14:19.280491 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-8b1fd6ba-56df-4d1a-b79f-3607c5a9423a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:14:19.356200 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fd6ba-56df-4d1a-b79f-3607c5a9423a None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:14:19.361445 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b19472-136c-49b7-ab97-929fd84a9252 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319da006b10c41f8aa8a9d5aa2225b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:14:19.362087 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b19472-136c-49b7-ab97-929fd84a9252 service placement] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:14:19.362369 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b19472-136c-49b7-ab97-929fd84a9252 service placement] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:14:19.362640 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b19472-136c-49b7-ab97-929fd84a9252 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:14:19.364396 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-15b19472-136c-49b7-ab97-929fd84a9252 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:14:19.375980 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b19472-136c-49b7-ab97-929fd84a9252 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:14:19.377519 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b19472-136c-49b7-ab97-929fd84a9252 service placement] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:14:19.387618 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1203/2411] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:14:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:14:20.289054 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ca42c-7829-42da-ba64-fdb39ad6e0c5 service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:14:20.299607 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ca42c-7829-42da-ba64-fdb39ad6e0c5 service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:14:20.303575 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3b488-0d09-4693-b4e5-87b277fd8161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:14:20.304487 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3b488-0d09-4693-b4e5-87b277fd8161 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:14:20.304964 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3b488-0d09-4693-b4e5-87b277fd8161 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:14:20.305523 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3b488-0d09-4693-b4e5-87b277fd8161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:14:20.307779 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-c9a3b488-0d09-4693-b4e5-87b277fd8161 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:14:20.321926 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3b488-0d09-4693-b4e5-87b277fd8161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:14:20.323429 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3b488-0d09-4693-b4e5-87b277fd8161 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:14:20.336371 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1209/2412] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:14:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:14:20.337105 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b19472-136c-49b7-ab97-929fd84a9252 service placement] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:14:20.349225 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b19472-136c-49b7-ab97-929fd84a9252 service placement] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:14:20.366804 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b61ca1-3d4e-470a-b8d3-fc3592cd14f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:14:20.367707 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b61ca1-3d4e-470a-b8d3-fc3592cd14f9 service nova] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:14:20.368327 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b61ca1-3d4e-470a-b8d3-fc3592cd14f9 service nova] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:14:20.368327 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b61ca1-3d4e-470a-b8d3-fc3592cd14f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:14:20.383224 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b61ca1-3d4e-470a-b8d3-fc3592cd14f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:14:20.385034 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b61ca1-3d4e-470a-b8d3-fc3592cd14f9 service nova] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:14:20.400020 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1204/2413] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:14:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:14:26.666099 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3b488-0d09-4693-b4e5-87b277fd8161 service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:14:26.674473 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3b488-0d09-4693-b4e5-87b277fd8161 service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:14:26.678119 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7697c6d-e07c-4095-a509-bd1f0358a8c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:14:26.678775 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7697c6d-e07c-4095-a509-bd1f0358a8c1 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:14:26.679057 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7697c6d-e07c-4095-a509-bd1f0358a8c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:14:26.679330 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7697c6d-e07c-4095-a509-bd1f0358a8c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:14:26.681107 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-b7697c6d-e07c-4095-a509-bd1f0358a8c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:14:26.691066 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7697c6d-e07c-4095-a509-bd1f0358a8c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:14:26.692500 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7697c6d-e07c-4095-a509-bd1f0358a8c1 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:14:26.700734 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1210/2414] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:14:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:14:29.364860 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b61ca1-3d4e-470a-b8d3-fc3592cd14f9 service nova] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:14:29.366355 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-b0b61ca1-3d4e-470a-b8d3-fc3592cd14f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:14:29.380833 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b61ca1-3d4e-470a-b8d3-fc3592cd14f9 service nova] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:14:29.386243 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe61f6f-f02d-468e-8e52-8821dc0f72b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:14:29.387521 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe61f6f-f02d-468e-8e52-8821dc0f72b5 service nova] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:14:29.387839 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe61f6f-f02d-468e-8e52-8821dc0f72b5 service nova] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:14:29.388116 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe61f6f-f02d-468e-8e52-8821dc0f72b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:14:29.389888 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-dfe61f6f-f02d-468e-8e52-8821dc0f72b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:14:29.447316 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe61f6f-f02d-468e-8e52-8821dc0f72b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:14:29.449519 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe61f6f-f02d-468e-8e52-8821dc0f72b5 service nova] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:14:29.458244 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1205/2415] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:14:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:14:36.414576 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea968b-7fd1-422a-bb4b-751df55f4c36 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:14:36.415077 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea968b-7fd1-422a-bb4b-751df55f4c36 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:14:36.415174 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea968b-7fd1-422a-bb4b-751df55f4c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:14:36.433520 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-38ea968b-7fd1-422a-bb4b-751df55f4c36 None None] MFA Rules not processed for user `78c3042fa768466e9a519b4fdb52edd3`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:14:36.434721 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-38ea968b-7fd1-422a-bb4b-751df55f4c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:14:36.490574 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1211/2416] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:14:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:14:36.805166 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe61f6f-f02d-468e-8e52-8821dc0f72b5 service nova] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:14:36.814282 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe61f6f-f02d-468e-8e52-8821dc0f72b5 service nova] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:14:36.818128 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf021ba-53b8-4fa1-a719-14cb705c6c26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:14:36.818757 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf021ba-53b8-4fa1-a719-14cb705c6c26 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:14:36.819041 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf021ba-53b8-4fa1-a719-14cb705c6c26 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:14:36.819314 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf021ba-53b8-4fa1-a719-14cb705c6c26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:14:36.821062 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-adf021ba-53b8-4fa1-a719-14cb705c6c26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:14:36.830605 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf021ba-53b8-4fa1-a719-14cb705c6c26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:14:36.832050 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf021ba-53b8-4fa1-a719-14cb705c6c26 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:14:36.840257 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1206/2417] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:14:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:14:42.838330 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9f23d-0448-41a4-98a7-2ce26595dc28 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:14:42.838792 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9f23d-0448-41a4-98a7-2ce26595dc28 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:14:42.838926 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9f23d-0448-41a4-98a7-2ce26595dc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:14:42.885740 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-51d9f23d-0448-41a4-98a7-2ce26595dc28 None None] MFA Rules not processed for user `7eb560db53cd4af192bb82abdfad3590`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:14:42.886932 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-51d9f23d-0448-41a4-98a7-2ce26595dc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:14:42.948759 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1212/2418] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Mar 10 04:14:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:14:42.995362 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf021ba-53b8-4fa1-a719-14cb705c6c26 service neutron] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:14:42.996780 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-adf021ba-53b8-4fa1-a719-14cb705c6c26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:14:43.081548 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf021ba-53b8-4fa1-a719-14cb705c6c26 service neutron] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:14:43.086472 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76dcf2c-efd7-42bb-9d9c-dd39a299a2f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260f561c676b4d049553eac4626b5502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:14:43.087108 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dcf2c-efd7-42bb-9d9c-dd39a299a2f4 service swift] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:14:43.087390 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dcf2c-efd7-42bb-9d9c-dd39a299a2f4 service swift] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:14:43.087667 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dcf2c-efd7-42bb-9d9c-dd39a299a2f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:14:43.095911 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76dcf2c-efd7-42bb-9d9c-dd39a299a2f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:14:43.097492 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76dcf2c-efd7-42bb-9d9c-dd39a299a2f4 service swift] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:14:43.105804 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1207/2419] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Mar 10 04:14:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 10 04:14:54.571293 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9f23d-0448-41a4-98a7-2ce26595dc28 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:14:54.585163 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9f23d-0448-41a4-98a7-2ce26595dc28 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:14:54.599248 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00823a2f-d3b9-428d-967f-c25cd96a7b8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:14:54.599921 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00823a2f-d3b9-428d-967f-c25cd96a7b8e service nova] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:14:54.600200 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00823a2f-d3b9-428d-967f-c25cd96a7b8e service nova] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:14:54.600738 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00823a2f-d3b9-428d-967f-c25cd96a7b8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:14:54.602624 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-00823a2f-d3b9-428d-967f-c25cd96a7b8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:14:54.618269 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00823a2f-d3b9-428d-967f-c25cd96a7b8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:14:54.621741 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00823a2f-d3b9-428d-967f-c25cd96a7b8e service nova] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:14:54.634763 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1213/2420] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:14:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:14:55.674319 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76dcf2c-efd7-42bb-9d9c-dd39a299a2f4 service swift] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:14:55.687222 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76dcf2c-efd7-42bb-9d9c-dd39a299a2f4 service swift] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:14:55.697461 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee584cf-d9ad-47a7-bed5-2d63697bfc2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:14:55.698670 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee584cf-d9ad-47a7-bed5-2d63697bfc2d service nova] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:14:55.698956 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee584cf-d9ad-47a7-bed5-2d63697bfc2d service nova] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:14:55.699235 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee584cf-d9ad-47a7-bed5-2d63697bfc2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:14:55.701109 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-4ee584cf-d9ad-47a7-bed5-2d63697bfc2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:14:55.718204 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee584cf-d9ad-47a7-bed5-2d63697bfc2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:14:55.718204 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee584cf-d9ad-47a7-bed5-2d63697bfc2d service nova] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:14:55.735366 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1208/2421] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:14:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:14:56.248392 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85034630-8453-4145-84a6-ac87feba160d None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:14:56.249007 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85034630-8453-4145-84a6-ac87feba160d None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:14:56.249107 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85034630-8453-4145-84a6-ac87feba160d None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:14:56.250990 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1214/2422] 10.222.0.15 () {54 vars in 921 bytes} [Thu Mar 10 04:14:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:14:56.258096 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98432b-d617-479a-804e-0ff0b8787476 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:14:56.258511 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98432b-d617-479a-804e-0ff0b8787476 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:14:56.258984 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98432b-d617-479a-804e-0ff0b8787476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:14:56.301970 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-5e98432b-d617-479a-804e-0ff0b8787476 None None] MFA Rules not processed for user `fbd92bd14ed04621af06d68161798fe3`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:14:56.303185 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-5e98432b-d617-479a-804e-0ff0b8787476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:14:56.313677 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1209/2423] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Mar 10 04:14:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:14:56.327754 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85034630-8453-4145-84a6-ac87feba160d None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:14:56.330437 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-85034630-8453-4145-84a6-ac87feba160d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:14:56.434445 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85034630-8453-4145-84a6-ac87feba160d None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:14:56.438153 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e987d70-fdc0-4801-b749-f22bf51b02a6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7c195f91114855acc58163631544d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:14:56.438791 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e987d70-fdc0-4801-b749-f22bf51b02a6 service glance] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:14:56.439075 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e987d70-fdc0-4801-b749-f22bf51b02a6 service glance] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:14:56.439599 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e987d70-fdc0-4801-b749-f22bf51b02a6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:14:56.455821 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e987d70-fdc0-4801-b749-f22bf51b02a6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:14:56.455821 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e987d70-fdc0-4801-b749-f22bf51b02a6 service glance] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:14:56.462730 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1215/2424] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:14:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:14:56.532686 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c27283-67c1-471d-9240-7c84996ab940 None None] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:14:56.532686 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c27283-67c1-471d-9240-7c84996ab940 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:14:56.532686 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c27283-67c1-471d-9240-7c84996ab940 None None] PATH_INFO: `/` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:14:56.532686 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1210/2425] 10.222.0.15 () {54 vars in 921 bytes} [Thu Mar 10 04:14:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:14:56.539103 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749c07f-47f3-47c6-95ac-5357c3394348 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:14:56.539374 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749c07f-47f3-47c6-95ac-5357c3394348 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:14:56.539660 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749c07f-47f3-47c6-95ac-5357c3394348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:14:56.558099 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-1749c07f-47f3-47c6-95ac-5357c3394348 None None] MFA Rules not processed for user `2faf262ae9d643c0b8708dcfecd75b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:14:56.559301 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-1749c07f-47f3-47c6-95ac-5357c3394348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:14:56.566242 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1216/2426] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Mar 10 04:14:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:14:56.578316 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c27283-67c1-471d-9240-7c84996ab940 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:14:56.590103 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c27283-67c1-471d-9240-7c84996ab940 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:14:56.594380 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd2bb2-5315-435e-8e05-c3693c9d1862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:14:56.595017 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd2bb2-5315-435e-8e05-c3693c9d1862 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:14:56.595327 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd2bb2-5315-435e-8e05-c3693c9d1862 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:14:56.595602 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd2bb2-5315-435e-8e05-c3693c9d1862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:14:56.603410 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd2bb2-5315-435e-8e05-c3693c9d1862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:14:56.605522 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd2bb2-5315-435e-8e05-c3693c9d1862 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:14:56.613858 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1211/2427] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:14:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:14:56.703487 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a4653-80fb-4d69-aeb6-1740bd1a2d8c None None] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:14:56.703850 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a4653-80fb-4d69-aeb6-1740bd1a2d8c None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:14:56.704129 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a4653-80fb-4d69-aeb6-1740bd1a2d8c None None] PATH_INFO: `/` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:14:56.705943 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1217/2428] 10.222.0.15 () {54 vars in 921 bytes} [Thu Mar 10 04:14:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 10 04:14:56.711742 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7e386-9351-4baa-836e-81cb47e3fb95 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:14:56.712251 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7e386-9351-4baa-836e-81cb47e3fb95 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:14:56.712545 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7e386-9351-4baa-836e-81cb47e3fb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:14:56.733363 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-10d7e386-9351-4baa-836e-81cb47e3fb95 None None] MFA Rules not processed for user `fbd92bd14ed04621af06d68161798fe3`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:14:56.734575 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-10d7e386-9351-4baa-836e-81cb47e3fb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:14:56.743833 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1212/2429] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Mar 10 04:14:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:14:56.755198 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a4653-80fb-4d69-aeb6-1740bd1a2d8c None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:14:56.767209 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a4653-80fb-4d69-aeb6-1740bd1a2d8c None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:14:56.771242 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7972e7-a2c0-47b5-9c0e-e9cc68ba387e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:14:56.772010 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7972e7-a2c0-47b5-9c0e-e9cc68ba387e service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:14:56.772361 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7972e7-a2c0-47b5-9c0e-e9cc68ba387e service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:14:56.772839 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7972e7-a2c0-47b5-9c0e-e9cc68ba387e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:14:56.784352 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7972e7-a2c0-47b5-9c0e-e9cc68ba387e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:14:56.785899 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7972e7-a2c0-47b5-9c0e-e9cc68ba387e service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:14:56.797181 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1218/2430] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:14:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:14:58.657383 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c346a10-53eb-40af-af94-ff30db5819ba None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:14:58.657834 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c346a10-53eb-40af-af94-ff30db5819ba None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:14:58.657951 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c346a10-53eb-40af-af94-ff30db5819ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:14:58.807516 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-9c346a10-53eb-40af-af94-ff30db5819ba None None] MFA Rules not processed for user `7eb560db53cd4af192bb82abdfad3590`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:14:58.808793 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-9c346a10-53eb-40af-af94-ff30db5819ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:14:58.816410 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1213/2431] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Mar 10 04:14:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:14:58.830776 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7972e7-a2c0-47b5-9c0e-e9cc68ba387e service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:14:58.841791 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7972e7-a2c0-47b5-9c0e-e9cc68ba387e service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:14:58.846699 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46c839-26ef-4e4c-8e00-674c7a408a85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260f561c676b4d049553eac4626b5502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:14:58.847328 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46c839-26ef-4e4c-8e00-674c7a408a85 service swift] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:14:58.847610 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46c839-26ef-4e4c-8e00-674c7a408a85 service swift] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:14:58.847912 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46c839-26ef-4e4c-8e00-674c7a408a85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:14:58.856800 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46c839-26ef-4e4c-8e00-674c7a408a85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:14:58.858378 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46c839-26ef-4e4c-8e00-674c7a408a85 service swift] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:14:58.866375 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1219/2432] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Mar 10 04:14:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 10 04:15:14.386775 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a1d1e-5cdb-4db3-9df5-7c38c5025c2b None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:14.387384 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a1d1e-5cdb-4db3-9df5-7c38c5025c2b None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:14.388633 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a1d1e-5cdb-4db3-9df5-7c38c5025c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:14.411664 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-e12a1d1e-5cdb-4db3-9df5-7c38c5025c2b None None] MFA Rules not processed for user `7eb560db53cd4af192bb82abdfad3590`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:14.413192 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-e12a1d1e-5cdb-4db3-9df5-7c38c5025c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:14.427203 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1214/2433] 10.222.0.15 () {58 vars in 967 bytes} [Thu Mar 10 04:15:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:15:14.442696 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46c839-26ef-4e4c-8e00-674c7a408a85 service swift] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:14.454817 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46c839-26ef-4e4c-8e00-674c7a408a85 service swift] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:14.460604 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83abd8-d7bc-4786-b032-aabc09c5c0cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260f561c676b4d049553eac4626b5502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:14.461375 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83abd8-d7bc-4786-b032-aabc09c5c0cf service swift] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:14.461757 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83abd8-d7bc-4786-b032-aabc09c5c0cf service swift] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:14.462283 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f83abd8-d7bc-4786-b032-aabc09c5c0cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:14.471948 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f83abd8-d7bc-4786-b032-aabc09c5c0cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:14.473760 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f83abd8-d7bc-4786-b032-aabc09c5c0cf service swift] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:14.485422 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1220/2434] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Mar 10 04:15:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 10 04:15:27.487414 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a1d1e-5cdb-4db3-9df5-7c38c5025c2b None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:27.488939 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-e12a1d1e-5cdb-4db3-9df5-7c38c5025c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:27.541593 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a1d1e-5cdb-4db3-9df5-7c38c5025c2b None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:27.545118 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c694f3b-f5de-4c0b-9229-dd028dd495a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:27.545750 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c694f3b-f5de-4c0b-9229-dd028dd495a0 service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:27.546031 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c694f3b-f5de-4c0b-9229-dd028dd495a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:27.546301 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c694f3b-f5de-4c0b-9229-dd028dd495a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:27.548068 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-2c694f3b-f5de-4c0b-9229-dd028dd495a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:27.558223 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c694f3b-f5de-4c0b-9229-dd028dd495a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:27.559631 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c694f3b-f5de-4c0b-9229-dd028dd495a0 service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:27.568421 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1215/2435] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:15:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:15:36.456123 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83abd8-d7bc-4786-b032-aabc09c5c0cf service swift] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:36.466426 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f83abd8-d7bc-4786-b032-aabc09c5c0cf service swift] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:36.470006 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba2adf-1e85-4989-b9bb-848803b2b551 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:36.470654 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba2adf-1e85-4989-b9bb-848803b2b551 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:36.470935 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba2adf-1e85-4989-b9bb-848803b2b551 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:36.471212 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba2adf-1e85-4989-b9bb-848803b2b551 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:36.473026 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-f3ba2adf-1e85-4989-b9bb-848803b2b551 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:36.537031 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba2adf-1e85-4989-b9bb-848803b2b551 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:36.538506 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba2adf-1e85-4989-b9bb-848803b2b551 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:36.549339 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1221/2436] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:15:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:15:39.854907 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c694f3b-f5de-4c0b-9229-dd028dd495a0 service cinder] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:39.856730 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-2c694f3b-f5de-4c0b-9229-dd028dd495a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:39.871973 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c694f3b-f5de-4c0b-9229-dd028dd495a0 service cinder] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:39.879545 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf0357-957e-4193-90d4-895db1565094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:39.880457 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf0357-957e-4193-90d4-895db1565094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:39.880801 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf0357-957e-4193-90d4-895db1565094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:39.881147 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf0357-957e-4193-90d4-895db1565094 admin admin] PATH_INFO: `/v3/users/af9aa388314f4cfca823c8d13f67a8e0` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:39.882378 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf0357-957e-4193-90d4-895db1565094 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af9aa388314f4cfca823c8d13f67a8e0)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:39.884928 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf0357-957e-4193-90d4-895db1565094 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:39.929892 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-1fcf0357-957e-4193-90d4-895db1565094 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af9aa388314f4cfca823c8d13f67a8e0'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:39.937777 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-1fcf0357-957e-4193-90d4-895db1565094 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af9aa388314f4cfca823c8d13f67a8e0'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:39.947372 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-1fcf0357-957e-4193-90d4-895db1565094 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af9aa388314f4cfca823c8d13f67a8e0'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:39.959439 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-1fcf0357-957e-4193-90d4-895db1565094 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af9aa388314f4cfca823c8d13f67a8e0'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:39.960096 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-1fcf0357-957e-4193-90d4-895db1565094 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af9aa388314f4cfca823c8d13f67a8e0'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:39.965901 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1216/2437] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:15:39 2022] DELETE /identity/v3/users/af9aa388314f4cfca823c8d13f67a8e0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:40.101618 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba2adf-1e85-4989-b9bb-848803b2b551 service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:40.110043 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba2adf-1e85-4989-b9bb-848803b2b551 service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:40.139867 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf0357-957e-4193-90d4-895db1565094 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:40.141405 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-1fcf0357-957e-4193-90d4-895db1565094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:40.166215 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9935b-2332-409c-ad32-889b9f465185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:40.166867 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9935b-2332-409c-ad32-889b9f465185 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:40.167205 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9935b-2332-409c-ad32-889b9f465185 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:40.167387 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9935b-2332-409c-ad32-889b9f465185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:40.169346 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-91b9935b-2332-409c-ad32-889b9f465185 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:40.205887 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf0357-957e-4193-90d4-895db1565094 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:40.211277 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6984580-be89-46dd-8031-13bfe7f6fa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:40.212191 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6984580-be89-46dd-8031-13bfe7f6fa79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:40.212474 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6984580-be89-46dd-8031-13bfe7f6fa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:40.212748 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6984580-be89-46dd-8031-13bfe7f6fa79 admin admin] PATH_INFO: `/v3/projects/2e617a5a84b449da8e8806baed547052` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:40.213916 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6984580-be89-46dd-8031-13bfe7f6fa79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e617a5a84b449da8e8806baed547052)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:40.215826 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6984580-be89-46dd-8031-13bfe7f6fa79 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:40.232817 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9935b-2332-409c-ad32-889b9f465185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:40.234273 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9935b-2332-409c-ad32-889b9f465185 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:40.245830 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1222/2438] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:15:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:15:40.260735 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-f6984580-be89-46dd-8031-13bfe7f6fa79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e617a5a84b449da8e8806baed547052', 'request_id': 'req-f6984580-be89-46dd-8031-13bfe7f6fa79'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:40.265992 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-f6984580-be89-46dd-8031-13bfe7f6fa79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e617a5a84b449da8e8806baed547052', 'request_id': 'req-f6984580-be89-46dd-8031-13bfe7f6fa79'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:40.272027 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-f6984580-be89-46dd-8031-13bfe7f6fa79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e617a5a84b449da8e8806baed547052', 'request_id': 'req-f6984580-be89-46dd-8031-13bfe7f6fa79'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:40.284677 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-f6984580-be89-46dd-8031-13bfe7f6fa79 admin admin] The token cache is being invalidate because project 2e617a5a84b449da8e8806baed547052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:15:40.285047 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-f6984580-be89-46dd-8031-13bfe7f6fa79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:40.285964 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-f6984580-be89-46dd-8031-13bfe7f6fa79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:40.287595 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1217/2439] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:15:40 2022] DELETE /identity/v3/projects/2e617a5a84b449da8e8806baed547052 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:40.293020 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9ac83-0093-4ebf-a929-328388470eb9 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:40.293315 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9ac83-0093-4ebf-a929-328388470eb9 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:40.293597 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9ac83-0093-4ebf-a929-328388470eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:40.312012 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-80d9ac83-0093-4ebf-a929-328388470eb9 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:40.313248 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-80d9ac83-0093-4ebf-a929-328388470eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:40.371026 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1223/2440] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:15:40.379545 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f74199-3768-4d24-a808-8b291b24540e None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:40.379876 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f74199-3768-4d24-a808-8b291b24540e None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:40.380163 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f74199-3768-4d24-a808-8b291b24540e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:40.398200 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-51f74199-3768-4d24-a808-8b291b24540e None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:40.399327 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-51f74199-3768-4d24-a808-8b291b24540e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:40.407288 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1218/2441] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:15:40.411655 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9ac83-0093-4ebf-a929-328388470eb9 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:40.421863 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9ac83-0093-4ebf-a929-328388470eb9 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:40.426441 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668266d-8943-4798-b94b-bab418dfa166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:40.427078 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668266d-8943-4798-b94b-bab418dfa166 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:40.427359 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668266d-8943-4798-b94b-bab418dfa166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:40.427630 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668266d-8943-4798-b94b-bab418dfa166 admin admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:40.428372 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668266d-8943-4798-b94b-bab418dfa166 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:15:40.428667 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668266d-8943-4798-b94b-bab418dfa166 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:40.430246 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668266d-8943-4798-b94b-bab418dfa166 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:40.445954 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1224/2442] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:15:40.447135 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f74199-3768-4d24-a808-8b291b24540e None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:40.456285 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f74199-3768-4d24-a808-8b291b24540e None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:40.461008 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76d530-af7d-45e3-bc23-5e96f63f492f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:40.461660 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76d530-af7d-45e3-bc23-5e96f63f492f admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:40.461973 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76d530-af7d-45e3-bc23-5e96f63f492f admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:40.462250 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76d530-af7d-45e3-bc23-5e96f63f492f admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:40.462941 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76d530-af7d-45e3-bc23-5e96f63f492f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:40.464884 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76d530-af7d-45e3-bc23-5e96f63f492f admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:40.500032 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1219/2443] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:15:40 2022] POST /identity/v3/projects => generated 401 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:15:40.504527 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668266d-8943-4798-b94b-bab418dfa166 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:40.514372 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668266d-8943-4798-b94b-bab418dfa166 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:40.569303 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfc294-11e2-44e9-9903-76a44ae6a0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:40.569977 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfc294-11e2-44e9-9903-76a44ae6a0f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:40.570261 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfc294-11e2-44e9-9903-76a44ae6a0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:40.570538 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfc294-11e2-44e9-9903-76a44ae6a0f6 admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:40.571237 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cfc294-11e2-44e9-9903-76a44ae6a0f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:40.573505 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cfc294-11e2-44e9-9903-76a44ae6a0f6 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:40.595852 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1225/2444] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:15:40 2022] POST /identity/v3/users => generated 301 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:15:40.597442 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76d530-af7d-45e3-bc23-5e96f63f492f admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:40.608082 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76d530-af7d-45e3-bc23-5e96f63f492f admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:40.612701 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbf27b-de6f-4f29-8e67-32a59bd2810a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:40.613351 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbf27b-de6f-4f29-8e67-32a59bd2810a admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:40.613629 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbf27b-de6f-4f29-8e67-32a59bd2810a admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:40.613899 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbf27b-de6f-4f29-8e67-32a59bd2810a admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:40.614614 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebbf27b-de6f-4f29-8e67-32a59bd2810a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:40.616223 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebbf27b-de6f-4f29-8e67-32a59bd2810a admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:40.626762 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1220/2445] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:15:40.630707 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfc294-11e2-44e9-9903-76a44ae6a0f6 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:40.640446 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfc294-11e2-44e9-9903-76a44ae6a0f6 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:40.644995 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0ed70-081b-467d-8631-526ec70a49af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:40.645708 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0ed70-081b-467d-8631-526ec70a49af admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:40.645927 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0ed70-081b-467d-8631-526ec70a49af admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:40.646202 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0ed70-081b-467d-8631-526ec70a49af admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:40.646917 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0ed70-081b-467d-8631-526ec70a49af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:40.648578 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0ed70-081b-467d-8631-526ec70a49af admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:40.663740 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1226/2446] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:15:40.664875 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbf27b-de6f-4f29-8e67-32a59bd2810a admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:40.675172 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbf27b-de6f-4f29-8e67-32a59bd2810a admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:40.679794 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b8c4e-5dd4-45c6-a7bf-059b0b5b0821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:40.680677 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b8c4e-5dd4-45c6-a7bf-059b0b5b0821 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:40.680971 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b8c4e-5dd4-45c6-a7bf-059b0b5b0821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:40.681262 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b8c4e-5dd4-45c6-a7bf-059b0b5b0821 admin admin] PATH_INFO: `/v3/projects/ae7f180ab3f94ec9adb278b323b9b935/users/656dbe0c52634d1b98f380a5b24f6414/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:40.695868 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b8c4e-5dd4-45c6-a7bf-059b0b5b0821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae7f180ab3f94ec9adb278b323b9b935, user_id=656dbe0c52634d1b98f380a5b24f6414, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:40.698538 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b8c4e-5dd4-45c6-a7bf-059b0b5b0821 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:40.711331 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1221/2447] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:15:40 2022] PUT /identity/v3/projects/ae7f180ab3f94ec9adb278b323b9b935/users/656dbe0c52634d1b98f380a5b24f6414/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:15:40.721803 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b49dd5-3f2c-46e6-b4d3-11f44fb5f619 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:40.722193 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b49dd5-3f2c-46e6-b4d3-11f44fb5f619 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:40.722545 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b49dd5-3f2c-46e6-b4d3-11f44fb5f619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:40.749149 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-02b49dd5-3f2c-46e6-b4d3-11f44fb5f619 None None] MFA Rules not processed for user `656dbe0c52634d1b98f380a5b24f6414`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:40.750352 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-02b49dd5-3f2c-46e6-b4d3-11f44fb5f619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:40.812354 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1227/2448] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:15:40.817102 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b8c4e-5dd4-45c6-a7bf-059b0b5b0821 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:40.876173 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b8c4e-5dd4-45c6-a7bf-059b0b5b0821 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:40.881141 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc426998-7d12-4ab1-86e0-4ac2c0715c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:40.881834 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc426998-7d12-4ab1-86e0-4ac2c0715c74 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:40.882119 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc426998-7d12-4ab1-86e0-4ac2c0715c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:40.882421 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc426998-7d12-4ab1-86e0-4ac2c0715c74 admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:40.883119 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc426998-7d12-4ab1-86e0-4ac2c0715c74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:40.885658 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc426998-7d12-4ab1-86e0-4ac2c0715c74 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:40.911754 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1222/2449] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:15:40 2022] POST /identity/v3/projects => generated 403 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:15:40.915488 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b49dd5-3f2c-46e6-b4d3-11f44fb5f619 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:40.926412 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b49dd5-3f2c-46e6-b4d3-11f44fb5f619 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:40.983718 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4a55c-f95f-4ec7-865a-b9d6ba62299b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:40.984412 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4a55c-f95f-4ec7-865a-b9d6ba62299b admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:40.984688 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4a55c-f95f-4ec7-865a-b9d6ba62299b admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:40.984966 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4a55c-f95f-4ec7-865a-b9d6ba62299b admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:40.985770 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4a55c-f95f-4ec7-865a-b9d6ba62299b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:40.987772 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4a55c-f95f-4ec7-865a-b9d6ba62299b admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:41.007559 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1228/2450] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:15:40 2022] POST /identity/v3/users => generated 308 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:15:41.012497 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc426998-7d12-4ab1-86e0-4ac2c0715c74 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:41.022365 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc426998-7d12-4ab1-86e0-4ac2c0715c74 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:41.027533 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2675f-6f82-477c-8301-18a1184914dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:41.028231 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2675f-6f82-477c-8301-18a1184914dc admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:41.028575 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2675f-6f82-477c-8301-18a1184914dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:41.029525 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2675f-6f82-477c-8301-18a1184914dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:41.030525 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f2675f-6f82-477c-8301-18a1184914dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:41.032165 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f2675f-6f82-477c-8301-18a1184914dc admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:41.053755 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1223/2451] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:15:41.058568 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4a55c-f95f-4ec7-865a-b9d6ba62299b admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:41.069093 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4a55c-f95f-4ec7-865a-b9d6ba62299b admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:41.074137 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0ba62-5069-4525-a136-3683cac7d4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:41.075119 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0ba62-5069-4525-a136-3683cac7d4b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:41.075470 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0ba62-5069-4525-a136-3683cac7d4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:41.075868 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0ba62-5069-4525-a136-3683cac7d4b3 admin admin] PATH_INFO: `/v3/projects/e9042c3bbe614337b03e0c491ec1ecf8/users/1de8c0ceebc14374b5c6d1861a48d0ab/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:41.090239 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0ba62-5069-4525-a136-3683cac7d4b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9042c3bbe614337b03e0c491ec1ecf8, user_id=1de8c0ceebc14374b5c6d1861a48d0ab, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:41.093011 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0ba62-5069-4525-a136-3683cac7d4b3 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:41.107054 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1229/2452] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:15:41 2022] PUT /identity/v3/projects/e9042c3bbe614337b03e0c491ec1ecf8/users/1de8c0ceebc14374b5c6d1861a48d0ab/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:15:41.111079 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2675f-6f82-477c-8301-18a1184914dc admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:41.121498 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2675f-6f82-477c-8301-18a1184914dc admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:41.174441 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1bc62-b7fa-41fc-b116-66964e7fc0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:41.175112 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1bc62-b7fa-41fc-b116-66964e7fc0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:41.175399 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1bc62-b7fa-41fc-b116-66964e7fc0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:41.175697 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1bc62-b7fa-41fc-b116-66964e7fc0b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:41.176431 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1bc62-b7fa-41fc-b116-66964e7fc0b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:41.178009 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1bc62-b7fa-41fc-b116-66964e7fc0b8 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:41.189684 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1224/2453] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:15:41.194570 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0ba62-5069-4525-a136-3683cac7d4b3 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:41.205127 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0ba62-5069-4525-a136-3683cac7d4b3 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:41.210115 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05926a-f765-4a34-b7c5-9a291b741fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:41.211006 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05926a-f765-4a34-b7c5-9a291b741fd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:41.211270 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05926a-f765-4a34-b7c5-9a291b741fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:41.211538 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05926a-f765-4a34-b7c5-9a291b741fd3 admin admin] PATH_INFO: `/v3/projects/e9042c3bbe614337b03e0c491ec1ecf8/users/1de8c0ceebc14374b5c6d1861a48d0ab/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:41.213636 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05926a-f765-4a34-b7c5-9a291b741fd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9042c3bbe614337b03e0c491ec1ecf8, user_id=1de8c0ceebc14374b5c6d1861a48d0ab, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:41.216340 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05926a-f765-4a34-b7c5-9a291b741fd3 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:41.226439 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1230/2454] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:15:41 2022] PUT /identity/v3/projects/e9042c3bbe614337b03e0c491ec1ecf8/users/1de8c0ceebc14374b5c6d1861a48d0ab/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:15:41.238252 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12d445-38bf-4703-93cf-1fac40f128bc None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:41.238637 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12d445-38bf-4703-93cf-1fac40f128bc None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:41.239171 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12d445-38bf-4703-93cf-1fac40f128bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:41.267202 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-4a12d445-38bf-4703-93cf-1fac40f128bc None None] MFA Rules not processed for user `1de8c0ceebc14374b5c6d1861a48d0ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:41.270826 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-4a12d445-38bf-4703-93cf-1fac40f128bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:41.347868 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1225/2455] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:41 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:15:41.360359 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05926a-f765-4a34-b7c5-9a291b741fd3 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:41.362194 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-fb05926a-f765-4a34-b7c5-9a291b741fd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:41.424047 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05926a-f765-4a34-b7c5-9a291b741fd3 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:41.427925 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a1ad0-fe5a-47d6-88d4-e0741d5f3f9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:41.428617 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a1ad0-fe5a-47d6-88d4-e0741d5f3f9e service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:41.428963 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a1ad0-fe5a-47d6-88d4-e0741d5f3f9e service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:41.429305 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a1ad0-fe5a-47d6-88d4-e0741d5f3f9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:41.439477 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a1ad0-fe5a-47d6-88d4-e0741d5f3f9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:41.441066 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a1ad0-fe5a-47d6-88d4-e0741d5f3f9e service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:41.464875 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1231/2456] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:15:41 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:15:41.594289 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12d445-38bf-4703-93cf-1fac40f128bc None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:41.653308 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12d445-38bf-4703-93cf-1fac40f128bc None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:41.658843 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789155c-3272-412d-9840-45785a8f3ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:41.659824 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789155c-3272-412d-9840-45785a8f3ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:41.660115 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789155c-3272-412d-9840-45785a8f3ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:41.660392 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789155c-3272-412d-9840-45785a8f3ad7 admin admin] PATH_INFO: `/v3/users/656dbe0c52634d1b98f380a5b24f6414` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:41.661592 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789155c-3272-412d-9840-45785a8f3ad7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=656dbe0c52634d1b98f380a5b24f6414)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:41.663527 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789155c-3272-412d-9840-45785a8f3ad7 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:41.709724 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-3789155c-3272-412d-9840-45785a8f3ad7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '656dbe0c52634d1b98f380a5b24f6414'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:41.717070 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-3789155c-3272-412d-9840-45785a8f3ad7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '656dbe0c52634d1b98f380a5b24f6414'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:41.724586 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-3789155c-3272-412d-9840-45785a8f3ad7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '656dbe0c52634d1b98f380a5b24f6414'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:41.738035 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-3789155c-3272-412d-9840-45785a8f3ad7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '656dbe0c52634d1b98f380a5b24f6414'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:41.738792 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-3789155c-3272-412d-9840-45785a8f3ad7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '656dbe0c52634d1b98f380a5b24f6414'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:41.744854 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1226/2457] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:15:41 2022] DELETE /identity/v3/users/656dbe0c52634d1b98f380a5b24f6414 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:41.749586 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f80f83-9251-4b83-97f6-9ba0b15da737 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:41.749979 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f80f83-9251-4b83-97f6-9ba0b15da737 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:41.750328 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f80f83-9251-4b83-97f6-9ba0b15da737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:41.768927 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-d6f80f83-9251-4b83-97f6-9ba0b15da737 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:41.770268 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-d6f80f83-9251-4b83-97f6-9ba0b15da737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:41.840091 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1232/2458] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:15:41.850730 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789155c-3272-412d-9840-45785a8f3ad7 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:41.852280 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-3789155c-3272-412d-9840-45785a8f3ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:41.911760 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789155c-3272-412d-9840-45785a8f3ad7 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:41.915573 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e2830-f5b3-49c2-9596-4ae18dcebf57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:41.916286 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e2830-f5b3-49c2-9596-4ae18dcebf57 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:41.916572 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e2830-f5b3-49c2-9596-4ae18dcebf57 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:41.916851 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e2830-f5b3-49c2-9596-4ae18dcebf57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:41.926497 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e2830-f5b3-49c2-9596-4ae18dcebf57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:41.927988 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e2830-f5b3-49c2-9596-4ae18dcebf57 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:41.937837 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1227/2459] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:15:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:15:42.226708 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f80f83-9251-4b83-97f6-9ba0b15da737 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:42.228485 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-d6f80f83-9251-4b83-97f6-9ba0b15da737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:42.244593 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f80f83-9251-4b83-97f6-9ba0b15da737 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:42.253122 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07bcdc-8cf9-4d94-b03d-da040bfdde4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:42.254417 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07bcdc-8cf9-4d94-b03d-da040bfdde4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:42.254853 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07bcdc-8cf9-4d94-b03d-da040bfdde4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:42.265837 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07bcdc-8cf9-4d94-b03d-da040bfdde4e admin admin] PATH_INFO: `/v3/projects/ae7f180ab3f94ec9adb278b323b9b935` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:42.267192 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff07bcdc-8cf9-4d94-b03d-da040bfdde4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae7f180ab3f94ec9adb278b323b9b935)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:42.269170 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff07bcdc-8cf9-4d94-b03d-da040bfdde4e admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:42.323801 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-ff07bcdc-8cf9-4d94-b03d-da040bfdde4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae7f180ab3f94ec9adb278b323b9b935', 'request_id': 'req-ff07bcdc-8cf9-4d94-b03d-da040bfdde4e'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:42.329220 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-ff07bcdc-8cf9-4d94-b03d-da040bfdde4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae7f180ab3f94ec9adb278b323b9b935', 'request_id': 'req-ff07bcdc-8cf9-4d94-b03d-da040bfdde4e'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:42.335898 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-ff07bcdc-8cf9-4d94-b03d-da040bfdde4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae7f180ab3f94ec9adb278b323b9b935', 'request_id': 'req-ff07bcdc-8cf9-4d94-b03d-da040bfdde4e'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:42.350138 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-ff07bcdc-8cf9-4d94-b03d-da040bfdde4e admin admin] The token cache is being invalidate because project ae7f180ab3f94ec9adb278b323b9b935 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:15:42.350727 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-ff07bcdc-8cf9-4d94-b03d-da040bfdde4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:42.351500 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-ff07bcdc-8cf9-4d94-b03d-da040bfdde4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:42.353491 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1233/2460] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:15:42 2022] DELETE /identity/v3/projects/ae7f180ab3f94ec9adb278b323b9b935 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:42.357224 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e2830-f5b3-49c2-9596-4ae18dcebf57 service neutron] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:42.367013 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e2830-f5b3-49c2-9596-4ae18dcebf57 service neutron] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:42.432739 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27d127-ce3a-422a-b4d1-ead3625913c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:42.433980 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27d127-ce3a-422a-b4d1-ead3625913c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:42.434557 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27d127-ce3a-422a-b4d1-ead3625913c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:42.434859 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27d127-ce3a-422a-b4d1-ead3625913c0 admin admin] PATH_INFO: `/v3/users/1de8c0ceebc14374b5c6d1861a48d0ab` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:42.436547 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27d127-ce3a-422a-b4d1-ead3625913c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1de8c0ceebc14374b5c6d1861a48d0ab)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:42.440669 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27d127-ce3a-422a-b4d1-ead3625913c0 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:42.492892 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-9e27d127-ce3a-422a-b4d1-ead3625913c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1de8c0ceebc14374b5c6d1861a48d0ab'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:42.499886 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-9e27d127-ce3a-422a-b4d1-ead3625913c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1de8c0ceebc14374b5c6d1861a48d0ab'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:42.508124 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-9e27d127-ce3a-422a-b4d1-ead3625913c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1de8c0ceebc14374b5c6d1861a48d0ab'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:42.520921 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-9e27d127-ce3a-422a-b4d1-ead3625913c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1de8c0ceebc14374b5c6d1861a48d0ab'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:42.521545 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-9e27d127-ce3a-422a-b4d1-ead3625913c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1de8c0ceebc14374b5c6d1861a48d0ab'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:42.529562 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1228/2461] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:15:42 2022] DELETE /identity/v3/users/1de8c0ceebc14374b5c6d1861a48d0ab => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:42.812540 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07bcdc-8cf9-4d94-b03d-da040bfdde4e admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:42.814418 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-ff07bcdc-8cf9-4d94-b03d-da040bfdde4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:42.834619 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07bcdc-8cf9-4d94-b03d-da040bfdde4e admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:42.891539 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a00ee-d673-469a-ad5b-068133bb9b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:42.892405 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a00ee-d673-469a-ad5b-068133bb9b9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:42.892799 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a00ee-d673-469a-ad5b-068133bb9b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:42.893088 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a00ee-d673-469a-ad5b-068133bb9b9a admin admin] PATH_INFO: `/v3/projects/e9042c3bbe614337b03e0c491ec1ecf8` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:42.894299 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a00ee-d673-469a-ad5b-068133bb9b9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9042c3bbe614337b03e0c491ec1ecf8)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:42.896261 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a00ee-d673-469a-ad5b-068133bb9b9a admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:42.944148 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-0e6a00ee-d673-469a-ad5b-068133bb9b9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9042c3bbe614337b03e0c491ec1ecf8', 'request_id': 'req-0e6a00ee-d673-469a-ad5b-068133bb9b9a'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:42.950096 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-0e6a00ee-d673-469a-ad5b-068133bb9b9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9042c3bbe614337b03e0c491ec1ecf8', 'request_id': 'req-0e6a00ee-d673-469a-ad5b-068133bb9b9a'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:42.956242 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-0e6a00ee-d673-469a-ad5b-068133bb9b9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9042c3bbe614337b03e0c491ec1ecf8', 'request_id': 'req-0e6a00ee-d673-469a-ad5b-068133bb9b9a'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:42.969692 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-0e6a00ee-d673-469a-ad5b-068133bb9b9a admin admin] The token cache is being invalidate because project e9042c3bbe614337b03e0c491ec1ecf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:15:42.969978 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-0e6a00ee-d673-469a-ad5b-068133bb9b9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:42.970589 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-0e6a00ee-d673-469a-ad5b-068133bb9b9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:42.972137 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1234/2462] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:15:42 2022] DELETE /identity/v3/projects/e9042c3bbe614337b03e0c491ec1ecf8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:42.977007 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66442b1d-a659-451d-b5a3-a3ed220b0b40 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:42.977551 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66442b1d-a659-451d-b5a3-a3ed220b0b40 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:42.977660 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66442b1d-a659-451d-b5a3-a3ed220b0b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:42.995461 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-66442b1d-a659-451d-b5a3-a3ed220b0b40 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:42.996624 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-66442b1d-a659-451d-b5a3-a3ed220b0b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:43.059932 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1229/2463] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:15:43.065050 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac40d93-e5a4-4b3d-9c7b-3a4a1c9e1402 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:43.066195 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac40d93-e5a4-4b3d-9c7b-3a4a1c9e1402 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:43.066663 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac40d93-e5a4-4b3d-9c7b-3a4a1c9e1402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:43.093400 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-1ac40d93-e5a4-4b3d-9c7b-3a4a1c9e1402 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:43.094805 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-1ac40d93-e5a4-4b3d-9c7b-3a4a1c9e1402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:43.103072 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1235/2464] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:15:43.107418 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66442b1d-a659-451d-b5a3-a3ed220b0b40 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:43.120143 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66442b1d-a659-451d-b5a3-a3ed220b0b40 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:43.126706 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d31c37-066f-422d-8c48-4b9780ea7fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:43.127478 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d31c37-066f-422d-8c48-4b9780ea7fed admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:43.128193 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d31c37-066f-422d-8c48-4b9780ea7fed admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:43.128547 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d31c37-066f-422d-8c48-4b9780ea7fed admin admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:43.129697 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d31c37-066f-422d-8c48-4b9780ea7fed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:15:43.129830 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d31c37-066f-422d-8c48-4b9780ea7fed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:43.131333 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d31c37-066f-422d-8c48-4b9780ea7fed admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:43.149805 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac40d93-e5a4-4b3d-9c7b-3a4a1c9e1402 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:43.154525 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1230/2465] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 04:15:43.159650 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac40d93-e5a4-4b3d-9c7b-3a4a1c9e1402 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:43.169650 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a280ee-aaa9-4435-a667-8b5723a2f677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:43.172314 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a280ee-aaa9-4435-a667-8b5723a2f677 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:43.173098 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a280ee-aaa9-4435-a667-8b5723a2f677 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:43.173383 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a280ee-aaa9-4435-a667-8b5723a2f677 admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:43.174774 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a280ee-aaa9-4435-a667-8b5723a2f677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:43.178356 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a280ee-aaa9-4435-a667-8b5723a2f677 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:43.223198 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1236/2466] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:15:43 2022] POST /identity/v3/projects => generated 365 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:15:43.224424 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d31c37-066f-422d-8c48-4b9780ea7fed admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:43.234765 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d31c37-066f-422d-8c48-4b9780ea7fed admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:43.294971 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5665cf6-b499-4b18-94fd-008959247de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:43.295816 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5665cf6-b499-4b18-94fd-008959247de5 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:43.296166 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5665cf6-b499-4b18-94fd-008959247de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:43.296508 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5665cf6-b499-4b18-94fd-008959247de5 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:43.297285 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5665cf6-b499-4b18-94fd-008959247de5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:43.299279 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5665cf6-b499-4b18-94fd-008959247de5 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:43.324566 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1231/2467] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:15:43 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:15:43.328575 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a280ee-aaa9-4435-a667-8b5723a2f677 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:43.339138 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a280ee-aaa9-4435-a667-8b5723a2f677 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:43.343755 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8bdba-1654-4a86-bd9a-581dc380d9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:43.344417 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8bdba-1654-4a86-bd9a-581dc380d9de admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:43.344701 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8bdba-1654-4a86-bd9a-581dc380d9de admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:43.344977 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8bdba-1654-4a86-bd9a-581dc380d9de admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:43.345699 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8bdba-1654-4a86-bd9a-581dc380d9de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:43.347286 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8bdba-1654-4a86-bd9a-581dc380d9de admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:43.358294 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1237/2468] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:15:43.362264 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5665cf6-b499-4b18-94fd-008959247de5 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:43.372954 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5665cf6-b499-4b18-94fd-008959247de5 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:43.377834 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee7cf3-9964-4ec7-b9c1-30e647f8a821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:43.378492 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee7cf3-9964-4ec7-b9c1-30e647f8a821 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:43.378775 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee7cf3-9964-4ec7-b9c1-30e647f8a821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:43.379053 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee7cf3-9964-4ec7-b9c1-30e647f8a821 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:43.379817 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee7cf3-9964-4ec7-b9c1-30e647f8a821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:43.381400 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee7cf3-9964-4ec7-b9c1-30e647f8a821 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:43.393194 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1232/2469] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:15:43.397132 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8bdba-1654-4a86-bd9a-581dc380d9de admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:43.409568 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8bdba-1654-4a86-bd9a-581dc380d9de admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:43.414595 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e985a-dfbf-48ba-979d-32c143ae6b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:43.416116 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e985a-dfbf-48ba-979d-32c143ae6b17 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:43.416470 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e985a-dfbf-48ba-979d-32c143ae6b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:43.416819 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e985a-dfbf-48ba-979d-32c143ae6b17 admin admin] PATH_INFO: `/v3/projects/4998640c62624c6f852018d2a87ee2c2/users/82c3ba13189848e9875bb2691afadfd6/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:43.431845 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e985a-dfbf-48ba-979d-32c143ae6b17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4998640c62624c6f852018d2a87ee2c2, user_id=82c3ba13189848e9875bb2691afadfd6, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:43.434507 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e985a-dfbf-48ba-979d-32c143ae6b17 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:43.448079 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1238/2470] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:15:43 2022] PUT /identity/v3/projects/4998640c62624c6f852018d2a87ee2c2/users/82c3ba13189848e9875bb2691afadfd6/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:15:43.458360 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83e922-c743-4de8-a771-d81b0d7d99a0 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:43.458656 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83e922-c743-4de8-a771-d81b0d7d99a0 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:43.458939 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83e922-c743-4de8-a771-d81b0d7d99a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:43.487362 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-9a83e922-c743-4de8-a771-d81b0d7d99a0 None None] MFA Rules not processed for user `82c3ba13189848e9875bb2691afadfd6`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:43.488810 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-9a83e922-c743-4de8-a771-d81b0d7d99a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:43.576794 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1233/2471] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:43 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:15:43.581189 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e985a-dfbf-48ba-979d-32c143ae6b17 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:43.657800 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e985a-dfbf-48ba-979d-32c143ae6b17 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:43.663443 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc4caa-af76-4618-ba73-8a95519ac0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:43.664152 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc4caa-af76-4618-ba73-8a95519ac0bb admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:43.664440 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc4caa-af76-4618-ba73-8a95519ac0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:43.664717 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc4caa-af76-4618-ba73-8a95519ac0bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:43.666319 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc4caa-af76-4618-ba73-8a95519ac0bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:43.668604 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc4caa-af76-4618-ba73-8a95519ac0bb admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:43.693916 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1239/2472] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:15:43 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:15:43.698172 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83e922-c743-4de8-a771-d81b0d7d99a0 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:43.709867 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83e922-c743-4de8-a771-d81b0d7d99a0 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:43.737991 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc4caa-af76-4618-ba73-8a95519ac0bb admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:43.741579 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-57cc4caa-af76-4618-ba73-8a95519ac0bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:43.785181 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdfaffb-a130-4236-8704-3f437e3ed76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:43.785975 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdfaffb-a130-4236-8704-3f437e3ed76b admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:43.786324 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdfaffb-a130-4236-8704-3f437e3ed76b admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:43.786680 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdfaffb-a130-4236-8704-3f437e3ed76b admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:43.787600 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdfaffb-a130-4236-8704-3f437e3ed76b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:43.789637 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdfaffb-a130-4236-8704-3f437e3ed76b admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:43.815345 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1234/2473] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:15:43 2022] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:15:43.817039 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc4caa-af76-4618-ba73-8a95519ac0bb admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:43.820692 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdfaffb-a130-4236-8704-3f437e3ed76b admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:43.822507 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61877c1c-418e-499d-a8b7-26a1927db749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:43.823562 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61877c1c-418e-499d-a8b7-26a1927db749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:43.824051 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61877c1c-418e-499d-a8b7-26a1927db749 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:43.824477 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61877c1c-418e-499d-a8b7-26a1927db749 admin admin] PATH_INFO: `/v3/users/d78a9f8d6fa54845a68972977d13109b` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:43.826111 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61877c1c-418e-499d-a8b7-26a1927db749 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d78a9f8d6fa54845a68972977d13109b)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:43.831652 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61877c1c-418e-499d-a8b7-26a1927db749 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:43.838838 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdfaffb-a130-4236-8704-3f437e3ed76b admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:43.846397 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0dff9-b04c-482f-88e5-5e649fbf3d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:43.847192 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0dff9-b04c-482f-88e5-5e649fbf3d35 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:43.847582 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0dff9-b04c-482f-88e5-5e649fbf3d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:43.848247 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0dff9-b04c-482f-88e5-5e649fbf3d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:43.848815 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de0dff9-b04c-482f-88e5-5e649fbf3d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:43.850559 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de0dff9-b04c-482f-88e5-5e649fbf3d35 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:43.866813 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1235/2474] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:15:43.867997 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0dff9-b04c-482f-88e5-5e649fbf3d35 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:43.878765 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0dff9-b04c-482f-88e5-5e649fbf3d35 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:43.884067 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e13b51-ac6d-4544-a031-0e7552faec29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:43.884942 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e13b51-ac6d-4544-a031-0e7552faec29 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:43.885226 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e13b51-ac6d-4544-a031-0e7552faec29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:43.885633 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e13b51-ac6d-4544-a031-0e7552faec29 admin admin] PATH_INFO: `/v3/projects/358b7c3d8361478189278726d511ee2f/users/76ee3f7c7fd4465388f100a473905af5/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:43.887177 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-61877c1c-418e-499d-a8b7-26a1927db749 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd78a9f8d6fa54845a68972977d13109b'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:43.887779 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-61877c1c-418e-499d-a8b7-26a1927db749 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd78a9f8d6fa54845a68972977d13109b'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:43.896780 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-61877c1c-418e-499d-a8b7-26a1927db749 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd78a9f8d6fa54845a68972977d13109b'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:43.905842 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e13b51-ac6d-4544-a031-0e7552faec29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=358b7c3d8361478189278726d511ee2f, user_id=76ee3f7c7fd4465388f100a473905af5, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:43.909697 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e13b51-ac6d-4544-a031-0e7552faec29 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:43.910806 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-61877c1c-418e-499d-a8b7-26a1927db749 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd78a9f8d6fa54845a68972977d13109b'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:43.911618 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-61877c1c-418e-499d-a8b7-26a1927db749 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd78a9f8d6fa54845a68972977d13109b'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:43.924693 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1236/2475] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:15:43 2022] PUT /identity/v3/projects/358b7c3d8361478189278726d511ee2f/users/76ee3f7c7fd4465388f100a473905af5/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:43.925926 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1240/2476] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:15:43 2022] DELETE /identity/v3/users/d78a9f8d6fa54845a68972977d13109b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:43.928657 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e13b51-ac6d-4544-a031-0e7552faec29 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:43.930475 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-b1e13b51-ac6d-4544-a031-0e7552faec29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:43.999987 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e13b51-ac6d-4544-a031-0e7552faec29 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:44.052879 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f08904-4d85-4883-941a-15834261ac33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:44.053546 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f08904-4d85-4883-941a-15834261ac33 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:44.053827 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f08904-4d85-4883-941a-15834261ac33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:44.054101 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f08904-4d85-4883-941a-15834261ac33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:44.054849 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f08904-4d85-4883-941a-15834261ac33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:44.056472 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f08904-4d85-4883-941a-15834261ac33 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:44.066316 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1237/2477] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:15:44.070619 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61877c1c-418e-499d-a8b7-26a1927db749 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:44.081296 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61877c1c-418e-499d-a8b7-26a1927db749 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:44.085866 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06a6f2-a316-4a38-9bda-85d23e6e5f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:44.086754 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06a6f2-a316-4a38-9bda-85d23e6e5f91 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:44.087593 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06a6f2-a316-4a38-9bda-85d23e6e5f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:44.087906 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06a6f2-a316-4a38-9bda-85d23e6e5f91 admin admin] PATH_INFO: `/v3/projects/358b7c3d8361478189278726d511ee2f/users/76ee3f7c7fd4465388f100a473905af5/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:44.090023 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06a6f2-a316-4a38-9bda-85d23e6e5f91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=358b7c3d8361478189278726d511ee2f, user_id=76ee3f7c7fd4465388f100a473905af5, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:44.092811 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06a6f2-a316-4a38-9bda-85d23e6e5f91 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:44.103994 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1241/2478] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:15:44 2022] PUT /identity/v3/projects/358b7c3d8361478189278726d511ee2f/users/76ee3f7c7fd4465388f100a473905af5/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:44.116702 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06a6f2-a316-4a38-9bda-85d23e6e5f91 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:44.117061 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6026c4-d30b-4079-9fa7-2a1b0e64237a None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:44.117355 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6026c4-d30b-4079-9fa7-2a1b0e64237a None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:44.118008 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6026c4-d30b-4079-9fa7-2a1b0e64237a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:44.118726 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-0a06a6f2-a316-4a38-9bda-85d23e6e5f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:44.147632 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-7f6026c4-d30b-4079-9fa7-2a1b0e64237a None None] MFA Rules not processed for user `76ee3f7c7fd4465388f100a473905af5`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:44.149133 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-7f6026c4-d30b-4079-9fa7-2a1b0e64237a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:44.192084 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06a6f2-a316-4a38-9bda-85d23e6e5f91 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:44.197612 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a3da9-c4e8-4589-9de5-bc4669cbbd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:44.198464 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a3da9-c4e8-4589-9de5-bc4669cbbd83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:44.198743 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a3da9-c4e8-4589-9de5-bc4669cbbd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:44.199018 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a3da9-c4e8-4589-9de5-bc4669cbbd83 admin admin] PATH_INFO: `/v3/projects/4bb4fe0c9d6643ce886b4e3582a4c816` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:44.200411 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a3da9-c4e8-4589-9de5-bc4669cbbd83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bb4fe0c9d6643ce886b4e3582a4c816)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:44.202326 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a3da9-c4e8-4589-9de5-bc4669cbbd83 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:44.217563 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1238/2479] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:44 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:15:44.228983 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6026c4-d30b-4079-9fa7-2a1b0e64237a None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:44.230538 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-7f6026c4-d30b-4079-9fa7-2a1b0e64237a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:44.249359 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-1f8a3da9-c4e8-4589-9de5-bc4669cbbd83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bb4fe0c9d6643ce886b4e3582a4c816', 'request_id': 'req-1f8a3da9-c4e8-4589-9de5-bc4669cbbd83'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:44.254718 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-1f8a3da9-c4e8-4589-9de5-bc4669cbbd83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bb4fe0c9d6643ce886b4e3582a4c816', 'request_id': 'req-1f8a3da9-c4e8-4589-9de5-bc4669cbbd83'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:44.261166 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-1f8a3da9-c4e8-4589-9de5-bc4669cbbd83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bb4fe0c9d6643ce886b4e3582a4c816', 'request_id': 'req-1f8a3da9-c4e8-4589-9de5-bc4669cbbd83'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:44.275931 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-1f8a3da9-c4e8-4589-9de5-bc4669cbbd83 admin admin] The token cache is being invalidate because project 4bb4fe0c9d6643ce886b4e3582a4c816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:15:44.276225 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-1f8a3da9-c4e8-4589-9de5-bc4669cbbd83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:44.276862 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-1f8a3da9-c4e8-4589-9de5-bc4669cbbd83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:44.278393 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1242/2480] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:15:44 2022] DELETE /identity/v3/projects/4bb4fe0c9d6643ce886b4e3582a4c816 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:44.283067 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8bf1c-e70d-4acf-9008-09620673267b None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:44.283398 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8bf1c-e70d-4acf-9008-09620673267b None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:44.283722 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8bf1c-e70d-4acf-9008-09620673267b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:44.287030 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6026c4-d30b-4079-9fa7-2a1b0e64237a None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:44.301521 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-62d8bf1c-e70d-4acf-9008-09620673267b None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:44.302723 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-62d8bf1c-e70d-4acf-9008-09620673267b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:44.333859 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80588b97-9a52-45ed-bbca-e49269732fe4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:44.334424 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80588b97-9a52-45ed-bbca-e49269732fe4 service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:44.334706 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80588b97-9a52-45ed-bbca-e49269732fe4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:44.334980 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80588b97-9a52-45ed-bbca-e49269732fe4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:44.336764 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-80588b97-9a52-45ed-bbca-e49269732fe4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:44.360462 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1243/2481] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:15:44.368410 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe2e1e-0196-412f-94c3-dc20facec92d None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:44.368701 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe2e1e-0196-412f-94c3-dc20facec92d None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:44.368971 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe2e1e-0196-412f-94c3-dc20facec92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:44.386989 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-52fe2e1e-0196-412f-94c3-dc20facec92d None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:44.388212 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-52fe2e1e-0196-412f-94c3-dc20facec92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:44.395986 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1244/2482] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:15:44.396331 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80588b97-9a52-45ed-bbca-e49269732fe4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:44.397756 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80588b97-9a52-45ed-bbca-e49269732fe4 service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:44.400826 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe2e1e-0196-412f-94c3-dc20facec92d None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:44.407767 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1239/2483] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:15:44 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:15:44.409586 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe2e1e-0196-412f-94c3-dc20facec92d None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:44.414218 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b25e7-a53f-4433-aa24-8cbd8834779e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:44.414856 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b25e7-a53f-4433-aa24-8cbd8834779e admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:44.415177 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b25e7-a53f-4433-aa24-8cbd8834779e admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:44.415458 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b25e7-a53f-4433-aa24-8cbd8834779e admin admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:44.416217 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b25e7-a53f-4433-aa24-8cbd8834779e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:15:44.416532 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b25e7-a53f-4433-aa24-8cbd8834779e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:44.418110 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b25e7-a53f-4433-aa24-8cbd8834779e admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:44.430180 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1245/2484] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:15:44.435037 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80588b97-9a52-45ed-bbca-e49269732fe4 service cinder] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:44.449325 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80588b97-9a52-45ed-bbca-e49269732fe4 service cinder] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:44.454062 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867dd7e-21f0-4638-b257-0b857480758a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:44.454739 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867dd7e-21f0-4638-b257-0b857480758a admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:44.455019 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867dd7e-21f0-4638-b257-0b857480758a admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:44.455296 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867dd7e-21f0-4638-b257-0b857480758a admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:44.456026 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a867dd7e-21f0-4638-b257-0b857480758a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:44.457932 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a867dd7e-21f0-4638-b257-0b857480758a admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:44.483757 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b25e7-a53f-4433-aa24-8cbd8834779e admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:44.484071 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1240/2485] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:15:44 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:15:44.488016 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867dd7e-21f0-4638-b257-0b857480758a admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:44.488664 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-4e3b25e7-a53f-4433-aa24-8cbd8834779e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:44.500857 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b25e7-a53f-4433-aa24-8cbd8834779e admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:44.545974 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867dd7e-21f0-4638-b257-0b857480758a admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:44.548157 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266ae0a-b271-42e8-ae6e-fae5170a469f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:44.548889 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266ae0a-b271-42e8-ae6e-fae5170a469f service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:44.549174 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266ae0a-b271-42e8-ae6e-fae5170a469f service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:44.549451 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266ae0a-b271-42e8-ae6e-fae5170a469f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:44.550754 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eac429-5233-4198-93a7-70bc180b53a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:44.551198 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-6266ae0a-b271-42e8-ae6e-fae5170a469f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:44.551442 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eac429-5233-4198-93a7-70bc180b53a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:44.551794 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eac429-5233-4198-93a7-70bc180b53a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:44.552075 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eac429-5233-4198-93a7-70bc180b53a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:44.552753 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eac429-5233-4198-93a7-70bc180b53a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:44.554770 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eac429-5233-4198-93a7-70bc180b53a5 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:44.575063 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1241/2486] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:15:44 2022] POST /identity/v3/users => generated 288 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:15:44.579326 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eac429-5233-4198-93a7-70bc180b53a5 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:44.588758 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eac429-5233-4198-93a7-70bc180b53a5 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:44.593213 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dadbf8-e845-49ea-b02e-0d7848036240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:44.593849 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dadbf8-e845-49ea-b02e-0d7848036240 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:44.594132 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dadbf8-e845-49ea-b02e-0d7848036240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:44.594409 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dadbf8-e845-49ea-b02e-0d7848036240 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:44.595127 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dadbf8-e845-49ea-b02e-0d7848036240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:44.596720 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dadbf8-e845-49ea-b02e-0d7848036240 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:44.606322 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1242/2487] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:15:44.610286 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dadbf8-e845-49ea-b02e-0d7848036240 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:44.611006 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266ae0a-b271-42e8-ae6e-fae5170a469f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:44.612481 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266ae0a-b271-42e8-ae6e-fae5170a469f service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:44.620231 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dadbf8-e845-49ea-b02e-0d7848036240 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:44.621813 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1246/2488] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:15:44 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:15:44.624817 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c6f04-7f83-426a-a232-8f09b36461f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:44.625458 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c6f04-7f83-426a-a232-8f09b36461f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:44.625741 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c6f04-7f83-426a-a232-8f09b36461f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:44.626020 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c6f04-7f83-426a-a232-8f09b36461f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:44.626799 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c6f04-7f83-426a-a232-8f09b36461f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:44.628331 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c6f04-7f83-426a-a232-8f09b36461f7 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:44.639866 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1243/2489] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:15:44.643919 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266ae0a-b271-42e8-ae6e-fae5170a469f service cinder] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:44.654218 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266ae0a-b271-42e8-ae6e-fae5170a469f service cinder] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:44.659938 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffde7d6-f2e3-4f0f-8539-85fdbf069cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:44.660929 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffde7d6-f2e3-4f0f-8539-85fdbf069cec admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:44.661250 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffde7d6-f2e3-4f0f-8539-85fdbf069cec admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:44.661567 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffde7d6-f2e3-4f0f-8539-85fdbf069cec admin admin] PATH_INFO: `/v3/projects/f842cd4030304a7f824cd9420e8773d9/users/c45ebd53dbe246fb90f11d117f070baa/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:44.677155 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffde7d6-f2e3-4f0f-8539-85fdbf069cec admin admin] RBAC: Authorizing `identity:create_grant(project_id=f842cd4030304a7f824cd9420e8773d9, user_id=c45ebd53dbe246fb90f11d117f070baa, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:44.680126 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffde7d6-f2e3-4f0f-8539-85fdbf069cec admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:44.693963 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1247/2490] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:15:44 2022] PUT /identity/v3/projects/f842cd4030304a7f824cd9420e8773d9/users/c45ebd53dbe246fb90f11d117f070baa/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:44.705812 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47eed68-308b-44ec-99da-370d461a154d None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:44.706101 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47eed68-308b-44ec-99da-370d461a154d None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:44.706373 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47eed68-308b-44ec-99da-370d461a154d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:44.738952 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-c47eed68-308b-44ec-99da-370d461a154d None None] MFA Rules not processed for user `c45ebd53dbe246fb90f11d117f070baa`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:44.740350 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-c47eed68-308b-44ec-99da-370d461a154d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:44.806848 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1244/2491] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:15:44.818446 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffde7d6-f2e3-4f0f-8539-85fdbf069cec admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:44.820182 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-cffde7d6-f2e3-4f0f-8539-85fdbf069cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:44.889467 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffde7d6-f2e3-4f0f-8539-85fdbf069cec admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:44.894929 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb089ea-5195-498b-af15-c42973f55fe8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:44.895558 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb089ea-5195-498b-af15-c42973f55fe8 service nova] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:44.895872 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb089ea-5195-498b-af15-c42973f55fe8 service nova] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:44.896153 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb089ea-5195-498b-af15-c42973f55fe8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:44.903671 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb089ea-5195-498b-af15-c42973f55fe8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:44.905271 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb089ea-5195-498b-af15-c42973f55fe8 service nova] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:44.913828 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1248/2492] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:15:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:15:45.098274 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47eed68-308b-44ec-99da-370d461a154d None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:45.157923 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47eed68-308b-44ec-99da-370d461a154d None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:45.162375 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2d73b-1223-4ab3-b334-bddd8ad40782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:45.163230 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2d73b-1223-4ab3-b334-bddd8ad40782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:45.163512 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2d73b-1223-4ab3-b334-bddd8ad40782 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:45.163816 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2d73b-1223-4ab3-b334-bddd8ad40782 admin admin] PATH_INFO: `/v3/users/c45ebd53dbe246fb90f11d117f070baa` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:45.165574 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2d73b-1223-4ab3-b334-bddd8ad40782 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c45ebd53dbe246fb90f11d117f070baa)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:45.167449 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2d73b-1223-4ab3-b334-bddd8ad40782 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:45.208570 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-76a2d73b-1223-4ab3-b334-bddd8ad40782 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c45ebd53dbe246fb90f11d117f070baa'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:45.215446 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-76a2d73b-1223-4ab3-b334-bddd8ad40782 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c45ebd53dbe246fb90f11d117f070baa'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:45.222186 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-76a2d73b-1223-4ab3-b334-bddd8ad40782 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c45ebd53dbe246fb90f11d117f070baa'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:45.233796 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-76a2d73b-1223-4ab3-b334-bddd8ad40782 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c45ebd53dbe246fb90f11d117f070baa'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:45.234440 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-76a2d73b-1223-4ab3-b334-bddd8ad40782 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c45ebd53dbe246fb90f11d117f070baa'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:45.240405 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1245/2493] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:15:45 2022] DELETE /identity/v3/users/c45ebd53dbe246fb90f11d117f070baa => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:45.244613 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8ccc7-63cb-4643-bd4c-055420826bbc None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:45.244907 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8ccc7-63cb-4643-bd4c-055420826bbc None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:45.245206 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8ccc7-63cb-4643-bd4c-055420826bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:45.261957 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-2fe8ccc7-63cb-4643-bd4c-055420826bbc None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:45.263154 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-2fe8ccc7-63cb-4643-bd4c-055420826bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:45.319400 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1249/2494] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:15:45.328900 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2d73b-1223-4ab3-b334-bddd8ad40782 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:45.330266 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-76a2d73b-1223-4ab3-b334-bddd8ad40782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:45.384248 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2d73b-1223-4ab3-b334-bddd8ad40782 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:45.387859 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5295e57-1085-4b85-bf8b-e435713cbad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:45.388485 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5295e57-1085-4b85-bf8b-e435713cbad7 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:45.388764 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5295e57-1085-4b85-bf8b-e435713cbad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:45.389034 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5295e57-1085-4b85-bf8b-e435713cbad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:45.397644 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5295e57-1085-4b85-bf8b-e435713cbad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:45.399043 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5295e57-1085-4b85-bf8b-e435713cbad7 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:45.408758 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1246/2495] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:15:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:15:45.663598 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8ccc7-63cb-4643-bd4c-055420826bbc None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:45.665067 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-2fe8ccc7-63cb-4643-bd4c-055420826bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:45.676754 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8ccc7-63cb-4643-bd4c-055420826bbc None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:45.681693 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58367d8a-cabc-460c-afed-a6165190a1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:45.682596 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58367d8a-cabc-460c-afed-a6165190a1a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:45.682888 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58367d8a-cabc-460c-afed-a6165190a1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:45.683168 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58367d8a-cabc-460c-afed-a6165190a1a9 admin admin] PATH_INFO: `/v3/projects/f842cd4030304a7f824cd9420e8773d9` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:45.684371 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58367d8a-cabc-460c-afed-a6165190a1a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f842cd4030304a7f824cd9420e8773d9)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:45.686287 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58367d8a-cabc-460c-afed-a6165190a1a9 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:45.732927 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-58367d8a-cabc-460c-afed-a6165190a1a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f842cd4030304a7f824cd9420e8773d9', 'request_id': 'req-58367d8a-cabc-460c-afed-a6165190a1a9'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:45.738087 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-58367d8a-cabc-460c-afed-a6165190a1a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f842cd4030304a7f824cd9420e8773d9', 'request_id': 'req-58367d8a-cabc-460c-afed-a6165190a1a9'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:45.743976 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-58367d8a-cabc-460c-afed-a6165190a1a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f842cd4030304a7f824cd9420e8773d9', 'request_id': 'req-58367d8a-cabc-460c-afed-a6165190a1a9'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:45.758268 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-58367d8a-cabc-460c-afed-a6165190a1a9 admin admin] The token cache is being invalidate because project f842cd4030304a7f824cd9420e8773d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:15:45.758560 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-58367d8a-cabc-460c-afed-a6165190a1a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:45.759672 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-58367d8a-cabc-460c-afed-a6165190a1a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:45.761227 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1250/2496] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:15:45 2022] DELETE /identity/v3/projects/f842cd4030304a7f824cd9420e8773d9 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:45.766248 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3593dd2-0fcc-4578-bce8-2d6ca0c7de4d None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:45.766539 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3593dd2-0fcc-4578-bce8-2d6ca0c7de4d None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:45.766827 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3593dd2-0fcc-4578-bce8-2d6ca0c7de4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:45.788439 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-b3593dd2-0fcc-4578-bce8-2d6ca0c7de4d None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:45.789407 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-b3593dd2-0fcc-4578-bce8-2d6ca0c7de4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:45.849967 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1247/2497] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:15:45.858133 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b143f-aa2d-417b-836b-61833943bf10 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:45.858441 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b143f-aa2d-417b-836b-61833943bf10 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:45.858719 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b143f-aa2d-417b-836b-61833943bf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:45.876306 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-a20b143f-aa2d-417b-836b-61833943bf10 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:45.877506 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-a20b143f-aa2d-417b-836b-61833943bf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:45.885724 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1251/2498] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:15:45.889976 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3593dd2-0fcc-4578-bce8-2d6ca0c7de4d None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:45.899153 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3593dd2-0fcc-4578-bce8-2d6ca0c7de4d None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:45.905036 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7da39-3cb3-477b-a136-a49ad908888d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:45.905691 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7da39-3cb3-477b-a136-a49ad908888d admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:45.905968 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7da39-3cb3-477b-a136-a49ad908888d admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:45.906238 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7da39-3cb3-477b-a136-a49ad908888d admin admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:45.907060 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7da39-3cb3-477b-a136-a49ad908888d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:15:45.907362 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7da39-3cb3-477b-a136-a49ad908888d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:45.909061 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7da39-3cb3-477b-a136-a49ad908888d admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:45.920488 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1248/2499] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:15:45.925403 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b143f-aa2d-417b-836b-61833943bf10 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:45.935674 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b143f-aa2d-417b-836b-61833943bf10 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:45.942067 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0009b4-4995-4a0e-bbd5-0eeed9d5927c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:45.942764 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0009b4-4995-4a0e-bbd5-0eeed9d5927c admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:45.943083 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0009b4-4995-4a0e-bbd5-0eeed9d5927c admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:45.943367 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0009b4-4995-4a0e-bbd5-0eeed9d5927c admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:45.944097 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0009b4-4995-4a0e-bbd5-0eeed9d5927c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:45.945992 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0009b4-4995-4a0e-bbd5-0eeed9d5927c admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:45.972854 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1252/2500] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:15:45 2022] POST /identity/v3/projects => generated 361 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:15:45.976983 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7da39-3cb3-477b-a136-a49ad908888d admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:45.986649 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7da39-3cb3-477b-a136-a49ad908888d admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:46.046060 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba070c-bb40-4220-a175-1943a788439c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:46.046956 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba070c-bb40-4220-a175-1943a788439c admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:46.047247 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba070c-bb40-4220-a175-1943a788439c admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:46.047526 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba070c-bb40-4220-a175-1943a788439c admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:46.048306 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba070c-bb40-4220-a175-1943a788439c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:46.050219 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba070c-bb40-4220-a175-1943a788439c admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:46.076896 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1249/2501] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:15:45 2022] POST /identity/v3/users => generated 281 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:15:46.078489 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0009b4-4995-4a0e-bbd5-0eeed9d5927c admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:46.091030 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0009b4-4995-4a0e-bbd5-0eeed9d5927c admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:46.096405 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ec176-94c1-4748-aef2-72b8ea93f7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:46.097152 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ec176-94c1-4748-aef2-72b8ea93f7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:46.097507 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ec176-94c1-4748-aef2-72b8ea93f7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:46.097768 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ec176-94c1-4748-aef2-72b8ea93f7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:46.098602 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ec176-94c1-4748-aef2-72b8ea93f7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:46.100267 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ec176-94c1-4748-aef2-72b8ea93f7b7 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:46.118881 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1253/2502] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:15:46.120378 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba070c-bb40-4220-a175-1943a788439c admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:46.131122 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba070c-bb40-4220-a175-1943a788439c admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:46.136548 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932f247-9a1b-44c5-a0a0-5640325953e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:46.137200 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932f247-9a1b-44c5-a0a0-5640325953e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:46.137485 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932f247-9a1b-44c5-a0a0-5640325953e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:46.137763 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932f247-9a1b-44c5-a0a0-5640325953e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:46.138516 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932f247-9a1b-44c5-a0a0-5640325953e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:46.140136 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932f247-9a1b-44c5-a0a0-5640325953e9 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:46.150259 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1250/2503] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:15:46.154814 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ec176-94c1-4748-aef2-72b8ea93f7b7 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:46.164972 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ec176-94c1-4748-aef2-72b8ea93f7b7 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:46.169647 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ab84b-3eff-4fd0-b3d5-1660bae39476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:46.170520 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ab84b-3eff-4fd0-b3d5-1660bae39476 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:46.170803 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ab84b-3eff-4fd0-b3d5-1660bae39476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:46.171105 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ab84b-3eff-4fd0-b3d5-1660bae39476 admin admin] PATH_INFO: `/v3/projects/d1c231d9882243ceb87efad9b97a72f1/users/0a19e999cbea45569619cf0b4d42a1b5/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:46.185641 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ab84b-3eff-4fd0-b3d5-1660bae39476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1c231d9882243ceb87efad9b97a72f1, user_id=0a19e999cbea45569619cf0b4d42a1b5, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:46.188819 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ab84b-3eff-4fd0-b3d5-1660bae39476 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:46.203979 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1254/2504] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:15:46 2022] PUT /identity/v3/projects/d1c231d9882243ceb87efad9b97a72f1/users/0a19e999cbea45569619cf0b4d42a1b5/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:15:46.214937 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a3320-b94b-4384-bb10-1989e1c3931f None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:46.215229 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a3320-b94b-4384-bb10-1989e1c3931f None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:46.215534 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a3320-b94b-4384-bb10-1989e1c3931f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:46.240973 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-5e9a3320-b94b-4384-bb10-1989e1c3931f None None] MFA Rules not processed for user `0a19e999cbea45569619cf0b4d42a1b5`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:46.242176 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-5e9a3320-b94b-4384-bb10-1989e1c3931f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:46.303624 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1251/2505] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:15:46.308691 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ab84b-3eff-4fd0-b3d5-1660bae39476 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:46.369502 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ab84b-3eff-4fd0-b3d5-1660bae39476 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:46.374101 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6eba95-2b4e-4271-9239-d503a78129d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:46.374741 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6eba95-2b4e-4271-9239-d503a78129d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:46.375020 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6eba95-2b4e-4271-9239-d503a78129d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:46.375291 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6eba95-2b4e-4271-9239-d503a78129d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:46.376010 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6eba95-2b4e-4271-9239-d503a78129d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:46.377898 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6eba95-2b4e-4271-9239-d503a78129d0 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:46.401493 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1255/2506] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:15:46 2022] POST /identity/v3/projects => generated 363 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:15:46.405512 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a3320-b94b-4384-bb10-1989e1c3931f None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:46.416482 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a3320-b94b-4384-bb10-1989e1c3931f None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:46.468103 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c65c3b-c751-4552-a41d-e3426631faf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:46.468752 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c65c3b-c751-4552-a41d-e3426631faf1 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:46.469032 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c65c3b-c751-4552-a41d-e3426631faf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:46.469303 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c65c3b-c751-4552-a41d-e3426631faf1 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:46.469984 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c65c3b-c751-4552-a41d-e3426631faf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:46.471892 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c65c3b-c751-4552-a41d-e3426631faf1 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:46.491155 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1252/2507] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:15:46 2022] POST /identity/v3/users => generated 288 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:15:46.495667 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6eba95-2b4e-4271-9239-d503a78129d0 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:46.505706 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6eba95-2b4e-4271-9239-d503a78129d0 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:46.510388 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350fd20-402e-4bc5-936f-06f7133a266c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:46.511011 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350fd20-402e-4bc5-936f-06f7133a266c admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:46.511294 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350fd20-402e-4bc5-936f-06f7133a266c admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:46.511576 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350fd20-402e-4bc5-936f-06f7133a266c admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:46.512332 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350fd20-402e-4bc5-936f-06f7133a266c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:46.513915 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350fd20-402e-4bc5-936f-06f7133a266c admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:46.524112 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1256/2508] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:15:46.528049 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c65c3b-c751-4552-a41d-e3426631faf1 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:46.537815 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c65c3b-c751-4552-a41d-e3426631faf1 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:46.543009 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3f7b9-c624-4a43-baa6-62a1520503ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:46.543910 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3f7b9-c624-4a43-baa6-62a1520503ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:46.544221 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3f7b9-c624-4a43-baa6-62a1520503ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:46.544490 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3f7b9-c624-4a43-baa6-62a1520503ed admin admin] PATH_INFO: `/v3/projects/42b104245e4647d6b498115ef8b75514/users/b3be21e9872d4917b6631872bc20d8f3/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:46.558950 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf3f7b9-c624-4a43-baa6-62a1520503ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=42b104245e4647d6b498115ef8b75514, user_id=b3be21e9872d4917b6631872bc20d8f3, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:46.561585 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf3f7b9-c624-4a43-baa6-62a1520503ed admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:46.574150 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1253/2509] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:15:46 2022] PUT /identity/v3/projects/42b104245e4647d6b498115ef8b75514/users/b3be21e9872d4917b6631872bc20d8f3/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:46.577953 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350fd20-402e-4bc5-936f-06f7133a266c admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:46.587776 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350fd20-402e-4bc5-936f-06f7133a266c admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:46.642065 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f72f0-9163-48b2-b582-5b3a3b97bd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:46.642727 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f72f0-9163-48b2-b582-5b3a3b97bd8a admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:46.643009 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f72f0-9163-48b2-b582-5b3a3b97bd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:46.643286 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f72f0-9163-48b2-b582-5b3a3b97bd8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:46.644034 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f72f0-9163-48b2-b582-5b3a3b97bd8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:46.645620 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f72f0-9163-48b2-b582-5b3a3b97bd8a admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:46.655535 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1257/2510] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:15:46.659988 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3f7b9-c624-4a43-baa6-62a1520503ed admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:46.670825 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3f7b9-c624-4a43-baa6-62a1520503ed admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:46.675304 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948681f1-8475-491d-9d79-5b34cc9133a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:46.676218 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948681f1-8475-491d-9d79-5b34cc9133a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:46.676501 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948681f1-8475-491d-9d79-5b34cc9133a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:46.676775 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948681f1-8475-491d-9d79-5b34cc9133a9 admin admin] PATH_INFO: `/v3/projects/42b104245e4647d6b498115ef8b75514/users/b3be21e9872d4917b6631872bc20d8f3/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:46.678733 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948681f1-8475-491d-9d79-5b34cc9133a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42b104245e4647d6b498115ef8b75514, user_id=b3be21e9872d4917b6631872bc20d8f3, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:46.681427 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948681f1-8475-491d-9d79-5b34cc9133a9 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:46.691489 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1254/2511] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:15:46 2022] PUT /identity/v3/projects/42b104245e4647d6b498115ef8b75514/users/b3be21e9872d4917b6631872bc20d8f3/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:46.702583 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7482de-c4a0-43b0-bd50-967701c79941 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:46.703038 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7482de-c4a0-43b0-bd50-967701c79941 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:46.703144 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7482de-c4a0-43b0-bd50-967701c79941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:46.731790 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-3a7482de-c4a0-43b0-bd50-967701c79941 None None] MFA Rules not processed for user `b3be21e9872d4917b6631872bc20d8f3`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:46.732998 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-3a7482de-c4a0-43b0-bd50-967701c79941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:46.797201 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1258/2512] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:46 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:15:46.808631 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948681f1-8475-491d-9d79-5b34cc9133a9 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:46.810283 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-948681f1-8475-491d-9d79-5b34cc9133a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:46.864312 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948681f1-8475-491d-9d79-5b34cc9133a9 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:46.868059 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc6896-7936-44b5-9b15-6a47ba3e98b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:46.868684 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc6896-7936-44b5-9b15-6a47ba3e98b0 service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:46.868964 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc6896-7936-44b5-9b15-6a47ba3e98b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:46.869261 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc6896-7936-44b5-9b15-6a47ba3e98b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:46.878016 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc6896-7936-44b5-9b15-6a47ba3e98b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:46.879416 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc6896-7936-44b5-9b15-6a47ba3e98b0 service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:46.888358 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1255/2513] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:15:46 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:15:47.047359 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7482de-c4a0-43b0-bd50-967701c79941 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:47.107855 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7482de-c4a0-43b0-bd50-967701c79941 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:47.113072 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec95307-a3f0-4a4e-b15a-9ab5ad904d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:47.113941 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec95307-a3f0-4a4e-b15a-9ab5ad904d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:47.114222 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec95307-a3f0-4a4e-b15a-9ab5ad904d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:47.114494 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec95307-a3f0-4a4e-b15a-9ab5ad904d52 admin admin] PATH_INFO: `/v3/users/0a19e999cbea45569619cf0b4d42a1b5` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:47.115672 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec95307-a3f0-4a4e-b15a-9ab5ad904d52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a19e999cbea45569619cf0b4d42a1b5)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:47.117606 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec95307-a3f0-4a4e-b15a-9ab5ad904d52 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:47.165597 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-dec95307-a3f0-4a4e-b15a-9ab5ad904d52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a19e999cbea45569619cf0b4d42a1b5'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:47.166265 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-dec95307-a3f0-4a4e-b15a-9ab5ad904d52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a19e999cbea45569619cf0b4d42a1b5'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:47.173011 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-dec95307-a3f0-4a4e-b15a-9ab5ad904d52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a19e999cbea45569619cf0b4d42a1b5'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:47.184927 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-dec95307-a3f0-4a4e-b15a-9ab5ad904d52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a19e999cbea45569619cf0b4d42a1b5'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:47.185605 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-dec95307-a3f0-4a4e-b15a-9ab5ad904d52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a19e999cbea45569619cf0b4d42a1b5'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:47.200782 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1259/2514] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:15:47 2022] DELETE /identity/v3/users/0a19e999cbea45569619cf0b4d42a1b5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:47.205196 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e64446-cf29-488b-89b9-b1fa9675eece None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:47.205694 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e64446-cf29-488b-89b9-b1fa9675eece None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:47.205802 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e64446-cf29-488b-89b9-b1fa9675eece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:47.224223 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-e8e64446-cf29-488b-89b9-b1fa9675eece None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:47.225486 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-e8e64446-cf29-488b-89b9-b1fa9675eece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:47.284065 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1256/2515] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:15:47.294467 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec95307-a3f0-4a4e-b15a-9ab5ad904d52 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:47.296003 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-dec95307-a3f0-4a4e-b15a-9ab5ad904d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:47.357070 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec95307-a3f0-4a4e-b15a-9ab5ad904d52 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:47.360678 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74d9d4-74d5-4d5b-82be-b038879b007a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:47.361314 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74d9d4-74d5-4d5b-82be-b038879b007a service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:47.361596 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74d9d4-74d5-4d5b-82be-b038879b007a service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:47.361871 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74d9d4-74d5-4d5b-82be-b038879b007a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:47.370611 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74d9d4-74d5-4d5b-82be-b038879b007a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:47.372063 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74d9d4-74d5-4d5b-82be-b038879b007a service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:47.381789 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1260/2516] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:15:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:15:47.656142 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e64446-cf29-488b-89b9-b1fa9675eece None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:47.657872 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-e8e64446-cf29-488b-89b9-b1fa9675eece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:47.672464 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e64446-cf29-488b-89b9-b1fa9675eece None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:47.678257 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e96e8-0424-4763-8384-ff608191cbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:47.679126 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e96e8-0424-4763-8384-ff608191cbfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:47.679405 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e96e8-0424-4763-8384-ff608191cbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:47.680110 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e96e8-0424-4763-8384-ff608191cbfc admin admin] PATH_INFO: `/v3/projects/d1c231d9882243ceb87efad9b97a72f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:47.681490 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e96e8-0424-4763-8384-ff608191cbfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1c231d9882243ceb87efad9b97a72f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:47.683388 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e96e8-0424-4763-8384-ff608191cbfc admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:47.735385 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-d94e96e8-0424-4763-8384-ff608191cbfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1c231d9882243ceb87efad9b97a72f1', 'request_id': 'req-d94e96e8-0424-4763-8384-ff608191cbfc'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:47.740570 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-d94e96e8-0424-4763-8384-ff608191cbfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1c231d9882243ceb87efad9b97a72f1', 'request_id': 'req-d94e96e8-0424-4763-8384-ff608191cbfc'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:47.746986 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-d94e96e8-0424-4763-8384-ff608191cbfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1c231d9882243ceb87efad9b97a72f1', 'request_id': 'req-d94e96e8-0424-4763-8384-ff608191cbfc'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:47.758390 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-d94e96e8-0424-4763-8384-ff608191cbfc admin admin] The token cache is being invalidate because project d1c231d9882243ceb87efad9b97a72f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:15:47.759321 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-d94e96e8-0424-4763-8384-ff608191cbfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:47.759968 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-d94e96e8-0424-4763-8384-ff608191cbfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:47.761495 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1257/2517] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:15:47 2022] DELETE /identity/v3/projects/d1c231d9882243ceb87efad9b97a72f1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:47.765401 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74d9d4-74d5-4d5b-82be-b038879b007a service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:47.774824 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74d9d4-74d5-4d5b-82be-b038879b007a service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:47.828918 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492ed20-d531-4a27-ab31-22f12b0a4ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:47.829786 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492ed20-d531-4a27-ab31-22f12b0a4ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:47.830070 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492ed20-d531-4a27-ab31-22f12b0a4ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:47.830350 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492ed20-d531-4a27-ab31-22f12b0a4ce5 admin admin] PATH_INFO: `/v3/users/b3be21e9872d4917b6631872bc20d8f3` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:47.831514 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492ed20-d531-4a27-ab31-22f12b0a4ce5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3be21e9872d4917b6631872bc20d8f3)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:47.833459 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492ed20-d531-4a27-ab31-22f12b0a4ce5 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:47.882255 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-d492ed20-d531-4a27-ab31-22f12b0a4ce5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3be21e9872d4917b6631872bc20d8f3'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:47.882939 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-d492ed20-d531-4a27-ab31-22f12b0a4ce5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3be21e9872d4917b6631872bc20d8f3'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:47.889604 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-d492ed20-d531-4a27-ab31-22f12b0a4ce5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3be21e9872d4917b6631872bc20d8f3'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:47.900881 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-d492ed20-d531-4a27-ab31-22f12b0a4ce5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3be21e9872d4917b6631872bc20d8f3'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:47.901509 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-d492ed20-d531-4a27-ab31-22f12b0a4ce5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3be21e9872d4917b6631872bc20d8f3'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:47.913789 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1261/2518] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:15:47 2022] DELETE /identity/v3/users/b3be21e9872d4917b6631872bc20d8f3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:48.171240 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e96e8-0424-4763-8384-ff608191cbfc admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:48.172993 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-d94e96e8-0424-4763-8384-ff608191cbfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:48.187924 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e96e8-0424-4763-8384-ff608191cbfc admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:48.243167 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0738004-2e79-4c38-823e-b3dd5c322825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:48.244060 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0738004-2e79-4c38-823e-b3dd5c322825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:48.244340 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0738004-2e79-4c38-823e-b3dd5c322825 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:48.244612 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0738004-2e79-4c38-823e-b3dd5c322825 admin admin] PATH_INFO: `/v3/projects/42b104245e4647d6b498115ef8b75514` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:48.245785 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0738004-2e79-4c38-823e-b3dd5c322825 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42b104245e4647d6b498115ef8b75514)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:48.247719 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0738004-2e79-4c38-823e-b3dd5c322825 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:48.290651 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b0738004-2e79-4c38-823e-b3dd5c322825 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42b104245e4647d6b498115ef8b75514', 'request_id': 'req-b0738004-2e79-4c38-823e-b3dd5c322825'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:48.295751 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b0738004-2e79-4c38-823e-b3dd5c322825 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42b104245e4647d6b498115ef8b75514', 'request_id': 'req-b0738004-2e79-4c38-823e-b3dd5c322825'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:48.301701 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b0738004-2e79-4c38-823e-b3dd5c322825 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42b104245e4647d6b498115ef8b75514', 'request_id': 'req-b0738004-2e79-4c38-823e-b3dd5c322825'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:48.314601 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b0738004-2e79-4c38-823e-b3dd5c322825 admin admin] The token cache is being invalidate because project 42b104245e4647d6b498115ef8b75514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:15:48.314894 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b0738004-2e79-4c38-823e-b3dd5c322825 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:48.315519 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b0738004-2e79-4c38-823e-b3dd5c322825 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:48.317128 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1258/2519] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:15:48 2022] DELETE /identity/v3/projects/42b104245e4647d6b498115ef8b75514 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:48.323360 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcce094-6c35-4b01-a5a4-6ec65e33003d None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:48.323763 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcce094-6c35-4b01-a5a4-6ec65e33003d None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:48.324170 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcce094-6c35-4b01-a5a4-6ec65e33003d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:48.343324 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-afcce094-6c35-4b01-a5a4-6ec65e33003d None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:48.344594 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-afcce094-6c35-4b01-a5a4-6ec65e33003d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:48.400835 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1262/2520] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:15:48.408529 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcb696-ee33-4d0b-a323-975dd112603d None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:48.408819 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcb696-ee33-4d0b-a323-975dd112603d None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:48.409092 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcb696-ee33-4d0b-a323-975dd112603d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:48.427858 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-e9bcb696-ee33-4d0b-a323-975dd112603d None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:48.429049 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-e9bcb696-ee33-4d0b-a323-975dd112603d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:48.436884 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1259/2521] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:15:48.441137 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcce094-6c35-4b01-a5a4-6ec65e33003d None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:48.450484 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcce094-6c35-4b01-a5a4-6ec65e33003d None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:48.455012 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da857ec-2c31-4afa-b9cf-e98bc4e73798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:48.455650 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da857ec-2c31-4afa-b9cf-e98bc4e73798 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:48.455970 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da857ec-2c31-4afa-b9cf-e98bc4e73798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:48.456254 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da857ec-2c31-4afa-b9cf-e98bc4e73798 admin admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:48.456969 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da857ec-2c31-4afa-b9cf-e98bc4e73798 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:15:48.457277 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da857ec-2c31-4afa-b9cf-e98bc4e73798 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:48.458865 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da857ec-2c31-4afa-b9cf-e98bc4e73798 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:48.470497 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1263/2522] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:15:48.474595 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcb696-ee33-4d0b-a323-975dd112603d None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:48.484282 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcb696-ee33-4d0b-a323-975dd112603d None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:48.488849 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de4235-5b08-46d4-912c-089975968ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:48.489500 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de4235-5b08-46d4-912c-089975968ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:48.489779 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de4235-5b08-46d4-912c-089975968ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:48.490053 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de4235-5b08-46d4-912c-089975968ec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:48.490730 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de4235-5b08-46d4-912c-089975968ec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:48.492635 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de4235-5b08-46d4-912c-089975968ec9 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:48.517471 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1260/2523] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:15:48 2022] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:15:48.521338 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da857ec-2c31-4afa-b9cf-e98bc4e73798 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:48.531597 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da857ec-2c31-4afa-b9cf-e98bc4e73798 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:48.585143 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abc493-05d9-4c6b-9ff6-cd6d6f187753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:48.585736 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abc493-05d9-4c6b-9ff6-cd6d6f187753 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:48.586021 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abc493-05d9-4c6b-9ff6-cd6d6f187753 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:48.586303 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abc493-05d9-4c6b-9ff6-cd6d6f187753 admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:48.587585 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90abc493-05d9-4c6b-9ff6-cd6d6f187753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:48.589584 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90abc493-05d9-4c6b-9ff6-cd6d6f187753 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:48.609208 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1264/2524] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:15:48 2022] POST /identity/v3/users => generated 285 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:15:48.613442 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de4235-5b08-46d4-912c-089975968ec9 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:48.623268 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de4235-5b08-46d4-912c-089975968ec9 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:48.628064 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91265c-be01-4875-812e-e6989e0421d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:48.628747 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91265c-be01-4875-812e-e6989e0421d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:48.629031 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91265c-be01-4875-812e-e6989e0421d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:48.629307 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91265c-be01-4875-812e-e6989e0421d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:48.630026 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91265c-be01-4875-812e-e6989e0421d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:48.631607 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91265c-be01-4875-812e-e6989e0421d7 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:48.642151 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1261/2525] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:15:48.645740 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abc493-05d9-4c6b-9ff6-cd6d6f187753 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:48.656561 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abc493-05d9-4c6b-9ff6-cd6d6f187753 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:48.661831 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc234f8-b347-4c60-8841-1bf7b77a7603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:48.662478 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc234f8-b347-4c60-8841-1bf7b77a7603 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:48.662761 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc234f8-b347-4c60-8841-1bf7b77a7603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:48.663037 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc234f8-b347-4c60-8841-1bf7b77a7603 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:48.663798 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc234f8-b347-4c60-8841-1bf7b77a7603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:48.665401 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc234f8-b347-4c60-8841-1bf7b77a7603 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:48.675521 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1265/2526] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:15:48.679445 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91265c-be01-4875-812e-e6989e0421d7 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:48.689139 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91265c-be01-4875-812e-e6989e0421d7 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:48.693654 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea9957-3d40-4ac2-a23e-cc690cf79394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:48.694510 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea9957-3d40-4ac2-a23e-cc690cf79394 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:48.694798 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea9957-3d40-4ac2-a23e-cc690cf79394 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:48.695079 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea9957-3d40-4ac2-a23e-cc690cf79394 admin admin] PATH_INFO: `/v3/projects/7be50d3037584b368fe477adba83de2e/users/5170546eb4b5405ba8e6c13b3c4dcfe8/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:48.709191 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea9957-3d40-4ac2-a23e-cc690cf79394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7be50d3037584b368fe477adba83de2e, user_id=5170546eb4b5405ba8e6c13b3c4dcfe8, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:48.712445 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea9957-3d40-4ac2-a23e-cc690cf79394 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:48.725183 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1262/2527] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:15:48 2022] PUT /identity/v3/projects/7be50d3037584b368fe477adba83de2e/users/5170546eb4b5405ba8e6c13b3c4dcfe8/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:48.735135 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe3b5b-d010-46df-94c1-8981dafabf72 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:48.735424 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe3b5b-d010-46df-94c1-8981dafabf72 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:48.735727 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe3b5b-d010-46df-94c1-8981dafabf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:48.762807 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-b0fe3b5b-d010-46df-94c1-8981dafabf72 None None] MFA Rules not processed for user `5170546eb4b5405ba8e6c13b3c4dcfe8`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:48.764303 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-b0fe3b5b-d010-46df-94c1-8981dafabf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:48.826887 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1266/2528] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:15:48.831196 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea9957-3d40-4ac2-a23e-cc690cf79394 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:48.888531 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea9957-3d40-4ac2-a23e-cc690cf79394 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:48.892988 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aced7a-067e-4fce-887b-a8802bcba082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:48.893630 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aced7a-067e-4fce-887b-a8802bcba082 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:48.893912 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aced7a-067e-4fce-887b-a8802bcba082 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:48.894214 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aced7a-067e-4fce-887b-a8802bcba082 admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:48.894898 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aced7a-067e-4fce-887b-a8802bcba082 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:48.896820 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aced7a-067e-4fce-887b-a8802bcba082 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:48.920569 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1263/2529] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:15:48 2022] POST /identity/v3/projects => generated 365 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:15:48.924531 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe3b5b-d010-46df-94c1-8981dafabf72 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:48.935785 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe3b5b-d010-46df-94c1-8981dafabf72 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:48.990180 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e0053-949a-438a-a6c6-92c1375ded94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:48.990838 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e0053-949a-438a-a6c6-92c1375ded94 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:48.991124 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e0053-949a-438a-a6c6-92c1375ded94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:48.991401 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e0053-949a-438a-a6c6-92c1375ded94 admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:48.992128 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e0053-949a-438a-a6c6-92c1375ded94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:48.994527 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e0053-949a-438a-a6c6-92c1375ded94 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:49.013852 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1267/2530] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:15:48 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:15:49.017816 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aced7a-067e-4fce-887b-a8802bcba082 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:49.027671 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aced7a-067e-4fce-887b-a8802bcba082 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:49.032271 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc10588-8a14-4a0d-8f69-329bd44623ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:49.032922 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc10588-8a14-4a0d-8f69-329bd44623ab admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:49.033209 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc10588-8a14-4a0d-8f69-329bd44623ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:49.033487 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc10588-8a14-4a0d-8f69-329bd44623ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:49.034208 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc10588-8a14-4a0d-8f69-329bd44623ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:49.036172 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc10588-8a14-4a0d-8f69-329bd44623ab admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:49.046238 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1264/2531] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:15:49.050083 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e0053-949a-438a-a6c6-92c1375ded94 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:49.060147 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e0053-949a-438a-a6c6-92c1375ded94 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:49.064865 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404483b7-24d4-420b-a8c3-f3e3cd4d684d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:49.065726 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404483b7-24d4-420b-a8c3-f3e3cd4d684d admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:49.066010 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404483b7-24d4-420b-a8c3-f3e3cd4d684d admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:49.066283 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404483b7-24d4-420b-a8c3-f3e3cd4d684d admin admin] PATH_INFO: `/v3/projects/628f497315ea484fba86ad62f876b0da/users/260217fff83c434cb8e28bbc68c2d2a9/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:49.210905 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404483b7-24d4-420b-a8c3-f3e3cd4d684d admin admin] RBAC: Authorizing `identity:create_grant(project_id=628f497315ea484fba86ad62f876b0da, user_id=260217fff83c434cb8e28bbc68c2d2a9, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:49.213516 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404483b7-24d4-420b-a8c3-f3e3cd4d684d admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:49.227143 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1268/2532] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:15:49 2022] PUT /identity/v3/projects/628f497315ea484fba86ad62f876b0da/users/260217fff83c434cb8e28bbc68c2d2a9/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:49.231084 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc10588-8a14-4a0d-8f69-329bd44623ab admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:49.240972 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc10588-8a14-4a0d-8f69-329bd44623ab admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:49.294048 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773d2fd-530b-47cc-b202-50de166f7d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:49.294704 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773d2fd-530b-47cc-b202-50de166f7d90 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:49.294973 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773d2fd-530b-47cc-b202-50de166f7d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:49.295247 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773d2fd-530b-47cc-b202-50de166f7d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:49.295999 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773d2fd-530b-47cc-b202-50de166f7d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:49.297568 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773d2fd-530b-47cc-b202-50de166f7d90 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:49.307548 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1265/2533] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:15:49.311480 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404483b7-24d4-420b-a8c3-f3e3cd4d684d admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:49.321995 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404483b7-24d4-420b-a8c3-f3e3cd4d684d admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:49.326471 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fb333-a6ca-48c8-b15f-c221966ea02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:49.327323 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fb333-a6ca-48c8-b15f-c221966ea02b admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:49.327599 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fb333-a6ca-48c8-b15f-c221966ea02b admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:49.327900 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fb333-a6ca-48c8-b15f-c221966ea02b admin admin] PATH_INFO: `/v3/projects/628f497315ea484fba86ad62f876b0da/users/260217fff83c434cb8e28bbc68c2d2a9/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:49.329828 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3fb333-a6ca-48c8-b15f-c221966ea02b admin admin] RBAC: Authorizing `identity:create_grant(project_id=628f497315ea484fba86ad62f876b0da, user_id=260217fff83c434cb8e28bbc68c2d2a9, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:49.332447 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3fb333-a6ca-48c8-b15f-c221966ea02b admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:49.342191 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1269/2534] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:15:49 2022] PUT /identity/v3/projects/628f497315ea484fba86ad62f876b0da/users/260217fff83c434cb8e28bbc68c2d2a9/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:49.353472 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29fe0b-20d4-4207-b1d3-b4b3adca4d96 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:49.353849 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29fe0b-20d4-4207-b1d3-b4b3adca4d96 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:49.354206 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29fe0b-20d4-4207-b1d3-b4b3adca4d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:49.381053 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-7e29fe0b-20d4-4207-b1d3-b4b3adca4d96 None None] MFA Rules not processed for user `260217fff83c434cb8e28bbc68c2d2a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:49.382258 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-7e29fe0b-20d4-4207-b1d3-b4b3adca4d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:49.446134 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1266/2535] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:49 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:15:49.457511 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fb333-a6ca-48c8-b15f-c221966ea02b admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:49.459174 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-6e3fb333-a6ca-48c8-b15f-c221966ea02b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:49.515062 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fb333-a6ca-48c8-b15f-c221966ea02b admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:49.518687 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee9830-bcce-4c99-ad39-aae205b25044 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:49.519325 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee9830-bcce-4c99-ad39-aae205b25044 service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:49.519603 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee9830-bcce-4c99-ad39-aae205b25044 service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:49.519900 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee9830-bcce-4c99-ad39-aae205b25044 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:49.528680 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee9830-bcce-4c99-ad39-aae205b25044 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:49.530086 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee9830-bcce-4c99-ad39-aae205b25044 service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:49.539323 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1270/2536] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:15:49 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:15:49.585668 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29fe0b-20d4-4207-b1d3-b4b3adca4d96 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:49.596995 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29fe0b-20d4-4207-b1d3-b4b3adca4d96 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:49.601144 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6918349-d5a7-407d-a181-4430d206b4f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:49.601903 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6918349-d5a7-407d-a181-4430d206b4f0 service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:49.602094 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6918349-d5a7-407d-a181-4430d206b4f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:49.602846 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6918349-d5a7-407d-a181-4430d206b4f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:49.659888 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6918349-d5a7-407d-a181-4430d206b4f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:49.661830 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6918349-d5a7-407d-a181-4430d206b4f0 service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:49.672471 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1267/2537] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:15:49 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:15:53.155350 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee9830-bcce-4c99-ad39-aae205b25044 service cinder] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:53.220452 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee9830-bcce-4c99-ad39-aae205b25044 service cinder] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:53.225629 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1377887-4341-4d92-b61d-e94c9a083487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:53.226496 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1377887-4341-4d92-b61d-e94c9a083487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:53.226779 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1377887-4341-4d92-b61d-e94c9a083487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:53.227080 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1377887-4341-4d92-b61d-e94c9a083487 admin admin] PATH_INFO: `/v3/users/5170546eb4b5405ba8e6c13b3c4dcfe8` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:53.228808 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1377887-4341-4d92-b61d-e94c9a083487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5170546eb4b5405ba8e6c13b3c4dcfe8)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:53.230718 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1377887-4341-4d92-b61d-e94c9a083487 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:53.280735 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-f1377887-4341-4d92-b61d-e94c9a083487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5170546eb4b5405ba8e6c13b3c4dcfe8'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:53.281445 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-f1377887-4341-4d92-b61d-e94c9a083487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5170546eb4b5405ba8e6c13b3c4dcfe8'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:53.288270 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-f1377887-4341-4d92-b61d-e94c9a083487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5170546eb4b5405ba8e6c13b3c4dcfe8'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:53.300093 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-f1377887-4341-4d92-b61d-e94c9a083487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5170546eb4b5405ba8e6c13b3c4dcfe8'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:53.300809 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-f1377887-4341-4d92-b61d-e94c9a083487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5170546eb4b5405ba8e6c13b3c4dcfe8'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:53.314613 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1271/2538] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:15:53 2022] DELETE /identity/v3/users/5170546eb4b5405ba8e6c13b3c4dcfe8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:53.319306 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37542acc-e46e-40cd-b98b-ef103da2801a None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:53.319817 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37542acc-e46e-40cd-b98b-ef103da2801a None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:53.320075 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37542acc-e46e-40cd-b98b-ef103da2801a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:53.337822 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-37542acc-e46e-40cd-b98b-ef103da2801a None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:53.339055 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-37542acc-e46e-40cd-b98b-ef103da2801a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:53.398383 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1268/2539] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:15:53.408803 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1377887-4341-4d92-b61d-e94c9a083487 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:53.410209 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-f1377887-4341-4d92-b61d-e94c9a083487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:53.470255 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1377887-4341-4d92-b61d-e94c9a083487 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:53.474766 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663a697-a57b-4870-864c-6125e4cdbca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:53.475525 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663a697-a57b-4870-864c-6125e4cdbca8 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:53.475942 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663a697-a57b-4870-864c-6125e4cdbca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:53.476326 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663a697-a57b-4870-864c-6125e4cdbca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:53.486166 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663a697-a57b-4870-864c-6125e4cdbca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:53.488091 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663a697-a57b-4870-864c-6125e4cdbca8 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:53.500416 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1272/2540] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:15:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:15:53.689508 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37542acc-e46e-40cd-b98b-ef103da2801a None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:53.691260 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-37542acc-e46e-40cd-b98b-ef103da2801a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:53.707344 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37542acc-e46e-40cd-b98b-ef103da2801a None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:53.712633 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f311fc-2acf-4089-88a0-c690823cb0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:53.713784 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f311fc-2acf-4089-88a0-c690823cb0de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:53.714227 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f311fc-2acf-4089-88a0-c690823cb0de admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:53.714662 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f311fc-2acf-4089-88a0-c690823cb0de admin admin] PATH_INFO: `/v3/users/82c3ba13189848e9875bb2691afadfd6` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:53.716434 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f311fc-2acf-4089-88a0-c690823cb0de admin admin] RBAC: Authorizing `identity:delete_user(user_id=82c3ba13189848e9875bb2691afadfd6)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:53.718764 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f311fc-2acf-4089-88a0-c690823cb0de admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:53.795131 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-e4f311fc-2acf-4089-88a0-c690823cb0de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82c3ba13189848e9875bb2691afadfd6'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:53.804251 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-e4f311fc-2acf-4089-88a0-c690823cb0de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82c3ba13189848e9875bb2691afadfd6'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:53.823129 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-e4f311fc-2acf-4089-88a0-c690823cb0de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82c3ba13189848e9875bb2691afadfd6'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:53.835971 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-e4f311fc-2acf-4089-88a0-c690823cb0de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82c3ba13189848e9875bb2691afadfd6'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:53.836713 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-e4f311fc-2acf-4089-88a0-c690823cb0de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82c3ba13189848e9875bb2691afadfd6'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:53.842710 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1269/2541] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:15:53 2022] DELETE /identity/v3/users/82c3ba13189848e9875bb2691afadfd6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:53.847124 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d526e3-7179-4655-8143-fd3d15684101 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:53.847600 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d526e3-7179-4655-8143-fd3d15684101 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:53.847980 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d526e3-7179-4655-8143-fd3d15684101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:53.866052 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-13d526e3-7179-4655-8143-fd3d15684101 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:53.867261 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-13d526e3-7179-4655-8143-fd3d15684101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:53.931779 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1273/2542] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:15:53.944904 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f311fc-2acf-4089-88a0-c690823cb0de admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:53.947242 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-e4f311fc-2acf-4089-88a0-c690823cb0de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:54.001702 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d526e3-7179-4655-8143-fd3d15684101 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:54.003271 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-13d526e3-7179-4655-8143-fd3d15684101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:54.015304 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d526e3-7179-4655-8143-fd3d15684101 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:54.020289 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f311fc-2acf-4089-88a0-c690823cb0de admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:54.021445 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd06ca-7004-4e1f-8529-b7be799d2572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:54.022328 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd06ca-7004-4e1f-8529-b7be799d2572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:54.022827 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd06ca-7004-4e1f-8529-b7be799d2572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:54.023212 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd06ca-7004-4e1f-8529-b7be799d2572 admin admin] PATH_INFO: `/v3/projects/7be50d3037584b368fe477adba83de2e` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:54.024360 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868755d-0ff5-415b-8d12-5baa162bf916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:54.024481 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd06ca-7004-4e1f-8529-b7be799d2572 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7be50d3037584b368fe477adba83de2e)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:54.025005 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868755d-0ff5-415b-8d12-5baa162bf916 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:54.025289 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868755d-0ff5-415b-8d12-5baa162bf916 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:54.025565 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868755d-0ff5-415b-8d12-5baa162bf916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:54.026342 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd06ca-7004-4e1f-8529-b7be799d2572 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:54.035408 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f868755d-0ff5-415b-8d12-5baa162bf916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:54.037768 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f868755d-0ff5-415b-8d12-5baa162bf916 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:54.052302 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1270/2543] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:15:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:15:54.107331 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-9ddd06ca-7004-4e1f-8529-b7be799d2572 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7be50d3037584b368fe477adba83de2e', 'request_id': 'req-9ddd06ca-7004-4e1f-8529-b7be799d2572'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:54.114038 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-9ddd06ca-7004-4e1f-8529-b7be799d2572 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7be50d3037584b368fe477adba83de2e', 'request_id': 'req-9ddd06ca-7004-4e1f-8529-b7be799d2572'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:54.121048 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-9ddd06ca-7004-4e1f-8529-b7be799d2572 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7be50d3037584b368fe477adba83de2e', 'request_id': 'req-9ddd06ca-7004-4e1f-8529-b7be799d2572'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:54.136306 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-9ddd06ca-7004-4e1f-8529-b7be799d2572 admin admin] The token cache is being invalidate because project 7be50d3037584b368fe477adba83de2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:15:54.136723 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-9ddd06ca-7004-4e1f-8529-b7be799d2572 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:54.137461 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-9ddd06ca-7004-4e1f-8529-b7be799d2572 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:54.139111 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1274/2544] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:15:54 2022] DELETE /identity/v3/projects/7be50d3037584b368fe477adba83de2e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:15:54.143187 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868755d-0ff5-415b-8d12-5baa162bf916 service neutron] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:54.155346 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868755d-0ff5-415b-8d12-5baa162bf916 service neutron] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:54.230501 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98eb5e3-f2c3-462a-82a0-b847138a5be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:54.231391 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98eb5e3-f2c3-462a-82a0-b847138a5be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:54.232156 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98eb5e3-f2c3-462a-82a0-b847138a5be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:54.232501 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98eb5e3-f2c3-462a-82a0-b847138a5be2 admin admin] PATH_INFO: `/v3/users/260217fff83c434cb8e28bbc68c2d2a9` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:54.233738 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98eb5e3-f2c3-462a-82a0-b847138a5be2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=260217fff83c434cb8e28bbc68c2d2a9)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:54.235801 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98eb5e3-f2c3-462a-82a0-b847138a5be2 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:54.302735 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b98eb5e3-f2c3-462a-82a0-b847138a5be2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '260217fff83c434cb8e28bbc68c2d2a9'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:54.310432 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b98eb5e3-f2c3-462a-82a0-b847138a5be2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '260217fff83c434cb8e28bbc68c2d2a9'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:54.319010 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b98eb5e3-f2c3-462a-82a0-b847138a5be2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '260217fff83c434cb8e28bbc68c2d2a9'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:54.337165 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b98eb5e3-f2c3-462a-82a0-b847138a5be2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '260217fff83c434cb8e28bbc68c2d2a9'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:54.337945 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b98eb5e3-f2c3-462a-82a0-b847138a5be2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '260217fff83c434cb8e28bbc68c2d2a9'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:54.344727 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1271/2545] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:15:54 2022] DELETE /identity/v3/users/260217fff83c434cb8e28bbc68c2d2a9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:54.363314 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd06ca-7004-4e1f-8529-b7be799d2572 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:54.365120 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-9ddd06ca-7004-4e1f-8529-b7be799d2572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:54.379781 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd06ca-7004-4e1f-8529-b7be799d2572 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:54.446736 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd8509-abfd-4ec7-af55-02c083e3bfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:54.447677 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd8509-abfd-4ec7-af55-02c083e3bfc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:54.448042 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd8509-abfd-4ec7-af55-02c083e3bfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:54.448394 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd8509-abfd-4ec7-af55-02c083e3bfc5 admin admin] PATH_INFO: `/v3/projects/4998640c62624c6f852018d2a87ee2c2` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:54.449650 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd8509-abfd-4ec7-af55-02c083e3bfc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4998640c62624c6f852018d2a87ee2c2)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:54.451749 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd8509-abfd-4ec7-af55-02c083e3bfc5 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:54.501556 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-55dd8509-abfd-4ec7-af55-02c083e3bfc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4998640c62624c6f852018d2a87ee2c2', 'request_id': 'req-55dd8509-abfd-4ec7-af55-02c083e3bfc5'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:54.509519 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-55dd8509-abfd-4ec7-af55-02c083e3bfc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4998640c62624c6f852018d2a87ee2c2', 'request_id': 'req-55dd8509-abfd-4ec7-af55-02c083e3bfc5'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:54.517053 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-55dd8509-abfd-4ec7-af55-02c083e3bfc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4998640c62624c6f852018d2a87ee2c2', 'request_id': 'req-55dd8509-abfd-4ec7-af55-02c083e3bfc5'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:54.532022 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-55dd8509-abfd-4ec7-af55-02c083e3bfc5 admin admin] The token cache is being invalidate because project 4998640c62624c6f852018d2a87ee2c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:15:54.532311 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-55dd8509-abfd-4ec7-af55-02c083e3bfc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:54.532973 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-55dd8509-abfd-4ec7-af55-02c083e3bfc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:54.534645 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1275/2546] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:15:54 2022] DELETE /identity/v3/projects/4998640c62624c6f852018d2a87ee2c2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:54.538528 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98eb5e3-f2c3-462a-82a0-b847138a5be2 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:54.540056 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-b98eb5e3-f2c3-462a-82a0-b847138a5be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:54.553477 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98eb5e3-f2c3-462a-82a0-b847138a5be2 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:54.609235 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20521a21-dbaa-4e0c-8bab-1914ab367f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:54.610038 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20521a21-dbaa-4e0c-8bab-1914ab367f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:54.610304 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20521a21-dbaa-4e0c-8bab-1914ab367f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:54.610575 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20521a21-dbaa-4e0c-8bab-1914ab367f36 admin admin] PATH_INFO: `/v3/users/76ee3f7c7fd4465388f100a473905af5` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:54.611765 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20521a21-dbaa-4e0c-8bab-1914ab367f36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76ee3f7c7fd4465388f100a473905af5)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:54.613702 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20521a21-dbaa-4e0c-8bab-1914ab367f36 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:54.640601 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd8509-abfd-4ec7-af55-02c083e3bfc5 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:54.642186 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-55dd8509-abfd-4ec7-af55-02c083e3bfc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:54.658157 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd8509-abfd-4ec7-af55-02c083e3bfc5 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:54.662808 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59912925-6644-4d38-9da6-57a7f912640d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:54.663962 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59912925-6644-4d38-9da6-57a7f912640d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:54.664317 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59912925-6644-4d38-9da6-57a7f912640d admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:54.664700 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59912925-6644-4d38-9da6-57a7f912640d admin admin] PATH_INFO: `/v3/projects/628f497315ea484fba86ad62f876b0da` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:54.666564 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59912925-6644-4d38-9da6-57a7f912640d admin admin] RBAC: Authorizing `identity:delete_project(project_id=628f497315ea484fba86ad62f876b0da)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:54.668897 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59912925-6644-4d38-9da6-57a7f912640d admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:54.671522 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-20521a21-dbaa-4e0c-8bab-1914ab367f36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76ee3f7c7fd4465388f100a473905af5'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:54.678627 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-20521a21-dbaa-4e0c-8bab-1914ab367f36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76ee3f7c7fd4465388f100a473905af5'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:54.688582 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-20521a21-dbaa-4e0c-8bab-1914ab367f36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76ee3f7c7fd4465388f100a473905af5'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:54.701232 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-20521a21-dbaa-4e0c-8bab-1914ab367f36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76ee3f7c7fd4465388f100a473905af5'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:54.701915 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-20521a21-dbaa-4e0c-8bab-1914ab367f36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76ee3f7c7fd4465388f100a473905af5'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:54.707879 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1272/2547] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:15:54 2022] DELETE /identity/v3/users/76ee3f7c7fd4465388f100a473905af5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:54.717200 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-59912925-6644-4d38-9da6-57a7f912640d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '628f497315ea484fba86ad62f876b0da', 'request_id': 'req-59912925-6644-4d38-9da6-57a7f912640d'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:54.724584 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-59912925-6644-4d38-9da6-57a7f912640d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '628f497315ea484fba86ad62f876b0da', 'request_id': 'req-59912925-6644-4d38-9da6-57a7f912640d'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:54.732479 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-59912925-6644-4d38-9da6-57a7f912640d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '628f497315ea484fba86ad62f876b0da', 'request_id': 'req-59912925-6644-4d38-9da6-57a7f912640d'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:54.747293 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-59912925-6644-4d38-9da6-57a7f912640d admin admin] The token cache is being invalidate because project 628f497315ea484fba86ad62f876b0da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:15:54.747866 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-59912925-6644-4d38-9da6-57a7f912640d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:54.748523 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-59912925-6644-4d38-9da6-57a7f912640d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:54.750035 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1276/2548] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:15:54 2022] DELETE /identity/v3/projects/628f497315ea484fba86ad62f876b0da => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:54.755330 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d229591-9663-4b75-926b-631e25bb053d None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:54.755627 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d229591-9663-4b75-926b-631e25bb053d None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:54.755953 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d229591-9663-4b75-926b-631e25bb053d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:54.775929 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-0d229591-9663-4b75-926b-631e25bb053d None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:54.777131 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-0d229591-9663-4b75-926b-631e25bb053d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:54.836170 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1273/2549] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:15:54.844741 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6757c8e-eaf6-4501-b62d-121b3dfebf2f None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:54.847576 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6757c8e-eaf6-4501-b62d-121b3dfebf2f None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:54.847895 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6757c8e-eaf6-4501-b62d-121b3dfebf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:54.865320 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-b6757c8e-eaf6-4501-b62d-121b3dfebf2f None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:54.866503 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-b6757c8e-eaf6-4501-b62d-121b3dfebf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:54.874324 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1277/2550] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:15:54.878490 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d229591-9663-4b75-926b-631e25bb053d None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:54.888583 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d229591-9663-4b75-926b-631e25bb053d None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:54.893318 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ea9f0-5e00-4449-bf2e-d7f267a5b2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:54.893968 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ea9f0-5e00-4449-bf2e-d7f267a5b2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:54.894248 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ea9f0-5e00-4449-bf2e-d7f267a5b2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:54.894522 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ea9f0-5e00-4449-bf2e-d7f267a5b2b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:54.895247 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ea9f0-5e00-4449-bf2e-d7f267a5b2b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:15:54.895540 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ea9f0-5e00-4449-bf2e-d7f267a5b2b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:54.897171 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ea9f0-5e00-4449-bf2e-d7f267a5b2b1 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:54.909159 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1274/2551] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:15:54.913390 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6757c8e-eaf6-4501-b62d-121b3dfebf2f None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:54.922508 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6757c8e-eaf6-4501-b62d-121b3dfebf2f None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:54.927162 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733fa45-ff21-4776-aab2-7338701e3747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:54.927837 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733fa45-ff21-4776-aab2-7338701e3747 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:54.928123 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733fa45-ff21-4776-aab2-7338701e3747 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:54.928400 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733fa45-ff21-4776-aab2-7338701e3747 admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:54.929087 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733fa45-ff21-4776-aab2-7338701e3747 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:54.931484 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733fa45-ff21-4776-aab2-7338701e3747 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:54.957821 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1278/2552] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:15:54 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:15:54.962154 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ea9f0-5e00-4449-bf2e-d7f267a5b2b1 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:54.972724 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ea9f0-5e00-4449-bf2e-d7f267a5b2b1 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:54.987578 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733fa45-ff21-4776-aab2-7338701e3747 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:54.989778 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-5733fa45-ff21-4776-aab2-7338701e3747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:55.031621 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038ea51-8ee3-4f1c-a226-7c48109470d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:55.032327 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038ea51-8ee3-4f1c-a226-7c48109470d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:55.032739 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038ea51-8ee3-4f1c-a226-7c48109470d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:55.032910 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038ea51-8ee3-4f1c-a226-7c48109470d2 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:55.033590 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038ea51-8ee3-4f1c-a226-7c48109470d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:55.035505 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038ea51-8ee3-4f1c-a226-7c48109470d2 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:55.055587 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1275/2553] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:15:54 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:15:55.059803 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038ea51-8ee3-4f1c-a226-7c48109470d2 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:55.070131 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038ea51-8ee3-4f1c-a226-7c48109470d2 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:55.074060 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733fa45-ff21-4776-aab2-7338701e3747 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:55.076200 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1690c-8266-4c20-bcf1-08f76527fd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:55.076872 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1690c-8266-4c20-bcf1-08f76527fd4a admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:55.077160 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1690c-8266-4c20-bcf1-08f76527fd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:55.077443 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1690c-8266-4c20-bcf1-08f76527fd4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:55.078174 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a1690c-8266-4c20-bcf1-08f76527fd4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:55.079264 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c979d-e0dc-49e5-854a-fa4bf7077d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:55.079840 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a1690c-8266-4c20-bcf1-08f76527fd4a admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:55.080132 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c979d-e0dc-49e5-854a-fa4bf7077d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:55.080411 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c979d-e0dc-49e5-854a-fa4bf7077d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:55.080737 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c979d-e0dc-49e5-854a-fa4bf7077d45 admin admin] PATH_INFO: `/v3/projects/358b7c3d8361478189278726d511ee2f` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:55.081940 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c979d-e0dc-49e5-854a-fa4bf7077d45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=358b7c3d8361478189278726d511ee2f)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:55.083902 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c979d-e0dc-49e5-854a-fa4bf7077d45 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:55.089996 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1276/2554] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:15:55.094002 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1690c-8266-4c20-bcf1-08f76527fd4a admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:55.103911 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1690c-8266-4c20-bcf1-08f76527fd4a admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:55.108522 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32c03f-dc0e-490b-b54c-3cc5182daf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:55.109166 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32c03f-dc0e-490b-b54c-3cc5182daf87 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:55.109586 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32c03f-dc0e-490b-b54c-3cc5182daf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:55.109818 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32c03f-dc0e-490b-b54c-3cc5182daf87 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:55.110619 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d32c03f-dc0e-490b-b54c-3cc5182daf87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:55.112567 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d32c03f-dc0e-490b-b54c-3cc5182daf87 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:55.124116 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1277/2555] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:15:55.128147 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32c03f-dc0e-490b-b54c-3cc5182daf87 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:55.135486 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-1f4c979d-e0dc-49e5-854a-fa4bf7077d45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '358b7c3d8361478189278726d511ee2f', 'request_id': 'req-1f4c979d-e0dc-49e5-854a-fa4bf7077d45'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:55.137997 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32c03f-dc0e-490b-b54c-3cc5182daf87 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:55.140950 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-1f4c979d-e0dc-49e5-854a-fa4bf7077d45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '358b7c3d8361478189278726d511ee2f', 'request_id': 'req-1f4c979d-e0dc-49e5-854a-fa4bf7077d45'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:55.146891 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-1f4c979d-e0dc-49e5-854a-fa4bf7077d45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '358b7c3d8361478189278726d511ee2f', 'request_id': 'req-1f4c979d-e0dc-49e5-854a-fa4bf7077d45'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:55.158787 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-1f4c979d-e0dc-49e5-854a-fa4bf7077d45 admin admin] The token cache is being invalidate because project 358b7c3d8361478189278726d511ee2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:15:55.159073 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-1f4c979d-e0dc-49e5-854a-fa4bf7077d45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:55.159741 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-1f4c979d-e0dc-49e5-854a-fa4bf7077d45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:55.161277 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1279/2556] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:15:54 2022] DELETE /identity/v3/projects/358b7c3d8361478189278726d511ee2f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:15:55.165933 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72ce4f-0e8b-430a-af1b-788fcad33b1f None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:55.166224 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72ce4f-0e8b-430a-af1b-788fcad33b1f None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:55.166503 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72ce4f-0e8b-430a-af1b-788fcad33b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:55.183839 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-cf72ce4f-0e8b-430a-af1b-788fcad33b1f None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:55.185028 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-cf72ce4f-0e8b-430a-af1b-788fcad33b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:55.192864 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a56d2-43ed-4d77-86c0-d16832db1bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:55.193779 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a56d2-43ed-4d77-86c0-d16832db1bd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:55.194061 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a56d2-43ed-4d77-86c0-d16832db1bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:55.194331 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a56d2-43ed-4d77-86c0-d16832db1bd9 admin admin] PATH_INFO: `/v3/projects/1921d2bc4fba46eabe48c4162cfdeb1f/users/619372667c56474a854b8ad554a891c9/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:55.209706 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a56d2-43ed-4d77-86c0-d16832db1bd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1921d2bc4fba46eabe48c4162cfdeb1f, user_id=619372667c56474a854b8ad554a891c9, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:55.212385 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a56d2-43ed-4d77-86c0-d16832db1bd9 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:55.225275 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1278/2557] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:15:55 2022] PUT /identity/v3/projects/1921d2bc4fba46eabe48c4162cfdeb1f/users/619372667c56474a854b8ad554a891c9/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:15:55.236216 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ddac6-53e0-4c35-a3c1-778a08f8a0bf None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:55.236505 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ddac6-53e0-4c35-a3c1-778a08f8a0bf None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:55.236778 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ddac6-53e0-4c35-a3c1-778a08f8a0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:55.255053 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1280/2558] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:15:55.262700 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6f173-c3c6-44f8-bbd9-6b1640a10cf4 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:55.262990 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6f173-c3c6-44f8-bbd9-6b1640a10cf4 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:55.263098 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-4c8ddac6-53e0-4c35-a3c1-778a08f8a0bf None None] MFA Rules not processed for user `619372667c56474a854b8ad554a891c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:55.263272 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6f173-c3c6-44f8-bbd9-6b1640a10cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:55.264415 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-4c8ddac6-53e0-4c35-a3c1-778a08f8a0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:55.280413 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-81f6f173-c3c6-44f8-bbd9-6b1640a10cf4 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:55.281588 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-81f6f173-c3c6-44f8-bbd9-6b1640a10cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:55.327357 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1279/2559] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:15:55.331757 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ddac6-53e0-4c35-a3c1-778a08f8a0bf None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:55.333048 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-4c8ddac6-53e0-4c35-a3c1-778a08f8a0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:55.341569 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1281/2560] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:15:55.342854 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6f173-c3c6-44f8-bbd9-6b1640a10cf4 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:55.348514 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ddac6-53e0-4c35-a3c1-778a08f8a0bf None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:55.351659 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6f173-c3c6-44f8-bbd9-6b1640a10cf4 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:55.353915 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1df956-e0bb-48fe-9eaf-9f25cc934a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:55.354561 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1df956-e0bb-48fe-9eaf-9f25cc934a63 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:55.354844 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1df956-e0bb-48fe-9eaf-9f25cc934a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:55.355123 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1df956-e0bb-48fe-9eaf-9f25cc934a63 admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:55.355849 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1df956-e0bb-48fe-9eaf-9f25cc934a63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:55.356783 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb06f47-dc06-4c3b-8164-4471a00b0bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:55.357414 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb06f47-dc06-4c3b-8164-4471a00b0bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:55.357697 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb06f47-dc06-4c3b-8164-4471a00b0bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:55.357792 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1df956-e0bb-48fe-9eaf-9f25cc934a63 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:55.357983 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb06f47-dc06-4c3b-8164-4471a00b0bd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:55.358697 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb06f47-dc06-4c3b-8164-4471a00b0bd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:15:55.359000 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb06f47-dc06-4c3b-8164-4471a00b0bd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:55.360646 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb06f47-dc06-4c3b-8164-4471a00b0bd9 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:55.372401 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1282/2561] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:15:55.376808 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb06f47-dc06-4c3b-8164-4471a00b0bd9 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:55.385618 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1280/2562] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:15:55 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:15:55.386767 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb06f47-dc06-4c3b-8164-4471a00b0bd9 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:55.386895 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1df956-e0bb-48fe-9eaf-9f25cc934a63 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:55.447942 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32534dcc-8cb2-4f88-a4be-fc6913ac8cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:55.448660 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32534dcc-8cb2-4f88-a4be-fc6913ac8cbb admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:55.448943 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32534dcc-8cb2-4f88-a4be-fc6913ac8cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:55.449221 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32534dcc-8cb2-4f88-a4be-fc6913ac8cbb admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:55.449913 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32534dcc-8cb2-4f88-a4be-fc6913ac8cbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:55.451883 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32534dcc-8cb2-4f88-a4be-fc6913ac8cbb admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:55.452000 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1df956-e0bb-48fe-9eaf-9f25cc934a63 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:55.457037 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f7e54-1168-417a-b975-5edc692872a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:55.457699 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f7e54-1168-417a-b975-5edc692872a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:55.458008 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f7e54-1168-417a-b975-5edc692872a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:55.458257 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f7e54-1168-417a-b975-5edc692872a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:55.458944 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f7e54-1168-417a-b975-5edc692872a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:55.461364 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f7e54-1168-417a-b975-5edc692872a5 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:55.480465 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1283/2563] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:15:55 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:15:55.484627 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32534dcc-8cb2-4f88-a4be-fc6913ac8cbb admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:55.489975 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1281/2564] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:15:55 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:15:55.491605 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f7e54-1168-417a-b975-5edc692872a5 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:55.504245 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f7e54-1168-417a-b975-5edc692872a5 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:55.548458 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32534dcc-8cb2-4f88-a4be-fc6913ac8cbb admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:55.553397 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb936e-515c-4296-9d86-152846b8d025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:55.554066 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb936e-515c-4296-9d86-152846b8d025 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:55.554354 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb936e-515c-4296-9d86-152846b8d025 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:55.554634 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb936e-515c-4296-9d86-152846b8d025 admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:55.556054 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb936e-515c-4296-9d86-152846b8d025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:55.561057 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb936e-515c-4296-9d86-152846b8d025 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:55.564651 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f286e-be44-4f11-a328-25012b9634d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:55.565334 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f286e-be44-4f11-a328-25012b9634d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:55.565620 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f286e-be44-4f11-a328-25012b9634d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:55.565896 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f286e-be44-4f11-a328-25012b9634d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:55.566633 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f286e-be44-4f11-a328-25012b9634d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:55.568644 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f286e-be44-4f11-a328-25012b9634d6 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:55.580145 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1282/2565] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:15:55.586571 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1284/2566] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:15:55 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:15:55.586754 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f286e-be44-4f11-a328-25012b9634d6 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:55.587959 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb936e-515c-4296-9d86-152846b8d025 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:55.595738 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f286e-be44-4f11-a328-25012b9634d6 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:55.600780 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb936e-515c-4296-9d86-152846b8d025 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:55.602961 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0c7a1-39de-4d3b-9a56-e147014e6a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:55.603853 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0c7a1-39de-4d3b-9a56-e147014e6a4d admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:55.604140 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0c7a1-39de-4d3b-9a56-e147014e6a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:55.604410 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0c7a1-39de-4d3b-9a56-e147014e6a4d admin admin] PATH_INFO: `/v3/projects/b87540b5ea1d452caf6077d189492152/users/7b1fca81b63d4aa9b9e6bfad24385521/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:55.608407 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fcdbf9-9b18-43f3-b935-553c90c13f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:55.609193 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcdbf9-9b18-43f3-b935-553c90c13f6f admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:55.609641 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcdbf9-9b18-43f3-b935-553c90c13f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:55.609982 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcdbf9-9b18-43f3-b935-553c90c13f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:55.610939 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fcdbf9-9b18-43f3-b935-553c90c13f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:55.612830 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fcdbf9-9b18-43f3-b935-553c90c13f6f admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:55.619704 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0c7a1-39de-4d3b-9a56-e147014e6a4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b87540b5ea1d452caf6077d189492152, user_id=7b1fca81b63d4aa9b9e6bfad24385521, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:55.622326 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0c7a1-39de-4d3b-9a56-e147014e6a4d admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:55.623640 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1285/2567] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:15:55.627652 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fcdbf9-9b18-43f3-b935-553c90c13f6f admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:55.635413 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1283/2568] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:15:55 2022] PUT /identity/v3/projects/b87540b5ea1d452caf6077d189492152/users/7b1fca81b63d4aa9b9e6bfad24385521/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:15:55.637417 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fcdbf9-9b18-43f3-b935-553c90c13f6f admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:55.639178 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0c7a1-39de-4d3b-9a56-e147014e6a4d admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:55.692481 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1951b-5345-4a04-86b3-98cde5e7da9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:55.693140 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1951b-5345-4a04-86b3-98cde5e7da9b admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:55.693424 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1951b-5345-4a04-86b3-98cde5e7da9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:55.693707 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1951b-5345-4a04-86b3-98cde5e7da9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:55.694426 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df1951b-5345-4a04-86b3-98cde5e7da9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:55.696065 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df1951b-5345-4a04-86b3-98cde5e7da9b admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:55.698547 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0c7a1-39de-4d3b-9a56-e147014e6a4d admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:55.703241 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f1025-f719-4372-8c7e-c96326594c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:55.704017 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f1025-f719-4372-8c7e-c96326594c96 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:55.704310 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f1025-f719-4372-8c7e-c96326594c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:55.704584 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f1025-f719-4372-8c7e-c96326594c96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:55.705293 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f1025-f719-4372-8c7e-c96326594c96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:55.705596 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1286/2569] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:15:55.706918 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f1025-f719-4372-8c7e-c96326594c96 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:55.709695 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1951b-5345-4a04-86b3-98cde5e7da9b admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:55.718499 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1284/2570] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:15:55.720252 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1951b-5345-4a04-86b3-98cde5e7da9b admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:55.723759 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f1025-f719-4372-8c7e-c96326594c96 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:55.728057 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b34b44-9b97-40ae-ab47-caac80977156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:55.728983 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b34b44-9b97-40ae-ab47-caac80977156 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:55.729304 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b34b44-9b97-40ae-ab47-caac80977156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:55.729580 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b34b44-9b97-40ae-ab47-caac80977156 admin admin] PATH_INFO: `/v3/projects/7ac4b13805a84094951ad849f6d706af/users/86e572babe3c4538a53d8c42097e5e9e/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:55.734577 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f1025-f719-4372-8c7e-c96326594c96 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:55.739273 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d35d5f-b892-4f43-a0f9-67aa22265787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:55.740263 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d35d5f-b892-4f43-a0f9-67aa22265787 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:55.740580 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d35d5f-b892-4f43-a0f9-67aa22265787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:55.740842 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d35d5f-b892-4f43-a0f9-67aa22265787 admin admin] PATH_INFO: `/v3/projects/b87540b5ea1d452caf6077d189492152/users/7b1fca81b63d4aa9b9e6bfad24385521/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:55.742805 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d35d5f-b892-4f43-a0f9-67aa22265787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b87540b5ea1d452caf6077d189492152, user_id=7b1fca81b63d4aa9b9e6bfad24385521, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:55.745158 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b34b44-9b97-40ae-ab47-caac80977156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ac4b13805a84094951ad849f6d706af, user_id=86e572babe3c4538a53d8c42097e5e9e, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:55.745476 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d35d5f-b892-4f43-a0f9-67aa22265787 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:55.747810 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b34b44-9b97-40ae-ab47-caac80977156 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:55.756600 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1285/2571] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:15:55 2022] PUT /identity/v3/projects/b87540b5ea1d452caf6077d189492152/users/7b1fca81b63d4aa9b9e6bfad24385521/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:15:55.760755 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1287/2572] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:15:55 2022] PUT /identity/v3/projects/7ac4b13805a84094951ad849f6d706af/users/86e572babe3c4538a53d8c42097e5e9e/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:15:55.766892 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6718b8b-d8b2-4f07-ac39-83bdd9c8d180 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:55.767245 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6718b8b-d8b2-4f07-ac39-83bdd9c8d180 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:55.767579 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6718b8b-d8b2-4f07-ac39-83bdd9c8d180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:55.770339 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303ddde-ce7e-4a77-9084-0b01be6519bb None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:55.770804 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303ddde-ce7e-4a77-9084-0b01be6519bb None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:55.771054 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303ddde-ce7e-4a77-9084-0b01be6519bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:55.796444 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-c6718b8b-d8b2-4f07-ac39-83bdd9c8d180 None None] MFA Rules not processed for user `7b1fca81b63d4aa9b9e6bfad24385521`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:55.798358 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-c6718b8b-d8b2-4f07-ac39-83bdd9c8d180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:55.799045 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-f303ddde-ce7e-4a77-9084-0b01be6519bb None None] MFA Rules not processed for user `86e572babe3c4538a53d8c42097e5e9e`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:55.800251 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-f303ddde-ce7e-4a77-9084-0b01be6519bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:55.866381 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1288/2573] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:15:55.870739 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303ddde-ce7e-4a77-9084-0b01be6519bb None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:55.877635 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1286/2574] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:55 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:15:55.887951 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6718b8b-d8b2-4f07-ac39-83bdd9c8d180 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:55.889343 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-c6718b8b-d8b2-4f07-ac39-83bdd9c8d180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:55.929493 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303ddde-ce7e-4a77-9084-0b01be6519bb None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:55.935334 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e1684-82da-4611-b07e-1bdca1fff47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:55.936013 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e1684-82da-4611-b07e-1bdca1fff47e admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:55.936297 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e1684-82da-4611-b07e-1bdca1fff47e admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:55.936578 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e1684-82da-4611-b07e-1bdca1fff47e admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:55.937261 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e1684-82da-4611-b07e-1bdca1fff47e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:55.939399 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e1684-82da-4611-b07e-1bdca1fff47e admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:55.944363 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6718b8b-d8b2-4f07-ac39-83bdd9c8d180 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:55.948118 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d2038-6b70-44ef-bac7-a52c327459f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:55.948757 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d2038-6b70-44ef-bac7-a52c327459f7 service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:55.949070 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d2038-6b70-44ef-bac7-a52c327459f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:55.949321 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d2038-6b70-44ef-bac7-a52c327459f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:55.959204 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d2038-6b70-44ef-bac7-a52c327459f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:55.960658 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d2038-6b70-44ef-bac7-a52c327459f7 service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:55.964567 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1289/2575] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:15:55 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:15:55.968487 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e1684-82da-4611-b07e-1bdca1fff47e admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:55.970884 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1287/2576] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:15:55 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:15:56.028687 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e1684-82da-4611-b07e-1bdca1fff47e admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:56.033642 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18d3cb-7024-49fd-9068-1b3cbff7f4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:56.034372 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18d3cb-7024-49fd-9068-1b3cbff7f4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:56.034665 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18d3cb-7024-49fd-9068-1b3cbff7f4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:56.034946 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18d3cb-7024-49fd-9068-1b3cbff7f4e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:56.035666 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18d3cb-7024-49fd-9068-1b3cbff7f4e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:56.037607 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db18d3cb-7024-49fd-9068-1b3cbff7f4e2 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:56.058613 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1290/2577] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:15:55 2022] POST /identity/v3/users => generated 299 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:15:56.062596 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d2038-6b70-44ef-bac7-a52c327459f7 service cinder] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:56.068864 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18d3cb-7024-49fd-9068-1b3cbff7f4e2 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:56.074383 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d2038-6b70-44ef-bac7-a52c327459f7 service cinder] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:56.078879 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a9f50-5bf5-43e2-a492-412f660870f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:56.079602 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a9f50-5bf5-43e2-a492-412f660870f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:56.079911 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a9f50-5bf5-43e2-a492-412f660870f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:56.080204 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a9f50-5bf5-43e2-a492-412f660870f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:56.080918 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a9f50-5bf5-43e2-a492-412f660870f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:56.082579 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a9f50-5bf5-43e2-a492-412f660870f7 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:56.092943 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1288/2578] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:15:56.097069 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a9f50-5bf5-43e2-a492-412f660870f7 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:56.106536 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a9f50-5bf5-43e2-a492-412f660870f7 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:56.111055 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1861a5-72f0-4583-ae02-fb300a78f040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:56.111952 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1861a5-72f0-4583-ae02-fb300a78f040 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:56.112237 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1861a5-72f0-4583-ae02-fb300a78f040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:56.112520 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1861a5-72f0-4583-ae02-fb300a78f040 admin admin] PATH_INFO: `/v3/projects/91e0e0f7e8be483fa4a601b13eccf02c/users/7e54408158f14a2eb6c8f54e7479d9ea/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:56.123759 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18d3cb-7024-49fd-9068-1b3cbff7f4e2 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:56.127195 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1861a5-72f0-4583-ae02-fb300a78f040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91e0e0f7e8be483fa4a601b13eccf02c, user_id=7e54408158f14a2eb6c8f54e7479d9ea, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:56.127318 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543a2ce-55a1-4482-a5a0-4d8e2d32f866 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:56.127974 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543a2ce-55a1-4482-a5a0-4d8e2d32f866 service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:56.128257 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543a2ce-55a1-4482-a5a0-4d8e2d32f866 service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:56.128568 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543a2ce-55a1-4482-a5a0-4d8e2d32f866 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:56.130077 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1861a5-72f0-4583-ae02-fb300a78f040 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:56.143865 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1289/2579] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:15:56 2022] PUT /identity/v3/projects/91e0e0f7e8be483fa4a601b13eccf02c/users/7e54408158f14a2eb6c8f54e7479d9ea/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:15:56.147564 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1861a5-72f0-4583-ae02-fb300a78f040 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:56.183961 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543a2ce-55a1-4482-a5a0-4d8e2d32f866 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:56.185416 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543a2ce-55a1-4482-a5a0-4d8e2d32f866 service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:56.194404 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1291/2580] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:15:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:15:56.205499 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1861a5-72f0-4583-ae02-fb300a78f040 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:56.210234 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88680f59-d25a-4ae6-833d-01c7013da657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:56.210893 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88680f59-d25a-4ae6-833d-01c7013da657 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:56.211177 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88680f59-d25a-4ae6-833d-01c7013da657 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:56.212119 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88680f59-d25a-4ae6-833d-01c7013da657 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:56.212856 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88680f59-d25a-4ae6-833d-01c7013da657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:56.214454 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88680f59-d25a-4ae6-833d-01c7013da657 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:56.224409 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1290/2581] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:15:56.228720 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543a2ce-55a1-4482-a5a0-4d8e2d32f866 service cinder] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:56.239494 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543a2ce-55a1-4482-a5a0-4d8e2d32f866 service cinder] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:56.244045 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323493c9-773e-4227-b8cf-4315f4d322d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:56.244919 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323493c9-773e-4227-b8cf-4315f4d322d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:56.245201 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323493c9-773e-4227-b8cf-4315f4d322d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:56.245478 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323493c9-773e-4227-b8cf-4315f4d322d8 admin admin] PATH_INFO: `/v3/projects/91e0e0f7e8be483fa4a601b13eccf02c/users/7e54408158f14a2eb6c8f54e7479d9ea/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:56.247433 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323493c9-773e-4227-b8cf-4315f4d322d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91e0e0f7e8be483fa4a601b13eccf02c, user_id=7e54408158f14a2eb6c8f54e7479d9ea, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:56.250073 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323493c9-773e-4227-b8cf-4315f4d322d8 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:56.260588 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1292/2582] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:15:56 2022] PUT /identity/v3/projects/91e0e0f7e8be483fa4a601b13eccf02c/users/7e54408158f14a2eb6c8f54e7479d9ea/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:56.271711 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dd569-3603-492e-934d-56d8cc1e3644 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:56.272089 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dd569-3603-492e-934d-56d8cc1e3644 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:56.272454 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dd569-3603-492e-934d-56d8cc1e3644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:56.299713 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-ea6dd569-3603-492e-934d-56d8cc1e3644 None None] MFA Rules not processed for user `7e54408158f14a2eb6c8f54e7479d9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:56.300929 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-ea6dd569-3603-492e-934d-56d8cc1e3644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:56.373439 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1291/2583] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:15:56.386643 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323493c9-773e-4227-b8cf-4315f4d322d8 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:56.388865 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-323493c9-773e-4227-b8cf-4315f4d322d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:56.477883 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323493c9-773e-4227-b8cf-4315f4d322d8 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:56.481718 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5c245-bf68-4ce5-8103-7d1b898e36e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:56.482364 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5c245-bf68-4ce5-8103-7d1b898e36e0 service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:56.482648 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5c245-bf68-4ce5-8103-7d1b898e36e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:56.483071 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5c245-bf68-4ce5-8103-7d1b898e36e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:56.492305 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5c245-bf68-4ce5-8103-7d1b898e36e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:56.494359 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5c245-bf68-4ce5-8103-7d1b898e36e0 service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:56.505221 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1293/2584] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:15:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:15:56.578676 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dd569-3603-492e-934d-56d8cc1e3644 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:56.638358 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dd569-3603-492e-934d-56d8cc1e3644 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:56.642930 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08840cf6-d64b-4061-924b-a23f6ef0416a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:56.643861 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08840cf6-d64b-4061-924b-a23f6ef0416a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:56.644132 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08840cf6-d64b-4061-924b-a23f6ef0416a admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:56.644785 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08840cf6-d64b-4061-924b-a23f6ef0416a admin admin] PATH_INFO: `/v3/users/86e572babe3c4538a53d8c42097e5e9e` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:56.645584 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08840cf6-d64b-4061-924b-a23f6ef0416a admin admin] RBAC: Authorizing `identity:delete_user(user_id=86e572babe3c4538a53d8c42097e5e9e)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:56.647488 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08840cf6-d64b-4061-924b-a23f6ef0416a admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:56.710585 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-08840cf6-d64b-4061-924b-a23f6ef0416a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86e572babe3c4538a53d8c42097e5e9e'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:56.720246 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-08840cf6-d64b-4061-924b-a23f6ef0416a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86e572babe3c4538a53d8c42097e5e9e'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:56.729659 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-08840cf6-d64b-4061-924b-a23f6ef0416a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86e572babe3c4538a53d8c42097e5e9e'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:56.735223 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5c245-bf68-4ce5-8103-7d1b898e36e0 service cinder] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:56.736858 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-41f5c245-bf68-4ce5-8103-7d1b898e36e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:56.743049 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-08840cf6-d64b-4061-924b-a23f6ef0416a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86e572babe3c4538a53d8c42097e5e9e'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:56.743965 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-08840cf6-d64b-4061-924b-a23f6ef0416a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86e572babe3c4538a53d8c42097e5e9e'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:56.753336 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1292/2585] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:15:56 2022] DELETE /identity/v3/users/86e572babe3c4538a53d8c42097e5e9e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:56.759134 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367c06e-df07-448c-a3dd-416867df8128 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:56.759423 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367c06e-df07-448c-a3dd-416867df8128 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:56.759724 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367c06e-df07-448c-a3dd-416867df8128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:56.777053 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-e367c06e-df07-448c-a3dd-416867df8128 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:56.778266 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-e367c06e-df07-448c-a3dd-416867df8128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:56.795414 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5c245-bf68-4ce5-8103-7d1b898e36e0 service cinder] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:56.835525 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1293/2586] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:15:56.841123 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e61d83-76ee-49c1-8589-437efa243593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:56.841764 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e61d83-76ee-49c1-8589-437efa243593 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:56.842046 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e61d83-76ee-49c1-8589-437efa243593 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:56.842324 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e61d83-76ee-49c1-8589-437efa243593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:56.844117 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-85e61d83-76ee-49c1-8589-437efa243593 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:56.845588 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367c06e-df07-448c-a3dd-416867df8128 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:56.846875 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-e367c06e-df07-448c-a3dd-416867df8128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:56.856581 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e61d83-76ee-49c1-8589-437efa243593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:56.858279 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e61d83-76ee-49c1-8589-437efa243593 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:56.858656 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367c06e-df07-448c-a3dd-416867df8128 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:56.862200 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0648a5e-8727-4da1-ad91-b962fc281781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:56.862831 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0648a5e-8727-4da1-ad91-b962fc281781 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:56.863113 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0648a5e-8727-4da1-ad91-b962fc281781 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:56.863392 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0648a5e-8727-4da1-ad91-b962fc281781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:56.868609 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1294/2587] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:15:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:15:56.872986 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0648a5e-8727-4da1-ad91-b962fc281781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:56.874459 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0648a5e-8727-4da1-ad91-b962fc281781 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:56.884004 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1294/2588] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:15:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:15:57.295198 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e61d83-76ee-49c1-8589-437efa243593 service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:57.296707 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-85e61d83-76ee-49c1-8589-437efa243593 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:57.308841 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e61d83-76ee-49c1-8589-437efa243593 service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:57.315129 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49458688-14f7-4c13-bda2-3236189f17d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:57.316094 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49458688-14f7-4c13-bda2-3236189f17d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:57.316380 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49458688-14f7-4c13-bda2-3236189f17d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:57.316656 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49458688-14f7-4c13-bda2-3236189f17d2 admin admin] PATH_INFO: `/v3/projects/7ac4b13805a84094951ad849f6d706af` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:57.317842 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49458688-14f7-4c13-bda2-3236189f17d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ac4b13805a84094951ad849f6d706af)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:57.319964 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49458688-14f7-4c13-bda2-3236189f17d2 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:57.365931 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-49458688-14f7-4c13-bda2-3236189f17d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ac4b13805a84094951ad849f6d706af', 'request_id': 'req-49458688-14f7-4c13-bda2-3236189f17d2'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:57.371117 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-49458688-14f7-4c13-bda2-3236189f17d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ac4b13805a84094951ad849f6d706af', 'request_id': 'req-49458688-14f7-4c13-bda2-3236189f17d2'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:57.377277 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-49458688-14f7-4c13-bda2-3236189f17d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ac4b13805a84094951ad849f6d706af', 'request_id': 'req-49458688-14f7-4c13-bda2-3236189f17d2'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:57.389420 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-49458688-14f7-4c13-bda2-3236189f17d2 admin admin] The token cache is being invalidate because project 7ac4b13805a84094951ad849f6d706af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:15:57.390080 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-49458688-14f7-4c13-bda2-3236189f17d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:57.390303 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-49458688-14f7-4c13-bda2-3236189f17d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:57.391842 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1295/2589] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:15:57 2022] DELETE /identity/v3/projects/7ac4b13805a84094951ad849f6d706af => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:57.395928 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0648a5e-8727-4da1-ad91-b962fc281781 service neutron] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:57.406288 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0648a5e-8727-4da1-ad91-b962fc281781 service neutron] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:57.460921 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc788544-7d21-4824-ad3f-b7a131c52015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:57.462247 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc788544-7d21-4824-ad3f-b7a131c52015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:57.462526 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc788544-7d21-4824-ad3f-b7a131c52015 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:57.462801 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc788544-7d21-4824-ad3f-b7a131c52015 admin admin] PATH_INFO: `/v3/users/7e54408158f14a2eb6c8f54e7479d9ea` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:57.464166 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc788544-7d21-4824-ad3f-b7a131c52015 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e54408158f14a2eb6c8f54e7479d9ea)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:57.466095 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc788544-7d21-4824-ad3f-b7a131c52015 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:57.513311 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-bc788544-7d21-4824-ad3f-b7a131c52015 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e54408158f14a2eb6c8f54e7479d9ea'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:57.520003 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-bc788544-7d21-4824-ad3f-b7a131c52015 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e54408158f14a2eb6c8f54e7479d9ea'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:57.530406 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-bc788544-7d21-4824-ad3f-b7a131c52015 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e54408158f14a2eb6c8f54e7479d9ea'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:57.544106 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-bc788544-7d21-4824-ad3f-b7a131c52015 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e54408158f14a2eb6c8f54e7479d9ea'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:57.544981 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-bc788544-7d21-4824-ad3f-b7a131c52015 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e54408158f14a2eb6c8f54e7479d9ea'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:57.551859 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1295/2590] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:15:57 2022] DELETE /identity/v3/users/7e54408158f14a2eb6c8f54e7479d9ea => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:15:57.968366 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49458688-14f7-4c13-bda2-3236189f17d2 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:57.969982 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-49458688-14f7-4c13-bda2-3236189f17d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:57.983344 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49458688-14f7-4c13-bda2-3236189f17d2 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:58.051401 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47410e2c-6007-44c9-a43c-b952ca46548a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:58.052472 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47410e2c-6007-44c9-a43c-b952ca46548a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:58.052880 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47410e2c-6007-44c9-a43c-b952ca46548a admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:58.053259 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47410e2c-6007-44c9-a43c-b952ca46548a admin admin] PATH_INFO: `/v3/projects/91e0e0f7e8be483fa4a601b13eccf02c` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:58.056046 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47410e2c-6007-44c9-a43c-b952ca46548a admin admin] RBAC: Authorizing `identity:delete_project(project_id=91e0e0f7e8be483fa4a601b13eccf02c)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:58.058116 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47410e2c-6007-44c9-a43c-b952ca46548a admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:58.115102 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-47410e2c-6007-44c9-a43c-b952ca46548a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91e0e0f7e8be483fa4a601b13eccf02c', 'request_id': 'req-47410e2c-6007-44c9-a43c-b952ca46548a'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:58.122295 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-47410e2c-6007-44c9-a43c-b952ca46548a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91e0e0f7e8be483fa4a601b13eccf02c', 'request_id': 'req-47410e2c-6007-44c9-a43c-b952ca46548a'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:58.129690 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-47410e2c-6007-44c9-a43c-b952ca46548a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91e0e0f7e8be483fa4a601b13eccf02c', 'request_id': 'req-47410e2c-6007-44c9-a43c-b952ca46548a'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:58.142947 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-47410e2c-6007-44c9-a43c-b952ca46548a admin admin] The token cache is being invalidate because project 91e0e0f7e8be483fa4a601b13eccf02c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:15:58.143241 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-47410e2c-6007-44c9-a43c-b952ca46548a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:58.143915 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-47410e2c-6007-44c9-a43c-b952ca46548a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:58.145456 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1296/2591] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:15:57 2022] DELETE /identity/v3/projects/91e0e0f7e8be483fa4a601b13eccf02c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:58.150702 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc9846-805c-489a-88d8-50e342b34179 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:58.151176 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc9846-805c-489a-88d8-50e342b34179 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:58.151636 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc9846-805c-489a-88d8-50e342b34179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:58.174279 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-41dc9846-805c-489a-88d8-50e342b34179 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:58.175663 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-41dc9846-805c-489a-88d8-50e342b34179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:58.241278 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1296/2592] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:15:58.249703 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf91f85-7d74-4c18-b550-148f76008f39 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:58.249994 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf91f85-7d74-4c18-b550-148f76008f39 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:58.250275 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf91f85-7d74-4c18-b550-148f76008f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:58.269419 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-bdf91f85-7d74-4c18-b550-148f76008f39 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:58.270558 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-bdf91f85-7d74-4c18-b550-148f76008f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:58.278905 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1297/2593] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:15:58.283036 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc9846-805c-489a-88d8-50e342b34179 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:58.293901 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc9846-805c-489a-88d8-50e342b34179 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:58.298659 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f1cb7-a1e0-4396-b9fc-ca454bda5926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:58.299326 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f1cb7-a1e0-4396-b9fc-ca454bda5926 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:58.299608 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f1cb7-a1e0-4396-b9fc-ca454bda5926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:58.299908 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f1cb7-a1e0-4396-b9fc-ca454bda5926 admin admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:58.300635 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f1cb7-a1e0-4396-b9fc-ca454bda5926 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:15:58.300939 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f1cb7-a1e0-4396-b9fc-ca454bda5926 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:58.302550 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f1cb7-a1e0-4396-b9fc-ca454bda5926 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:58.319727 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1297/2594] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:15:58.321237 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf91f85-7d74-4c18-b550-148f76008f39 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:58.330750 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf91f85-7d74-4c18-b550-148f76008f39 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:58.335618 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d93ed6-0337-46cf-81fa-880bf1981ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:58.336433 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d93ed6-0337-46cf-81fa-880bf1981ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:58.336780 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d93ed6-0337-46cf-81fa-880bf1981ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:58.337123 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d93ed6-0337-46cf-81fa-880bf1981ae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:58.337955 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d93ed6-0337-46cf-81fa-880bf1981ae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:58.339960 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d93ed6-0337-46cf-81fa-880bf1981ae7 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:58.367181 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1298/2595] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:15:58 2022] POST /identity/v3/projects => generated 407 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:15:58.372411 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f1cb7-a1e0-4396-b9fc-ca454bda5926 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:58.382629 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f1cb7-a1e0-4396-b9fc-ca454bda5926 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:58.439777 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd5460-8437-4df3-bfdc-bf75e82d2541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:58.440504 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd5460-8437-4df3-bfdc-bf75e82d2541 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:58.440740 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd5460-8437-4df3-bfdc-bf75e82d2541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:58.441024 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd5460-8437-4df3-bfdc-bf75e82d2541 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:58.441741 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd5460-8437-4df3-bfdc-bf75e82d2541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:58.443717 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd5460-8437-4df3-bfdc-bf75e82d2541 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:58.466932 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1298/2596] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:15:58 2022] POST /identity/v3/users => generated 304 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:15:58.468322 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d93ed6-0337-46cf-81fa-880bf1981ae7 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:58.478828 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d93ed6-0337-46cf-81fa-880bf1981ae7 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:58.483404 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d3e9b-2c11-4612-9949-d4e3ff82e573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:58.484148 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d3e9b-2c11-4612-9949-d4e3ff82e573 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:58.484504 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d3e9b-2c11-4612-9949-d4e3ff82e573 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:58.484887 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d3e9b-2c11-4612-9949-d4e3ff82e573 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:58.485602 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d3e9b-2c11-4612-9949-d4e3ff82e573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:58.487172 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d3e9b-2c11-4612-9949-d4e3ff82e573 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:58.498128 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1299/2597] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:15:58.502072 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd5460-8437-4df3-bfdc-bf75e82d2541 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:58.511921 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd5460-8437-4df3-bfdc-bf75e82d2541 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:58.516584 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6802fd-42e8-4b8d-962e-53b79e751532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:58.517306 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6802fd-42e8-4b8d-962e-53b79e751532 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:58.517590 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6802fd-42e8-4b8d-962e-53b79e751532 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:58.517861 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6802fd-42e8-4b8d-962e-53b79e751532 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:58.518575 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6802fd-42e8-4b8d-962e-53b79e751532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:58.520172 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6802fd-42e8-4b8d-962e-53b79e751532 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:58.533278 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1299/2598] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:15:58.534450 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d3e9b-2c11-4612-9949-d4e3ff82e573 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:58.545143 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d3e9b-2c11-4612-9949-d4e3ff82e573 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:58.549767 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdcb65-ad35-4910-814e-6b5698844906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:58.550638 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdcb65-ad35-4910-814e-6b5698844906 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:58.550919 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdcb65-ad35-4910-814e-6b5698844906 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:58.551200 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdcb65-ad35-4910-814e-6b5698844906 admin admin] PATH_INFO: `/v3/projects/03a6fe3a77cc4949b22e1709c624922f/users/aaf021bdf8be4391818888fda7b10a38/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:58.566040 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdcb65-ad35-4910-814e-6b5698844906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a6fe3a77cc4949b22e1709c624922f, user_id=aaf021bdf8be4391818888fda7b10a38, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:58.568695 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdcb65-ad35-4910-814e-6b5698844906 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:58.581333 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1300/2599] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:15:58 2022] PUT /identity/v3/projects/03a6fe3a77cc4949b22e1709c624922f/users/aaf021bdf8be4391818888fda7b10a38/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:58.591611 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f66aea-3519-4db6-a2a3-273226c65458 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:58.591942 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f66aea-3519-4db6-a2a3-273226c65458 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:58.592227 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f66aea-3519-4db6-a2a3-273226c65458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:58.618632 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-d5f66aea-3519-4db6-a2a3-273226c65458 None None] MFA Rules not processed for user `aaf021bdf8be4391818888fda7b10a38`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:58.619863 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-d5f66aea-3519-4db6-a2a3-273226c65458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:58.689728 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1300/2600] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:58 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:15:58.694183 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdcb65-ad35-4910-814e-6b5698844906 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:58.754325 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdcb65-ad35-4910-814e-6b5698844906 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:58.756200 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f66aea-3519-4db6-a2a3-273226c65458 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:58.757537 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-d5f66aea-3519-4db6-a2a3-273226c65458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:58.759578 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fa1b0-96bc-4e2f-abc5-dff7c25ef2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:58.760365 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fa1b0-96bc-4e2f-abc5-dff7c25ef2d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:58.760744 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fa1b0-96bc-4e2f-abc5-dff7c25ef2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:58.761121 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fa1b0-96bc-4e2f-abc5-dff7c25ef2d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:58.761950 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fa1b0-96bc-4e2f-abc5-dff7c25ef2d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:58.763964 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fa1b0-96bc-4e2f-abc5-dff7c25ef2d4 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:58.771423 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f66aea-3519-4db6-a2a3-273226c65458 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:58.776723 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b3f71-e4d6-4efe-8c55-4680bd274a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:58.777665 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b3f71-e4d6-4efe-8c55-4680bd274a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:58.777953 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b3f71-e4d6-4efe-8c55-4680bd274a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:58.778229 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b3f71-e4d6-4efe-8c55-4680bd274a8f admin admin] PATH_INFO: `/v3/users/619372667c56474a854b8ad554a891c9` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:58.779440 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b3f71-e4d6-4efe-8c55-4680bd274a8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=619372667c56474a854b8ad554a891c9)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:58.781412 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b3f71-e4d6-4efe-8c55-4680bd274a8f admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:58.798540 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1301/2601] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:15:58 2022] POST /identity/v3/projects => generated 405 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:15:58.799732 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fa1b0-96bc-4e2f-abc5-dff7c25ef2d4 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:58.857446 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-cf2b3f71-e4d6-4efe-8c55-4680bd274a8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '619372667c56474a854b8ad554a891c9'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:58.864508 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-cf2b3f71-e4d6-4efe-8c55-4680bd274a8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '619372667c56474a854b8ad554a891c9'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:58.868307 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fa1b0-96bc-4e2f-abc5-dff7c25ef2d4 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:58.873645 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-cf2b3f71-e4d6-4efe-8c55-4680bd274a8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '619372667c56474a854b8ad554a891c9'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:58.876625 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3dd9ed-144a-4c91-b035-cf43c60fc012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:58.879262 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3dd9ed-144a-4c91-b035-cf43c60fc012 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:58.879554 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3dd9ed-144a-4c91-b035-cf43c60fc012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:58.879855 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3dd9ed-144a-4c91-b035-cf43c60fc012 admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:58.880548 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3dd9ed-144a-4c91-b035-cf43c60fc012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:58.884525 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3dd9ed-144a-4c91-b035-cf43c60fc012 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:58.894175 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-cf2b3f71-e4d6-4efe-8c55-4680bd274a8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '619372667c56474a854b8ad554a891c9'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:58.895142 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-cf2b3f71-e4d6-4efe-8c55-4680bd274a8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '619372667c56474a854b8ad554a891c9'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:58.907029 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1301/2602] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:15:58 2022] DELETE /identity/v3/users/619372667c56474a854b8ad554a891c9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:58.911121 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1302/2603] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:15:58 2022] POST /identity/v3/users => generated 309 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:15:58.911289 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e061ed-e266-44e5-b957-1c191476f545 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:58.911289 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e061ed-e266-44e5-b957-1c191476f545 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:58.911289 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e061ed-e266-44e5-b957-1c191476f545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:58.913022 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3dd9ed-144a-4c91-b035-cf43c60fc012 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:58.915990 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-0d3dd9ed-144a-4c91-b035-cf43c60fc012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:58.929001 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3dd9ed-144a-4c91-b035-cf43c60fc012 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:58.930501 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-c9e061ed-e266-44e5-b957-1c191476f545 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:58.931917 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-c9e061ed-e266-44e5-b957-1c191476f545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:58.990451 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e2a25-2562-42c2-98d9-9646472a8138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:58.991163 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e2a25-2562-42c2-98d9-9646472a8138 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:58.991401 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1302/2604] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:15:58.994563 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e2a25-2562-42c2-98d9-9646472a8138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:58.994563 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e2a25-2562-42c2-98d9-9646472a8138 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:58.994563 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e2a25-2562-42c2-98d9-9646472a8138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:58.994563 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e2a25-2562-42c2-98d9-9646472a8138 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:59.001487 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e061ed-e266-44e5-b957-1c191476f545 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:59.003162 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-c9e061ed-e266-44e5-b957-1c191476f545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:59.007726 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1303/2605] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:15:59.009755 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e2a25-2562-42c2-98d9-9646472a8138 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:59.020045 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e2a25-2562-42c2-98d9-9646472a8138 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:59.025781 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d5adb-87d5-4fc1-aaba-14112614c463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:59.026876 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d5adb-87d5-4fc1-aaba-14112614c463 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:59.027312 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d5adb-87d5-4fc1-aaba-14112614c463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:59.027807 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d5adb-87d5-4fc1-aaba-14112614c463 admin admin] PATH_INFO: `/v3/projects/ad5944f6ead4479b94616cabe65f2c75/users/9f21dea708b54ee390ea312fd976a22e/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:59.044139 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d5adb-87d5-4fc1-aaba-14112614c463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad5944f6ead4479b94616cabe65f2c75, user_id=9f21dea708b54ee390ea312fd976a22e, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:59.046819 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d5adb-87d5-4fc1-aaba-14112614c463 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:59.063492 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1304/2606] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:15:59 2022] PUT /identity/v3/projects/ad5944f6ead4479b94616cabe65f2c75/users/9f21dea708b54ee390ea312fd976a22e/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:59.070080 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d5adb-87d5-4fc1-aaba-14112614c463 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:59.087913 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e061ed-e266-44e5-b957-1c191476f545 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:59.142578 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d5adb-87d5-4fc1-aaba-14112614c463 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:59.148587 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa788d23-90b9-45b1-bec5-3f8a675354a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:59.149980 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa788d23-90b9-45b1-bec5-3f8a675354a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:59.150334 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa788d23-90b9-45b1-bec5-3f8a675354a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:59.150739 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa788d23-90b9-45b1-bec5-3f8a675354a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:59.151508 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa788d23-90b9-45b1-bec5-3f8a675354a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:59.153238 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa788d23-90b9-45b1-bec5-3f8a675354a1 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:59.161031 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab3dc4-d560-440f-9f79-8f2df78bb604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:59.164458 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab3dc4-d560-440f-9f79-8f2df78bb604 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:59.164744 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab3dc4-d560-440f-9f79-8f2df78bb604 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:59.165022 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab3dc4-d560-440f-9f79-8f2df78bb604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:59.169890 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1305/2607] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:15:59.170926 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa788d23-90b9-45b1-bec5-3f8a675354a1 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:59.179609 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab3dc4-d560-440f-9f79-8f2df78bb604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:59.181199 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab3dc4-d560-440f-9f79-8f2df78bb604 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:59.183545 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa788d23-90b9-45b1-bec5-3f8a675354a1 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:59.190209 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d02da-6f37-4de7-b445-1c4e1159c59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:59.191242 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d02da-6f37-4de7-b445-1c4e1159c59b admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:59.191522 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d02da-6f37-4de7-b445-1c4e1159c59b admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:59.191830 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d02da-6f37-4de7-b445-1c4e1159c59b admin admin] PATH_INFO: `/v3/projects/ad5944f6ead4479b94616cabe65f2c75/users/9f21dea708b54ee390ea312fd976a22e/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:59.193996 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d02da-6f37-4de7-b445-1c4e1159c59b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad5944f6ead4479b94616cabe65f2c75, user_id=9f21dea708b54ee390ea312fd976a22e, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:59.195067 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1303/2608] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:15:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:15:59.198622 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d02da-6f37-4de7-b445-1c4e1159c59b admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:59.215766 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1306/2609] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:15:59 2022] PUT /identity/v3/projects/ad5944f6ead4479b94616cabe65f2c75/users/9f21dea708b54ee390ea312fd976a22e/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:59.225106 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5e1c6-92c4-4fdc-a4fd-13ef9b724a9c None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:59.225581 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5e1c6-92c4-4fdc-a4fd-13ef9b724a9c None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:59.226424 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5e1c6-92c4-4fdc-a4fd-13ef9b724a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:59.259782 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-a1c5e1c6-92c4-4fdc-a4fd-13ef9b724a9c None None] MFA Rules not processed for user `9f21dea708b54ee390ea312fd976a22e`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:15:59.260933 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-a1c5e1c6-92c4-4fdc-a4fd-13ef9b724a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:59.348420 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1304/2610] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:15:59 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:15:59.360258 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d02da-6f37-4de7-b445-1c4e1159c59b admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:59.362039 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-640d02da-6f37-4de7-b445-1c4e1159c59b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:59.474042 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d02da-6f37-4de7-b445-1c4e1159c59b admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:59.477015 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa19bf-501a-40d2-8e1b-f804e8590d9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:59.477015 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa19bf-501a-40d2-8e1b-f804e8590d9b service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:59.477575 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa19bf-501a-40d2-8e1b-f804e8590d9b service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:59.477778 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa19bf-501a-40d2-8e1b-f804e8590d9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:59.488043 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa19bf-501a-40d2-8e1b-f804e8590d9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:59.489567 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa19bf-501a-40d2-8e1b-f804e8590d9b service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:59.500672 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1307/2611] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:15:59 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:15:59.542678 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5e1c6-92c4-4fdc-a4fd-13ef9b724a9c None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:59.544780 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-a1c5e1c6-92c4-4fdc-a4fd-13ef9b724a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:59.616547 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5e1c6-92c4-4fdc-a4fd-13ef9b724a9c None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:59.622139 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535d215-051e-4978-8269-f4e89906e74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:59.623113 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535d215-051e-4978-8269-f4e89906e74a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:59.623487 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535d215-051e-4978-8269-f4e89906e74a admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:59.623712 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535d215-051e-4978-8269-f4e89906e74a admin admin] PATH_INFO: `/v3/projects/1921d2bc4fba46eabe48c4162cfdeb1f` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:59.624905 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535d215-051e-4978-8269-f4e89906e74a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1921d2bc4fba46eabe48c4162cfdeb1f)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:59.626924 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535d215-051e-4978-8269-f4e89906e74a admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:59.668467 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa19bf-501a-40d2-8e1b-f804e8590d9b service cinder] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:59.678455 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa19bf-501a-40d2-8e1b-f804e8590d9b service cinder] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:59.682008 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-6535d215-051e-4978-8269-f4e89906e74a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1921d2bc4fba46eabe48c4162cfdeb1f', 'request_id': 'req-6535d215-051e-4978-8269-f4e89906e74a'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:59.692900 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-6535d215-051e-4978-8269-f4e89906e74a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1921d2bc4fba46eabe48c4162cfdeb1f', 'request_id': 'req-6535d215-051e-4978-8269-f4e89906e74a'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:59.701875 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-6535d215-051e-4978-8269-f4e89906e74a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1921d2bc4fba46eabe48c4162cfdeb1f', 'request_id': 'req-6535d215-051e-4978-8269-f4e89906e74a'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:59.715214 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-6535d215-051e-4978-8269-f4e89906e74a admin admin] The token cache is being invalidate because project 1921d2bc4fba46eabe48c4162cfdeb1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:15:59.715838 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-6535d215-051e-4978-8269-f4e89906e74a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:59.716479 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-6535d215-051e-4978-8269-f4e89906e74a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:59.718560 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1305/2612] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:15:59 2022] DELETE /identity/v3/projects/1921d2bc4fba46eabe48c4162cfdeb1f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:15:59.722291 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535d215-051e-4978-8269-f4e89906e74a admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:15:59.724789 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-6535d215-051e-4978-8269-f4e89906e74a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:59.740204 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83707b-611b-4dfa-bc03-95eccf72937f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:59.741231 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83707b-611b-4dfa-bc03-95eccf72937f service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:59.741499 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83707b-611b-4dfa-bc03-95eccf72937f service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:59.741780 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83707b-611b-4dfa-bc03-95eccf72937f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:59.745086 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-0b83707b-611b-4dfa-bc03-95eccf72937f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:15:59.797422 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535d215-051e-4978-8269-f4e89906e74a admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:15:59.805758 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a545d-a43e-469f-a803-f3cea077b69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:15:59.806736 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a545d-a43e-469f-a803-f3cea077b69b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:15:59.807666 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a545d-a43e-469f-a803-f3cea077b69b admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:15:59.808299 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a545d-a43e-469f-a803-f3cea077b69b admin admin] PATH_INFO: `/v3/users/7b1fca81b63d4aa9b9e6bfad24385521` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:15:59.809383 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83707b-611b-4dfa-bc03-95eccf72937f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:59.809877 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a545d-a43e-469f-a803-f3cea077b69b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b1fca81b63d4aa9b9e6bfad24385521)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:15:59.811513 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83707b-611b-4dfa-bc03-95eccf72937f service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:59.820991 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1308/2613] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:15:59 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:15:59.824386 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a545d-a43e-469f-a803-f3cea077b69b admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:15:59.917581 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-364a545d-a43e-469f-a803-f3cea077b69b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b1fca81b63d4aa9b9e6bfad24385521'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:59.932821 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-364a545d-a43e-469f-a803-f3cea077b69b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b1fca81b63d4aa9b9e6bfad24385521'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:59.945796 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-364a545d-a43e-469f-a803-f3cea077b69b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b1fca81b63d4aa9b9e6bfad24385521'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:59.959831 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-364a545d-a43e-469f-a803-f3cea077b69b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b1fca81b63d4aa9b9e6bfad24385521'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:59.961404 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-364a545d-a43e-469f-a803-f3cea077b69b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b1fca81b63d4aa9b9e6bfad24385521'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:15:59.970562 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1306/2614] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:15:59 2022] DELETE /identity/v3/users/7b1fca81b63d4aa9b9e6bfad24385521 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:16:00.348111 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83707b-611b-4dfa-bc03-95eccf72937f service cinder] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:00.361512 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83707b-611b-4dfa-bc03-95eccf72937f service cinder] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:00.456026 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782b71f-e2fd-4027-8edd-f09f7a87ea23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:00.456984 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782b71f-e2fd-4027-8edd-f09f7a87ea23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:00.457754 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782b71f-e2fd-4027-8edd-f09f7a87ea23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:00.457754 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782b71f-e2fd-4027-8edd-f09f7a87ea23 admin admin] PATH_INFO: `/v3/projects/b87540b5ea1d452caf6077d189492152` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:00.459107 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782b71f-e2fd-4027-8edd-f09f7a87ea23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b87540b5ea1d452caf6077d189492152)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:00.464967 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782b71f-e2fd-4027-8edd-f09f7a87ea23 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:00.520226 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-a782b71f-e2fd-4027-8edd-f09f7a87ea23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b87540b5ea1d452caf6077d189492152', 'request_id': 'req-a782b71f-e2fd-4027-8edd-f09f7a87ea23'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:00.528038 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-a782b71f-e2fd-4027-8edd-f09f7a87ea23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b87540b5ea1d452caf6077d189492152', 'request_id': 'req-a782b71f-e2fd-4027-8edd-f09f7a87ea23'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:00.534742 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-a782b71f-e2fd-4027-8edd-f09f7a87ea23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b87540b5ea1d452caf6077d189492152', 'request_id': 'req-a782b71f-e2fd-4027-8edd-f09f7a87ea23'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:00.553487 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-a782b71f-e2fd-4027-8edd-f09f7a87ea23 admin admin] The token cache is being invalidate because project b87540b5ea1d452caf6077d189492152 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:16:00.553897 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-a782b71f-e2fd-4027-8edd-f09f7a87ea23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:00.554696 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-a782b71f-e2fd-4027-8edd-f09f7a87ea23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:00.560488 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1309/2615] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:16:00 2022] DELETE /identity/v3/projects/b87540b5ea1d452caf6077d189492152 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:00.562318 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e0e73-f534-42c4-ba59-87907e5891cb None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:00.562877 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e0e73-f534-42c4-ba59-87907e5891cb None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:00.563634 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e0e73-f534-42c4-ba59-87907e5891cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:00.584229 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-336e0e73-f534-42c4-ba59-87907e5891cb None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:00.585774 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-336e0e73-f534-42c4-ba59-87907e5891cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:00.659088 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1307/2616] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:00.668298 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648709a3-5f27-4f66-a716-edd3fff20594 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:00.668822 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648709a3-5f27-4f66-a716-edd3fff20594 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:00.669207 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648709a3-5f27-4f66-a716-edd3fff20594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:00.706441 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e0e73-f534-42c4-ba59-87907e5891cb None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:00.708078 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-336e0e73-f534-42c4-ba59-87907e5891cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:00.716047 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-648709a3-5f27-4f66-a716-edd3fff20594 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:00.717506 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-648709a3-5f27-4f66-a716-edd3fff20594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:00.723126 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e0e73-f534-42c4-ba59-87907e5891cb None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:00.729500 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1310/2617] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:00.731807 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8aa4d-b73a-46a3-9dec-c150a338432c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:00.732705 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8aa4d-b73a-46a3-9dec-c150a338432c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:00.733009 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8aa4d-b73a-46a3-9dec-c150a338432c admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:00.733303 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8aa4d-b73a-46a3-9dec-c150a338432c admin admin] PATH_INFO: `/v3/users/382fc34b389c4338b8e9fcae2b4d89e3` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:00.733898 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648709a3-5f27-4f66-a716-edd3fff20594 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:00.734775 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8aa4d-b73a-46a3-9dec-c150a338432c admin admin] RBAC: Authorizing `identity:delete_user(user_id=382fc34b389c4338b8e9fcae2b4d89e3)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:00.736747 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8aa4d-b73a-46a3-9dec-c150a338432c admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:00.744062 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648709a3-5f27-4f66-a716-edd3fff20594 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:00.748989 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a251fe-9140-4448-ad41-75e117a18847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:00.749770 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a251fe-9140-4448-ad41-75e117a18847 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:00.750124 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a251fe-9140-4448-ad41-75e117a18847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:00.750405 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a251fe-9140-4448-ad41-75e117a18847 admin admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:00.751128 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a251fe-9140-4448-ad41-75e117a18847 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:16:00.751435 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a251fe-9140-4448-ad41-75e117a18847 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:00.753215 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a251fe-9140-4448-ad41-75e117a18847 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:00.768911 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1311/2618] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 04:16:00.770646 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a251fe-9140-4448-ad41-75e117a18847 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:00.780733 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a251fe-9140-4448-ad41-75e117a18847 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:00.785454 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baade90b-894e-4ca4-bede-f14a67d1342f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:00.785734 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-f1b8aa4d-b73a-46a3-9dec-c150a338432c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '382fc34b389c4338b8e9fcae2b4d89e3'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:00.786265 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baade90b-894e-4ca4-bede-f14a67d1342f admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:00.786621 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baade90b-894e-4ca4-bede-f14a67d1342f admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:00.786899 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baade90b-894e-4ca4-bede-f14a67d1342f admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:00.787670 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baade90b-894e-4ca4-bede-f14a67d1342f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:00.790159 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baade90b-894e-4ca4-bede-f14a67d1342f admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:00.793161 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-f1b8aa4d-b73a-46a3-9dec-c150a338432c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '382fc34b389c4338b8e9fcae2b4d89e3'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:00.800525 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-f1b8aa4d-b73a-46a3-9dec-c150a338432c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '382fc34b389c4338b8e9fcae2b4d89e3'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:00.813918 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-f1b8aa4d-b73a-46a3-9dec-c150a338432c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '382fc34b389c4338b8e9fcae2b4d89e3'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:00.814578 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-f1b8aa4d-b73a-46a3-9dec-c150a338432c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '382fc34b389c4338b8e9fcae2b4d89e3'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:00.816610 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1312/2619] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:16:00 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:16:00.820777 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1308/2620] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:16:00 2022] DELETE /identity/v3/users/382fc34b389c4338b8e9fcae2b4d89e3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:16:00.824682 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baade90b-894e-4ca4-bede-f14a67d1342f admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:00.827033 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-baade90b-894e-4ca4-bede-f14a67d1342f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:00.890702 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baade90b-894e-4ca4-bede-f14a67d1342f admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:00.944956 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742af40-4789-4079-8a00-e413fa1d0015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:00.945770 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742af40-4789-4079-8a00-e413fa1d0015 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:00.945997 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742af40-4789-4079-8a00-e413fa1d0015 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:00.946271 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742af40-4789-4079-8a00-e413fa1d0015 admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:00.946956 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742af40-4789-4079-8a00-e413fa1d0015 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:00.948916 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742af40-4789-4079-8a00-e413fa1d0015 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:00.969356 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1313/2621] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:16:00 2022] POST /identity/v3/users => generated 288 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:16:00.973784 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8aa4d-b73a-46a3-9dec-c150a338432c admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:00.984431 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8aa4d-b73a-46a3-9dec-c150a338432c admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:00.989352 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ef64a-1dbf-47b9-8951-dad7e13b2760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:00.990195 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ef64a-1dbf-47b9-8951-dad7e13b2760 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:00.990543 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ef64a-1dbf-47b9-8951-dad7e13b2760 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:00.990837 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ef64a-1dbf-47b9-8951-dad7e13b2760 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:00.991559 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ef64a-1dbf-47b9-8951-dad7e13b2760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:00.994086 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ef64a-1dbf-47b9-8951-dad7e13b2760 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:01.000726 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742af40-4789-4079-8a00-e413fa1d0015 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:01.004714 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-2742af40-4789-4079-8a00-e413fa1d0015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:01.007903 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1309/2622] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:16:01.010022 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ef64a-1dbf-47b9-8951-dad7e13b2760 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:01.017688 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742af40-4789-4079-8a00-e413fa1d0015 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:01.020385 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ef64a-1dbf-47b9-8951-dad7e13b2760 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:01.022675 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135527f-261c-45a5-a23b-18b282c8c69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:01.023528 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135527f-261c-45a5-a23b-18b282c8c69d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:01.023881 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135527f-261c-45a5-a23b-18b282c8c69d admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:01.024164 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135527f-261c-45a5-a23b-18b282c8c69d admin admin] PATH_INFO: `/v3/projects/1043931780a941138b2c0a8bd33e3723` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:01.025412 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308703d0-67aa-45a1-abe6-d541d260ce28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:01.025550 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135527f-261c-45a5-a23b-18b282c8c69d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1043931780a941138b2c0a8bd33e3723)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:01.026093 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308703d0-67aa-45a1-abe6-d541d260ce28 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:01.026350 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308703d0-67aa-45a1-abe6-d541d260ce28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:01.026625 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308703d0-67aa-45a1-abe6-d541d260ce28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:01.027739 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135527f-261c-45a5-a23b-18b282c8c69d admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:01.027948 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308703d0-67aa-45a1-abe6-d541d260ce28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:01.029547 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308703d0-67aa-45a1-abe6-d541d260ce28 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:01.040559 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1310/2623] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:16:01.044841 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308703d0-67aa-45a1-abe6-d541d260ce28 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:01.054758 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308703d0-67aa-45a1-abe6-d541d260ce28 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:01.061055 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d4192-01e4-4454-9f2b-f78e2e05a7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:01.061977 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d4192-01e4-4454-9f2b-f78e2e05a7f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:01.062258 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d4192-01e4-4454-9f2b-f78e2e05a7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:01.062532 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d4192-01e4-4454-9f2b-f78e2e05a7f7 admin admin] PATH_INFO: `/v3/projects/77ce5a9883514b709d5a9294f2b27356/users/a8051c58ae09469b85b52ec73cfd12f1/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:01.076651 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b135527f-261c-45a5-a23b-18b282c8c69d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1043931780a941138b2c0a8bd33e3723', 'request_id': 'req-b135527f-261c-45a5-a23b-18b282c8c69d'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:01.079646 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d4192-01e4-4454-9f2b-f78e2e05a7f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77ce5a9883514b709d5a9294f2b27356, user_id=a8051c58ae09469b85b52ec73cfd12f1, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:01.082044 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b135527f-261c-45a5-a23b-18b282c8c69d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1043931780a941138b2c0a8bd33e3723', 'request_id': 'req-b135527f-261c-45a5-a23b-18b282c8c69d'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:01.082394 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d4192-01e4-4454-9f2b-f78e2e05a7f7 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:01.088791 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b135527f-261c-45a5-a23b-18b282c8c69d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1043931780a941138b2c0a8bd33e3723', 'request_id': 'req-b135527f-261c-45a5-a23b-18b282c8c69d'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:01.097329 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1311/2624] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:16:01 2022] PUT /identity/v3/projects/77ce5a9883514b709d5a9294f2b27356/users/a8051c58ae09469b85b52ec73cfd12f1/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:16:01.102212 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b135527f-261c-45a5-a23b-18b282c8c69d admin admin] The token cache is being invalidate because project 1043931780a941138b2c0a8bd33e3723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:16:01.102506 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b135527f-261c-45a5-a23b-18b282c8c69d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:01.103170 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b135527f-261c-45a5-a23b-18b282c8c69d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:01.104733 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1314/2625] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:16:00 2022] DELETE /identity/v3/projects/1043931780a941138b2c0a8bd33e3723 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:01.108724 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc951fe5-61ab-43c0-9aca-e6b6ee5b7a4a None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:01.109016 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc951fe5-61ab-43c0-9aca-e6b6ee5b7a4a None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:01.109286 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc951fe5-61ab-43c0-9aca-e6b6ee5b7a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:01.109426 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7442c0b-92e0-4e6c-a43d-eb7021aa1a7d None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:01.109713 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7442c0b-92e0-4e6c-a43d-eb7021aa1a7d None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:01.111872 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7442c0b-92e0-4e6c-a43d-eb7021aa1a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:01.129427 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-a7442c0b-92e0-4e6c-a43d-eb7021aa1a7d None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:01.130636 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-a7442c0b-92e0-4e6c-a43d-eb7021aa1a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:01.136577 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-fc951fe5-61ab-43c0-9aca-e6b6ee5b7a4a None None] MFA Rules not processed for user `a8051c58ae09469b85b52ec73cfd12f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:01.137741 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-fc951fe5-61ab-43c0-9aca-e6b6ee5b7a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:01.187382 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1315/2626] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:01.195314 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37100f-0c88-4982-b658-eeaee7ea54fd None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:01.196195 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37100f-0c88-4982-b658-eeaee7ea54fd None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:01.196486 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37100f-0c88-4982-b658-eeaee7ea54fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:01.200205 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1312/2627] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:01.211278 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc951fe5-61ab-43c0-9aca-e6b6ee5b7a4a None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:01.212618 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-fc951fe5-61ab-43c0-9aca-e6b6ee5b7a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:01.213904 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-3c37100f-0c88-4982-b658-eeaee7ea54fd None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:01.215062 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-3c37100f-0c88-4982-b658-eeaee7ea54fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:01.222958 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1316/2628] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:16:01.226995 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37100f-0c88-4982-b658-eeaee7ea54fd None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:01.235631 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37100f-0c88-4982-b658-eeaee7ea54fd None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:01.240346 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae4466-be1f-4f87-ad99-63034f1f106f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:01.240980 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae4466-be1f-4f87-ad99-63034f1f106f admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:01.241710 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae4466-be1f-4f87-ad99-63034f1f106f admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:01.241710 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae4466-be1f-4f87-ad99-63034f1f106f admin admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:01.242877 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae4466-be1f-4f87-ad99-63034f1f106f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:16:01.243186 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae4466-be1f-4f87-ad99-63034f1f106f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:01.245005 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae4466-be1f-4f87-ad99-63034f1f106f admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:01.256269 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1317/2629] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 04:16:01.260754 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae4466-be1f-4f87-ad99-63034f1f106f admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:01.269984 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae4466-be1f-4f87-ad99-63034f1f106f admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:01.270142 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc951fe5-61ab-43c0-9aca-e6b6ee5b7a4a None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:01.273701 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2fd34-9f4b-4533-a56a-48f71c34437b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:01.274364 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2fd34-9f4b-4533-a56a-48f71c34437b service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:01.274611 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2fd34-9f4b-4533-a56a-48f71c34437b service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:01.274724 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809c774-41d2-4b98-97d1-eed9257e46da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:01.274885 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2fd34-9f4b-4533-a56a-48f71c34437b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:01.275333 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809c774-41d2-4b98-97d1-eed9257e46da admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:01.275628 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809c774-41d2-4b98-97d1-eed9257e46da admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:01.275944 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809c774-41d2-4b98-97d1-eed9257e46da admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:01.276628 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809c774-41d2-4b98-97d1-eed9257e46da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:01.278491 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809c774-41d2-4b98-97d1-eed9257e46da admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:01.283384 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2fd34-9f4b-4533-a56a-48f71c34437b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:01.284836 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2fd34-9f4b-4533-a56a-48f71c34437b service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:01.297733 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1313/2630] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:16:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:16:01.311013 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1318/2631] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:16:01 2022] POST /identity/v3/projects => generated 403 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:16:01.312158 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2fd34-9f4b-4533-a56a-48f71c34437b service cinder] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:01.323851 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2fd34-9f4b-4533-a56a-48f71c34437b service cinder] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:01.400958 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ab41e-4da4-44ef-9ca1-602bac7094e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:01.401881 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ab41e-4da4-44ef-9ca1-602bac7094e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:01.402319 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ab41e-4da4-44ef-9ca1-602bac7094e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:01.402656 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ab41e-4da4-44ef-9ca1-602bac7094e8 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:01.403510 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ab41e-4da4-44ef-9ca1-602bac7094e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:01.406336 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ab41e-4da4-44ef-9ca1-602bac7094e8 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:01.433320 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1314/2632] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:16:01 2022] POST /identity/v3/users => generated 302 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:16:01.436676 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809c774-41d2-4b98-97d1-eed9257e46da admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:01.451503 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809c774-41d2-4b98-97d1-eed9257e46da admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:01.459996 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6070f67-cb6e-4cdf-bb32-a2ad6c241c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:01.461063 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6070f67-cb6e-4cdf-bb32-a2ad6c241c0a admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:01.461778 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6070f67-cb6e-4cdf-bb32-a2ad6c241c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:01.462463 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6070f67-cb6e-4cdf-bb32-a2ad6c241c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:01.463793 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6070f67-cb6e-4cdf-bb32-a2ad6c241c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:01.467739 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6070f67-cb6e-4cdf-bb32-a2ad6c241c0a admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:01.485394 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1319/2633] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:16:01.489650 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ab41e-4da4-44ef-9ca1-602bac7094e8 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:01.505746 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ab41e-4da4-44ef-9ca1-602bac7094e8 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:01.512730 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57647450-7330-4459-955f-282a41f95908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:01.513774 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57647450-7330-4459-955f-282a41f95908 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:01.514022 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57647450-7330-4459-955f-282a41f95908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:01.514361 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57647450-7330-4459-955f-282a41f95908 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:01.519040 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57647450-7330-4459-955f-282a41f95908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:01.519040 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57647450-7330-4459-955f-282a41f95908 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:01.529591 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1315/2634] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:16:01.534009 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6070f67-cb6e-4cdf-bb32-a2ad6c241c0a admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:01.544685 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6070f67-cb6e-4cdf-bb32-a2ad6c241c0a admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:01.549614 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5185dd-4225-4f0d-a2b8-2fc464080ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:01.550520 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5185dd-4225-4f0d-a2b8-2fc464080ce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:01.550816 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5185dd-4225-4f0d-a2b8-2fc464080ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:01.551153 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5185dd-4225-4f0d-a2b8-2fc464080ce7 admin admin] PATH_INFO: `/v3/projects/218f3bb981b840eb9a458797ab8aa487/users/5d124211fc494377a7e0a21e8e28a19e/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:01.567293 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5185dd-4225-4f0d-a2b8-2fc464080ce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=218f3bb981b840eb9a458797ab8aa487, user_id=5d124211fc494377a7e0a21e8e28a19e, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:01.570120 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5185dd-4225-4f0d-a2b8-2fc464080ce7 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:01.583060 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1320/2635] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:16:01 2022] PUT /identity/v3/projects/218f3bb981b840eb9a458797ab8aa487/users/5d124211fc494377a7e0a21e8e28a19e/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:01.588913 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b39858-e06a-4e24-812e-bc42b77755d3 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:01.589391 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b39858-e06a-4e24-812e-bc42b77755d3 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:01.589506 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b39858-e06a-4e24-812e-bc42b77755d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:01.606995 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-c6b39858-e06a-4e24-812e-bc42b77755d3 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:01.608120 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-c6b39858-e06a-4e24-812e-bc42b77755d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:01.674234 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1316/2636] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:16:01.684399 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5185dd-4225-4f0d-a2b8-2fc464080ce7 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:01.686395 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-3c5185dd-4225-4f0d-a2b8-2fc464080ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:01.750525 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5185dd-4225-4f0d-a2b8-2fc464080ce7 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:01.754212 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f20c0-59de-4538-8815-5b8bcc0566f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:01.754857 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f20c0-59de-4538-8815-5b8bcc0566f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:01.755148 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f20c0-59de-4538-8815-5b8bcc0566f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:01.755474 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f20c0-59de-4538-8815-5b8bcc0566f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:01.765125 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f20c0-59de-4538-8815-5b8bcc0566f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:01.766582 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f20c0-59de-4538-8815-5b8bcc0566f0 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:01.775952 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1321/2637] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:16:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:16:02.341067 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a890854-3371-4ad2-9857-8638f86e2804 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:02.341540 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a890854-3371-4ad2-9857-8638f86e2804 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:02.341851 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a890854-3371-4ad2-9857-8638f86e2804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:02.368865 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-9a890854-3371-4ad2-9857-8638f86e2804 None None] MFA Rules not processed for user `5d124211fc494377a7e0a21e8e28a19e`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:02.370088 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-9a890854-3371-4ad2-9857-8638f86e2804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:02.433164 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1317/2638] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:02.437635 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f20c0-59de-4538-8815-5b8bcc0566f0 service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:02.447648 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f20c0-59de-4538-8815-5b8bcc0566f0 service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:02.452258 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472cdfda-1a31-424e-be97-21a756c6da43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:02.452927 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cdfda-1a31-424e-be97-21a756c6da43 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:02.453211 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cdfda-1a31-424e-be97-21a756c6da43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:02.453487 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cdfda-1a31-424e-be97-21a756c6da43 admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:02.454198 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472cdfda-1a31-424e-be97-21a756c6da43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:02.456130 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472cdfda-1a31-424e-be97-21a756c6da43 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:02.485489 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1322/2639] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:16:02 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:16:02.489583 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a890854-3371-4ad2-9857-8638f86e2804 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:02.500436 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a890854-3371-4ad2-9857-8638f86e2804 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:02.558843 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64936bfe-befb-4151-b64f-603beae7070a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:02.559516 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64936bfe-befb-4151-b64f-603beae7070a admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:02.559828 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64936bfe-befb-4151-b64f-603beae7070a admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:02.560108 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64936bfe-befb-4151-b64f-603beae7070a admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:02.560810 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64936bfe-befb-4151-b64f-603beae7070a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:02.562707 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64936bfe-befb-4151-b64f-603beae7070a admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:02.585790 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1318/2640] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:16:02 2022] POST /identity/v3/users => generated 309 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:16:02.587773 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472cdfda-1a31-424e-be97-21a756c6da43 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:02.597752 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472cdfda-1a31-424e-be97-21a756c6da43 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:02.602909 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa249756-a035-4822-a059-12b1db0559ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:02.603561 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa249756-a035-4822-a059-12b1db0559ff admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:02.603891 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa249756-a035-4822-a059-12b1db0559ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:02.604169 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa249756-a035-4822-a059-12b1db0559ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:02.604888 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa249756-a035-4822-a059-12b1db0559ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:02.606531 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa249756-a035-4822-a059-12b1db0559ff admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:02.616808 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1323/2641] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:16:02.620945 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64936bfe-befb-4151-b64f-603beae7070a admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:02.630961 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64936bfe-befb-4151-b64f-603beae7070a admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:02.635774 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636f0e3-6f81-4b51-8b8a-a082fc7ca58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:02.636691 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636f0e3-6f81-4b51-8b8a-a082fc7ca58d admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:02.637002 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636f0e3-6f81-4b51-8b8a-a082fc7ca58d admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:02.637634 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636f0e3-6f81-4b51-8b8a-a082fc7ca58d admin admin] PATH_INFO: `/v3/projects/f7cb7e6d3e784708b69f8e90fd9fc521/users/6e38b20752e542379484a3502eb0bbd5/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:02.653493 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636f0e3-6f81-4b51-8b8a-a082fc7ca58d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7cb7e6d3e784708b69f8e90fd9fc521, user_id=6e38b20752e542379484a3502eb0bbd5, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:02.656255 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636f0e3-6f81-4b51-8b8a-a082fc7ca58d admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:02.672061 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1319/2642] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:16:02 2022] PUT /identity/v3/projects/f7cb7e6d3e784708b69f8e90fd9fc521/users/6e38b20752e542379484a3502eb0bbd5/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:16:02.676175 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa249756-a035-4822-a059-12b1db0559ff admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:02.685845 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa249756-a035-4822-a059-12b1db0559ff admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:02.740001 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7212e5-6408-437f-9806-f834a0cc8f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:02.740702 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7212e5-6408-437f-9806-f834a0cc8f19 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:02.740988 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7212e5-6408-437f-9806-f834a0cc8f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:02.741440 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7212e5-6408-437f-9806-f834a0cc8f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:02.742076 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7212e5-6408-437f-9806-f834a0cc8f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:02.743893 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7212e5-6408-437f-9806-f834a0cc8f19 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:02.753698 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1324/2643] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:16:02.757804 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636f0e3-6f81-4b51-8b8a-a082fc7ca58d admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:02.768117 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636f0e3-6f81-4b51-8b8a-a082fc7ca58d admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:02.772572 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f85cc-2112-4c80-a07c-4d5d02b1770c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:02.773434 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f85cc-2112-4c80-a07c-4d5d02b1770c admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:02.774271 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f85cc-2112-4c80-a07c-4d5d02b1770c admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:02.774548 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f85cc-2112-4c80-a07c-4d5d02b1770c admin admin] PATH_INFO: `/v3/projects/f7cb7e6d3e784708b69f8e90fd9fc521/users/6e38b20752e542379484a3502eb0bbd5/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:02.776500 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f85cc-2112-4c80-a07c-4d5d02b1770c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7cb7e6d3e784708b69f8e90fd9fc521, user_id=6e38b20752e542379484a3502eb0bbd5, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:02.779090 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f85cc-2112-4c80-a07c-4d5d02b1770c admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:02.788867 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1320/2644] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:16:02 2022] PUT /identity/v3/projects/f7cb7e6d3e784708b69f8e90fd9fc521/users/6e38b20752e542379484a3502eb0bbd5/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:16:03.606464 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd06f6d-4b21-4b53-a846-e9df6d10cd4c None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:03.607028 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd06f6d-4b21-4b53-a846-e9df6d10cd4c None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:03.607028 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd06f6d-4b21-4b53-a846-e9df6d10cd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:03.634115 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-8dd06f6d-4b21-4b53-a846-e9df6d10cd4c None None] MFA Rules not processed for user `6e38b20752e542379484a3502eb0bbd5`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:03.635325 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-8dd06f6d-4b21-4b53-a846-e9df6d10cd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:03.703510 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1325/2645] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:03 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:04.667308 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f85cc-2112-4c80-a07c-4d5d02b1770c admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:04.729361 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f85cc-2112-4c80-a07c-4d5d02b1770c admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:04.733885 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a3a0e-91a6-48d2-a083-fe9d254d72f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:04.734743 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a3a0e-91a6-48d2-a083-fe9d254d72f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:04.735024 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a3a0e-91a6-48d2-a083-fe9d254d72f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:04.735295 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a3a0e-91a6-48d2-a083-fe9d254d72f8 admin admin] PATH_INFO: `/v3/users/5d124211fc494377a7e0a21e8e28a19e` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:04.736545 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a3a0e-91a6-48d2-a083-fe9d254d72f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d124211fc494377a7e0a21e8e28a19e)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:04.738448 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a3a0e-91a6-48d2-a083-fe9d254d72f8 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:04.784418 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-715a3a0e-91a6-48d2-a083-fe9d254d72f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d124211fc494377a7e0a21e8e28a19e'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:04.790990 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-715a3a0e-91a6-48d2-a083-fe9d254d72f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d124211fc494377a7e0a21e8e28a19e'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:04.798797 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-715a3a0e-91a6-48d2-a083-fe9d254d72f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d124211fc494377a7e0a21e8e28a19e'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:04.814479 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-715a3a0e-91a6-48d2-a083-fe9d254d72f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d124211fc494377a7e0a21e8e28a19e'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:04.815194 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-715a3a0e-91a6-48d2-a083-fe9d254d72f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d124211fc494377a7e0a21e8e28a19e'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:04.822386 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1321/2646] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:16:04 2022] DELETE /identity/v3/users/5d124211fc494377a7e0a21e8e28a19e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:05.015839 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd06f6d-4b21-4b53-a846-e9df6d10cd4c None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:05.035575 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd06f6d-4b21-4b53-a846-e9df6d10cd4c None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:05.106955 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093c10f-4c3c-40b3-9d94-f62512c58faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:05.107854 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093c10f-4c3c-40b3-9d94-f62512c58faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:05.108191 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093c10f-4c3c-40b3-9d94-f62512c58faf admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:05.108435 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093c10f-4c3c-40b3-9d94-f62512c58faf admin admin] PATH_INFO: `/v3/projects/218f3bb981b840eb9a458797ab8aa487` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:05.109713 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093c10f-4c3c-40b3-9d94-f62512c58faf admin admin] RBAC: Authorizing `identity:delete_project(project_id=218f3bb981b840eb9a458797ab8aa487)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:05.111549 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093c10f-4c3c-40b3-9d94-f62512c58faf admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:05.164676 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-e093c10f-4c3c-40b3-9d94-f62512c58faf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '218f3bb981b840eb9a458797ab8aa487', 'request_id': 'req-e093c10f-4c3c-40b3-9d94-f62512c58faf'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:05.170824 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-e093c10f-4c3c-40b3-9d94-f62512c58faf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '218f3bb981b840eb9a458797ab8aa487', 'request_id': 'req-e093c10f-4c3c-40b3-9d94-f62512c58faf'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:05.177644 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-e093c10f-4c3c-40b3-9d94-f62512c58faf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '218f3bb981b840eb9a458797ab8aa487', 'request_id': 'req-e093c10f-4c3c-40b3-9d94-f62512c58faf'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:05.192027 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-e093c10f-4c3c-40b3-9d94-f62512c58faf admin admin] The token cache is being invalidate because project 218f3bb981b840eb9a458797ab8aa487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:16:05.192321 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-e093c10f-4c3c-40b3-9d94-f62512c58faf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:05.193235 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-e093c10f-4c3c-40b3-9d94-f62512c58faf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:05.194977 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1326/2647] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:16:05 2022] DELETE /identity/v3/projects/218f3bb981b840eb9a458797ab8aa487 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:05.198899 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a3a0e-91a6-48d2-a083-fe9d254d72f8 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:05.202258 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-715a3a0e-91a6-48d2-a083-fe9d254d72f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:05.213204 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a3a0e-91a6-48d2-a083-fe9d254d72f8 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:05.268514 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c14e69-d6ed-4c30-9928-3f3a7a4bef39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:05.269384 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c14e69-d6ed-4c30-9928-3f3a7a4bef39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:05.269669 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c14e69-d6ed-4c30-9928-3f3a7a4bef39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:05.269955 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c14e69-d6ed-4c30-9928-3f3a7a4bef39 admin admin] PATH_INFO: `/v3/users/6e38b20752e542379484a3502eb0bbd5` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:05.271108 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c14e69-d6ed-4c30-9928-3f3a7a4bef39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e38b20752e542379484a3502eb0bbd5)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:05.273041 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c14e69-d6ed-4c30-9928-3f3a7a4bef39 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:05.318172 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-30c14e69-d6ed-4c30-9928-3f3a7a4bef39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e38b20752e542379484a3502eb0bbd5'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:05.324564 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-30c14e69-d6ed-4c30-9928-3f3a7a4bef39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e38b20752e542379484a3502eb0bbd5'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:05.331914 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-30c14e69-d6ed-4c30-9928-3f3a7a4bef39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e38b20752e542379484a3502eb0bbd5'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:05.343235 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-30c14e69-d6ed-4c30-9928-3f3a7a4bef39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e38b20752e542379484a3502eb0bbd5'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:05.343889 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-30c14e69-d6ed-4c30-9928-3f3a7a4bef39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e38b20752e542379484a3502eb0bbd5'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:05.349526 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1322/2648] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:16:05 2022] DELETE /identity/v3/users/6e38b20752e542379484a3502eb0bbd5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:05.512239 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093c10f-4c3c-40b3-9d94-f62512c58faf admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:05.513709 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-e093c10f-4c3c-40b3-9d94-f62512c58faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:05.527236 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093c10f-4c3c-40b3-9d94-f62512c58faf admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:05.582560 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38e007-3798-48e2-be51-5d484bd39f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:05.583410 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38e007-3798-48e2-be51-5d484bd39f52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:05.583705 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38e007-3798-48e2-be51-5d484bd39f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:05.583992 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38e007-3798-48e2-be51-5d484bd39f52 admin admin] PATH_INFO: `/v3/projects/f7cb7e6d3e784708b69f8e90fd9fc521` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:05.585143 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38e007-3798-48e2-be51-5d484bd39f52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7cb7e6d3e784708b69f8e90fd9fc521)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:05.587579 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38e007-3798-48e2-be51-5d484bd39f52 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:05.630171 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-db38e007-3798-48e2-be51-5d484bd39f52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7cb7e6d3e784708b69f8e90fd9fc521', 'request_id': 'req-db38e007-3798-48e2-be51-5d484bd39f52'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:05.635612 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-db38e007-3798-48e2-be51-5d484bd39f52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7cb7e6d3e784708b69f8e90fd9fc521', 'request_id': 'req-db38e007-3798-48e2-be51-5d484bd39f52'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:05.641509 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-db38e007-3798-48e2-be51-5d484bd39f52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7cb7e6d3e784708b69f8e90fd9fc521', 'request_id': 'req-db38e007-3798-48e2-be51-5d484bd39f52'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:05.653086 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-db38e007-3798-48e2-be51-5d484bd39f52 admin admin] The token cache is being invalidate because project f7cb7e6d3e784708b69f8e90fd9fc521 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:16:05.653373 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-db38e007-3798-48e2-be51-5d484bd39f52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:05.653987 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-db38e007-3798-48e2-be51-5d484bd39f52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:05.655525 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1327/2649] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:16:05 2022] DELETE /identity/v3/projects/f7cb7e6d3e784708b69f8e90fd9fc521 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:05.661108 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decfb5f-d9e5-4b07-9a5a-9ffa992ed294 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:05.661399 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decfb5f-d9e5-4b07-9a5a-9ffa992ed294 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:05.661684 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decfb5f-d9e5-4b07-9a5a-9ffa992ed294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:05.679597 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-0decfb5f-d9e5-4b07-9a5a-9ffa992ed294 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:05.680834 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-0decfb5f-d9e5-4b07-9a5a-9ffa992ed294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:05.738145 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1323/2650] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:05.746191 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb9889-aaaf-4a5e-926a-1b9a532f70af None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:05.746511 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb9889-aaaf-4a5e-926a-1b9a532f70af None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:05.746796 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb9889-aaaf-4a5e-926a-1b9a532f70af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:05.764926 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-24cb9889-aaaf-4a5e-926a-1b9a532f70af None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:05.766050 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-24cb9889-aaaf-4a5e-926a-1b9a532f70af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:05.774401 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1328/2651] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:05.778371 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decfb5f-d9e5-4b07-9a5a-9ffa992ed294 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:05.787890 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decfb5f-d9e5-4b07-9a5a-9ffa992ed294 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:05.792398 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a45921-ed3e-4e8e-8b52-ab9db0dc229d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:05.793075 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a45921-ed3e-4e8e-8b52-ab9db0dc229d admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:05.793357 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a45921-ed3e-4e8e-8b52-ab9db0dc229d admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:05.793711 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a45921-ed3e-4e8e-8b52-ab9db0dc229d admin admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:05.794460 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a45921-ed3e-4e8e-8b52-ab9db0dc229d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:16:05.794767 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a45921-ed3e-4e8e-8b52-ab9db0dc229d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:05.796398 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a45921-ed3e-4e8e-8b52-ab9db0dc229d admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:05.807437 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1324/2652] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 04:16:05.811484 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb9889-aaaf-4a5e-926a-1b9a532f70af None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:05.824906 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb9889-aaaf-4a5e-926a-1b9a532f70af None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:05.830150 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02f388-7a63-4d28-851f-85dd5c6b0c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:05.830799 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02f388-7a63-4d28-851f-85dd5c6b0c9e admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:05.831079 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02f388-7a63-4d28-851f-85dd5c6b0c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:05.831354 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02f388-7a63-4d28-851f-85dd5c6b0c9e admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:05.832115 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02f388-7a63-4d28-851f-85dd5c6b0c9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:05.834083 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02f388-7a63-4d28-851f-85dd5c6b0c9e admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:05.859243 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1329/2653] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:16:05 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:16:05.863308 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a45921-ed3e-4e8e-8b52-ab9db0dc229d admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:05.872778 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a45921-ed3e-4e8e-8b52-ab9db0dc229d admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:05.924795 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401c02a-5a6e-4558-a4dc-0a44a145ffe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:05.925440 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401c02a-5a6e-4558-a4dc-0a44a145ffe0 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:05.925720 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401c02a-5a6e-4558-a4dc-0a44a145ffe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:05.925993 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401c02a-5a6e-4558-a4dc-0a44a145ffe0 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:05.926661 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401c02a-5a6e-4558-a4dc-0a44a145ffe0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:05.928577 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401c02a-5a6e-4558-a4dc-0a44a145ffe0 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:05.950599 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1325/2654] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:16:05 2022] POST /identity/v3/users => generated 284 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:16:05.951767 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02f388-7a63-4d28-851f-85dd5c6b0c9e admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:05.962461 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02f388-7a63-4d28-851f-85dd5c6b0c9e admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:05.967092 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03e2bb-b806-42f3-944c-386ec176b02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:05.967780 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03e2bb-b806-42f3-944c-386ec176b02a admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:05.968066 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03e2bb-b806-42f3-944c-386ec176b02a admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:05.968346 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03e2bb-b806-42f3-944c-386ec176b02a admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:05.969067 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03e2bb-b806-42f3-944c-386ec176b02a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:05.970642 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc03e2bb-b806-42f3-944c-386ec176b02a admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:05.980720 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1330/2655] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:16:05.984407 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401c02a-5a6e-4558-a4dc-0a44a145ffe0 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:05.993828 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401c02a-5a6e-4558-a4dc-0a44a145ffe0 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:05.998330 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077b9ae-b92b-4a85-ace5-15d49c9783ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:05.998969 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077b9ae-b92b-4a85-ace5-15d49c9783ba admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:05.999256 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077b9ae-b92b-4a85-ace5-15d49c9783ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:05.999530 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077b9ae-b92b-4a85-ace5-15d49c9783ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:06.000271 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c077b9ae-b92b-4a85-ace5-15d49c9783ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:06.001830 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c077b9ae-b92b-4a85-ace5-15d49c9783ba admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:06.011813 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1326/2656] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:16:06.016009 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03e2bb-b806-42f3-944c-386ec176b02a admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:06.027027 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03e2bb-b806-42f3-944c-386ec176b02a admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:06.031960 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a0390-b747-4576-a649-80152bd6400d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:06.032843 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a0390-b747-4576-a649-80152bd6400d admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:06.033122 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a0390-b747-4576-a649-80152bd6400d admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:06.033425 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a0390-b747-4576-a649-80152bd6400d admin admin] PATH_INFO: `/v3/projects/3ce5d94cd4ac4adaa7d32f3765785752/users/173abeb7fa924341b8ff868c609077ee/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:06.049625 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a0390-b747-4576-a649-80152bd6400d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce5d94cd4ac4adaa7d32f3765785752, user_id=173abeb7fa924341b8ff868c609077ee, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:06.052254 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a0390-b747-4576-a649-80152bd6400d admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:06.068623 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1331/2657] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:16:06 2022] PUT /identity/v3/projects/3ce5d94cd4ac4adaa7d32f3765785752/users/173abeb7fa924341b8ff868c609077ee/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:06.080082 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48a850-9e53-4314-93c8-35258c3905f9 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:06.080420 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48a850-9e53-4314-93c8-35258c3905f9 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:06.080699 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48a850-9e53-4314-93c8-35258c3905f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:06.108726 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-1b48a850-9e53-4314-93c8-35258c3905f9 None None] MFA Rules not processed for user `173abeb7fa924341b8ff868c609077ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:06.109980 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-1b48a850-9e53-4314-93c8-35258c3905f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:06.171711 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1327/2658] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:06.176042 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a0390-b747-4576-a649-80152bd6400d admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:06.238212 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a0390-b747-4576-a649-80152bd6400d admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:06.254537 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85559a90-19ff-4956-88f2-a803a5380a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:06.255401 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85559a90-19ff-4956-88f2-a803a5380a11 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:06.255728 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85559a90-19ff-4956-88f2-a803a5380a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:06.256178 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85559a90-19ff-4956-88f2-a803a5380a11 admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:06.256839 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85559a90-19ff-4956-88f2-a803a5380a11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:06.260732 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85559a90-19ff-4956-88f2-a803a5380a11 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:06.289827 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1332/2659] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:16:06 2022] POST /identity/v3/projects => generated 367 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:16:06.293730 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48a850-9e53-4314-93c8-35258c3905f9 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:06.305444 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48a850-9e53-4314-93c8-35258c3905f9 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:06.360367 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b8cb9-925c-48b1-82ba-01f123e40367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:06.361033 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b8cb9-925c-48b1-82ba-01f123e40367 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:06.361345 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b8cb9-925c-48b1-82ba-01f123e40367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:06.361617 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b8cb9-925c-48b1-82ba-01f123e40367 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:06.362292 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b8cb9-925c-48b1-82ba-01f123e40367 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:06.364295 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b8cb9-925c-48b1-82ba-01f123e40367 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:06.387867 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1328/2660] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:16:06 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:16:06.389127 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85559a90-19ff-4956-88f2-a803a5380a11 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:06.400198 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85559a90-19ff-4956-88f2-a803a5380a11 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:06.404863 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf2b21-5cf6-4386-875b-711a27d88897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:06.405589 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf2b21-5cf6-4386-875b-711a27d88897 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:06.405974 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf2b21-5cf6-4386-875b-711a27d88897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:06.406288 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf2b21-5cf6-4386-875b-711a27d88897 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:06.407440 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf2b21-5cf6-4386-875b-711a27d88897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:06.409849 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf2b21-5cf6-4386-875b-711a27d88897 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:06.422344 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1333/2661] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:16:06.426714 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b8cb9-925c-48b1-82ba-01f123e40367 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:06.438290 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b8cb9-925c-48b1-82ba-01f123e40367 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:06.443066 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668b297-a1b2-4e16-801d-05ab46b98610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:06.445159 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668b297-a1b2-4e16-801d-05ab46b98610 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:06.445159 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668b297-a1b2-4e16-801d-05ab46b98610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:06.445159 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668b297-a1b2-4e16-801d-05ab46b98610 admin admin] PATH_INFO: `/v3/projects/71a9ba05bb7d43749f5f5d1f75485ea1/users/5b2a8bf38a4949ed945df55f120d7e48/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:06.460724 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668b297-a1b2-4e16-801d-05ab46b98610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71a9ba05bb7d43749f5f5d1f75485ea1, user_id=5b2a8bf38a4949ed945df55f120d7e48, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:06.465089 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668b297-a1b2-4e16-801d-05ab46b98610 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:06.479836 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1329/2662] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:16:06 2022] PUT /identity/v3/projects/71a9ba05bb7d43749f5f5d1f75485ea1/users/5b2a8bf38a4949ed945df55f120d7e48/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:16:06.484128 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf2b21-5cf6-4386-875b-711a27d88897 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:06.493979 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf2b21-5cf6-4386-875b-711a27d88897 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:06.561061 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716392f0-6adb-4b07-b19f-fc89dfa1dbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:06.561658 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716392f0-6adb-4b07-b19f-fc89dfa1dbff admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:06.561940 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716392f0-6adb-4b07-b19f-fc89dfa1dbff admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:06.562246 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716392f0-6adb-4b07-b19f-fc89dfa1dbff admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:06.563414 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716392f0-6adb-4b07-b19f-fc89dfa1dbff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:06.566517 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716392f0-6adb-4b07-b19f-fc89dfa1dbff admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:06.576952 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1334/2663] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:16:06.581517 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668b297-a1b2-4e16-801d-05ab46b98610 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:06.592508 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668b297-a1b2-4e16-801d-05ab46b98610 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:06.597198 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77d63c-60d0-4b7e-b445-d4b3760b6300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:06.598080 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77d63c-60d0-4b7e-b445-d4b3760b6300 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:06.598365 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77d63c-60d0-4b7e-b445-d4b3760b6300 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:06.598644 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77d63c-60d0-4b7e-b445-d4b3760b6300 admin admin] PATH_INFO: `/v3/projects/71a9ba05bb7d43749f5f5d1f75485ea1/users/5b2a8bf38a4949ed945df55f120d7e48/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:06.600762 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77d63c-60d0-4b7e-b445-d4b3760b6300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71a9ba05bb7d43749f5f5d1f75485ea1, user_id=5b2a8bf38a4949ed945df55f120d7e48, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:06.603417 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77d63c-60d0-4b7e-b445-d4b3760b6300 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:06.614747 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1330/2664] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:16:06 2022] PUT /identity/v3/projects/71a9ba05bb7d43749f5f5d1f75485ea1/users/5b2a8bf38a4949ed945df55f120d7e48/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:16:06.624810 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdbe3d-e973-4e1b-ad83-7b8fcdc55df8 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:06.625102 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdbe3d-e973-4e1b-ad83-7b8fcdc55df8 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:06.625381 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bdbe3d-e973-4e1b-ad83-7b8fcdc55df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:06.651430 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-61bdbe3d-e973-4e1b-ad83-7b8fcdc55df8 None None] MFA Rules not processed for user `5b2a8bf38a4949ed945df55f120d7e48`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:06.652656 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-61bdbe3d-e973-4e1b-ad83-7b8fcdc55df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:06.718605 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1335/2665] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:06 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:06.729890 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77d63c-60d0-4b7e-b445-d4b3760b6300 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:06.731655 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-0d77d63c-60d0-4b7e-b445-d4b3760b6300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:06.785241 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77d63c-60d0-4b7e-b445-d4b3760b6300 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:06.788716 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee289f6-9970-4f90-ac45-d371371263ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:06.789356 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee289f6-9970-4f90-ac45-d371371263ea service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:06.789634 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee289f6-9970-4f90-ac45-d371371263ea service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:06.789905 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee289f6-9970-4f90-ac45-d371371263ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:06.798401 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee289f6-9970-4f90-ac45-d371371263ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:06.799849 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee289f6-9970-4f90-ac45-d371371263ea service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:06.808807 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1331/2666] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:16:06 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:16:07.294019 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdbe3d-e973-4e1b-ad83-7b8fcdc55df8 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:07.295459 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-61bdbe3d-e973-4e1b-ad83-7b8fcdc55df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:07.361679 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bdbe3d-e973-4e1b-ad83-7b8fcdc55df8 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:07.367700 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11a7ff-8883-4a18-b2df-9460e452fb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:07.368583 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11a7ff-8883-4a18-b2df-9460e452fb57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:07.368869 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11a7ff-8883-4a18-b2df-9460e452fb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:07.369148 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11a7ff-8883-4a18-b2df-9460e452fb57 admin admin] PATH_INFO: `/v3/users/aaf021bdf8be4391818888fda7b10a38` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:07.370349 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11a7ff-8883-4a18-b2df-9460e452fb57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaf021bdf8be4391818888fda7b10a38)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:07.372329 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11a7ff-8883-4a18-b2df-9460e452fb57 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:07.419880 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-2a11a7ff-8883-4a18-b2df-9460e452fb57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaf021bdf8be4391818888fda7b10a38'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:07.419880 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-2a11a7ff-8883-4a18-b2df-9460e452fb57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaf021bdf8be4391818888fda7b10a38'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:07.426644 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-2a11a7ff-8883-4a18-b2df-9460e452fb57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaf021bdf8be4391818888fda7b10a38'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:07.439131 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-2a11a7ff-8883-4a18-b2df-9460e452fb57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaf021bdf8be4391818888fda7b10a38'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:07.439862 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-2a11a7ff-8883-4a18-b2df-9460e452fb57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaf021bdf8be4391818888fda7b10a38'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:07.452345 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1336/2667] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:16:07 2022] DELETE /identity/v3/users/aaf021bdf8be4391818888fda7b10a38 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:07.456594 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814eae7-953d-45a1-a4d9-0b80a961552f None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:07.456883 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814eae7-953d-45a1-a4d9-0b80a961552f None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:07.457161 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814eae7-953d-45a1-a4d9-0b80a961552f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:07.479970 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-1814eae7-953d-45a1-a4d9-0b80a961552f None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:07.481153 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-1814eae7-953d-45a1-a4d9-0b80a961552f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:07.541961 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1332/2668] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:07.549717 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11a7ff-8883-4a18-b2df-9460e452fb57 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:07.552421 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-2a11a7ff-8883-4a18-b2df-9460e452fb57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:07.612041 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11a7ff-8883-4a18-b2df-9460e452fb57 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:07.615857 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a38696-8869-486b-9fc1-9ea13dc6a1c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:07.616537 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a38696-8869-486b-9fc1-9ea13dc6a1c4 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:07.616824 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a38696-8869-486b-9fc1-9ea13dc6a1c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:07.617748 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a38696-8869-486b-9fc1-9ea13dc6a1c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:07.627741 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a38696-8869-486b-9fc1-9ea13dc6a1c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:07.629208 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a38696-8869-486b-9fc1-9ea13dc6a1c4 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:07.640172 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1337/2669] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:16:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:16:07.960486 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814eae7-953d-45a1-a4d9-0b80a961552f None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:07.963207 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-1814eae7-953d-45a1-a4d9-0b80a961552f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:07.992529 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814eae7-953d-45a1-a4d9-0b80a961552f None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:08.004106 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e83fe-dd90-487b-888b-59b9d1311dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:08.005412 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e83fe-dd90-487b-888b-59b9d1311dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:08.005878 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e83fe-dd90-487b-888b-59b9d1311dae admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:08.006158 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e83fe-dd90-487b-888b-59b9d1311dae admin admin] PATH_INFO: `/v3/projects/03a6fe3a77cc4949b22e1709c624922f` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:08.007416 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e83fe-dd90-487b-888b-59b9d1311dae admin admin] RBAC: Authorizing `identity:delete_project(project_id=03a6fe3a77cc4949b22e1709c624922f)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:08.010103 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e83fe-dd90-487b-888b-59b9d1311dae admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:08.073799 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-275e83fe-dd90-487b-888b-59b9d1311dae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03a6fe3a77cc4949b22e1709c624922f', 'request_id': 'req-275e83fe-dd90-487b-888b-59b9d1311dae'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:08.079647 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-275e83fe-dd90-487b-888b-59b9d1311dae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03a6fe3a77cc4949b22e1709c624922f', 'request_id': 'req-275e83fe-dd90-487b-888b-59b9d1311dae'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:08.086631 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-275e83fe-dd90-487b-888b-59b9d1311dae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03a6fe3a77cc4949b22e1709c624922f', 'request_id': 'req-275e83fe-dd90-487b-888b-59b9d1311dae'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:08.101444 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-275e83fe-dd90-487b-888b-59b9d1311dae admin admin] The token cache is being invalidate because project 03a6fe3a77cc4949b22e1709c624922f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:16:08.101927 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-275e83fe-dd90-487b-888b-59b9d1311dae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:08.102632 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-275e83fe-dd90-487b-888b-59b9d1311dae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:08.104343 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1333/2670] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:16:07 2022] DELETE /identity/v3/projects/03a6fe3a77cc4949b22e1709c624922f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:16:08.108515 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a38696-8869-486b-9fc1-9ea13dc6a1c4 service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:08.118662 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a38696-8869-486b-9fc1-9ea13dc6a1c4 service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:08.159100 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e83fe-dd90-487b-888b-59b9d1311dae admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:08.161576 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-275e83fe-dd90-487b-888b-59b9d1311dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:08.194771 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a17f3c-690c-4178-bac2-1066b298f066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:08.196332 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a17f3c-690c-4178-bac2-1066b298f066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:08.196809 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a17f3c-690c-4178-bac2-1066b298f066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:08.197181 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a17f3c-690c-4178-bac2-1066b298f066 admin admin] PATH_INFO: `/v3/users/9f21dea708b54ee390ea312fd976a22e` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:08.198460 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a17f3c-690c-4178-bac2-1066b298f066 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f21dea708b54ee390ea312fd976a22e)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:08.200528 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a17f3c-690c-4178-bac2-1066b298f066 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:08.227936 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e83fe-dd90-487b-888b-59b9d1311dae admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:08.233666 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31e769-4799-4649-a30c-51bf0fec7520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:08.236651 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31e769-4799-4649-a30c-51bf0fec7520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:08.236973 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31e769-4799-4649-a30c-51bf0fec7520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:08.237490 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31e769-4799-4649-a30c-51bf0fec7520 admin admin] PATH_INFO: `/v3/users/173abeb7fa924341b8ff868c609077ee` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:08.239325 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31e769-4799-4649-a30c-51bf0fec7520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=173abeb7fa924341b8ff868c609077ee)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:08.241444 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31e769-4799-4649-a30c-51bf0fec7520 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:08.248005 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-22a17f3c-690c-4178-bac2-1066b298f066 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f21dea708b54ee390ea312fd976a22e'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:08.248663 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-22a17f3c-690c-4178-bac2-1066b298f066 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f21dea708b54ee390ea312fd976a22e'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:08.255437 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-22a17f3c-690c-4178-bac2-1066b298f066 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f21dea708b54ee390ea312fd976a22e'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:08.267475 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-22a17f3c-690c-4178-bac2-1066b298f066 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f21dea708b54ee390ea312fd976a22e'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:08.268331 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-22a17f3c-690c-4178-bac2-1066b298f066 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f21dea708b54ee390ea312fd976a22e'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:08.283749 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1338/2671] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:16:08 2022] DELETE /identity/v3/users/9f21dea708b54ee390ea312fd976a22e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:08.291658 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-ce31e769-4799-4649-a30c-51bf0fec7520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '173abeb7fa924341b8ff868c609077ee'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:08.298549 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-ce31e769-4799-4649-a30c-51bf0fec7520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '173abeb7fa924341b8ff868c609077ee'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:08.307308 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-ce31e769-4799-4649-a30c-51bf0fec7520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '173abeb7fa924341b8ff868c609077ee'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:08.319469 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-ce31e769-4799-4649-a30c-51bf0fec7520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '173abeb7fa924341b8ff868c609077ee'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:08.320695 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-ce31e769-4799-4649-a30c-51bf0fec7520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '173abeb7fa924341b8ff868c609077ee'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:08.334426 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1334/2672] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:16:08 2022] DELETE /identity/v3/users/173abeb7fa924341b8ff868c609077ee => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:16:08.339692 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef876d-8b28-4580-91eb-b0408963eb95 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:08.340182 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef876d-8b28-4580-91eb-b0408963eb95 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:08.340319 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef876d-8b28-4580-91eb-b0408963eb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:08.359147 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-30ef876d-8b28-4580-91eb-b0408963eb95 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:08.360464 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-30ef876d-8b28-4580-91eb-b0408963eb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:08.422638 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1339/2673] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:16:08.440687 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31e769-4799-4649-a30c-51bf0fec7520 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:08.442236 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-ce31e769-4799-4649-a30c-51bf0fec7520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:08.503275 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31e769-4799-4649-a30c-51bf0fec7520 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:08.510268 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e17e1-abe1-47ad-bfda-c08106b37472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:08.511032 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e17e1-abe1-47ad-bfda-c08106b37472 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:08.511562 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e17e1-abe1-47ad-bfda-c08106b37472 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:08.511811 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e17e1-abe1-47ad-bfda-c08106b37472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:08.521965 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e17e1-abe1-47ad-bfda-c08106b37472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:08.523587 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e17e1-abe1-47ad-bfda-c08106b37472 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:08.533654 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1335/2674] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:16:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:16:08.567275 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef876d-8b28-4580-91eb-b0408963eb95 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:08.568729 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-30ef876d-8b28-4580-91eb-b0408963eb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:08.586066 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef876d-8b28-4580-91eb-b0408963eb95 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:08.593186 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b1bc8-c0a1-4077-9faa-4f97c3bce725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:08.594476 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b1bc8-c0a1-4077-9faa-4f97c3bce725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:08.594810 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b1bc8-c0a1-4077-9faa-4f97c3bce725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:08.595090 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b1bc8-c0a1-4077-9faa-4f97c3bce725 admin admin] PATH_INFO: `/v3/projects/ad5944f6ead4479b94616cabe65f2c75` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:08.596801 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b1bc8-c0a1-4077-9faa-4f97c3bce725 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad5944f6ead4479b94616cabe65f2c75)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:08.598710 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b1bc8-c0a1-4077-9faa-4f97c3bce725 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:08.646477 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-d84b1bc8-c0a1-4077-9faa-4f97c3bce725 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad5944f6ead4479b94616cabe65f2c75', 'request_id': 'req-d84b1bc8-c0a1-4077-9faa-4f97c3bce725'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:08.653110 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-d84b1bc8-c0a1-4077-9faa-4f97c3bce725 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad5944f6ead4479b94616cabe65f2c75', 'request_id': 'req-d84b1bc8-c0a1-4077-9faa-4f97c3bce725'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:08.661764 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-d84b1bc8-c0a1-4077-9faa-4f97c3bce725 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad5944f6ead4479b94616cabe65f2c75', 'request_id': 'req-d84b1bc8-c0a1-4077-9faa-4f97c3bce725'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:08.678079 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-d84b1bc8-c0a1-4077-9faa-4f97c3bce725 admin admin] The token cache is being invalidate because project ad5944f6ead4479b94616cabe65f2c75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:16:08.678431 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-d84b1bc8-c0a1-4077-9faa-4f97c3bce725 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:08.679132 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-d84b1bc8-c0a1-4077-9faa-4f97c3bce725 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:08.681534 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1340/2675] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:16:08 2022] DELETE /identity/v3/projects/ad5944f6ead4479b94616cabe65f2c75 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:08.686532 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403e287-9fd4-4bc0-ba1b-42a5b74067d6 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:08.687107 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403e287-9fd4-4bc0-ba1b-42a5b74067d6 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:08.687624 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403e287-9fd4-4bc0-ba1b-42a5b74067d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:08.709858 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-5403e287-9fd4-4bc0-ba1b-42a5b74067d6 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:08.711112 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-5403e287-9fd4-4bc0-ba1b-42a5b74067d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:08.775547 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1336/2676] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:16:08.783370 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4aec61-ac03-402e-9732-914c1570326b None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:08.783649 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4aec61-ac03-402e-9732-914c1570326b None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:08.783951 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4aec61-ac03-402e-9732-914c1570326b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:08.802793 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-0e4aec61-ac03-402e-9732-914c1570326b None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:08.804019 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-0e4aec61-ac03-402e-9732-914c1570326b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:08.815811 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1341/2677] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:08.820568 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403e287-9fd4-4bc0-ba1b-42a5b74067d6 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:08.830487 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403e287-9fd4-4bc0-ba1b-42a5b74067d6 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:08.837952 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4aec61-ac03-402e-9732-914c1570326b None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:08.838354 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075631fb-7676-4323-b33c-9435b0006f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:08.839204 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075631fb-7676-4323-b33c-9435b0006f72 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:08.839631 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075631fb-7676-4323-b33c-9435b0006f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:08.839796 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-0e4aec61-ac03-402e-9732-914c1570326b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:08.840034 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075631fb-7676-4323-b33c-9435b0006f72 admin admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:08.840887 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075631fb-7676-4323-b33c-9435b0006f72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:16:08.841269 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075631fb-7676-4323-b33c-9435b0006f72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:08.843003 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075631fb-7676-4323-b33c-9435b0006f72 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:08.856159 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4aec61-ac03-402e-9732-914c1570326b None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:08.860716 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1337/2678] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:16:08.864768 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075631fb-7676-4323-b33c-9435b0006f72 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:08.865387 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0411ae8-0115-424d-8e82-e4352d2ae5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:08.866256 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0411ae8-0115-424d-8e82-e4352d2ae5c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:08.866534 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0411ae8-0115-424d-8e82-e4352d2ae5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:08.866806 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0411ae8-0115-424d-8e82-e4352d2ae5c1 admin admin] PATH_INFO: `/v3/projects/3ce5d94cd4ac4adaa7d32f3765785752` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:08.868702 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0411ae8-0115-424d-8e82-e4352d2ae5c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ce5d94cd4ac4adaa7d32f3765785752)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:08.870595 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0411ae8-0115-424d-8e82-e4352d2ae5c1 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:08.877528 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075631fb-7676-4323-b33c-9435b0006f72 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:08.882331 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea4365-d73f-4141-ab01-6d5f5d755d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:08.883027 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea4365-d73f-4141-ab01-6d5f5d755d29 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:08.883315 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea4365-d73f-4141-ab01-6d5f5d755d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:08.883596 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea4365-d73f-4141-ab01-6d5f5d755d29 admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:08.884378 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea4365-d73f-4141-ab01-6d5f5d755d29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:08.886283 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea4365-d73f-4141-ab01-6d5f5d755d29 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:08.919368 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-e0411ae8-0115-424d-8e82-e4352d2ae5c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ce5d94cd4ac4adaa7d32f3765785752', 'request_id': 'req-e0411ae8-0115-424d-8e82-e4352d2ae5c1'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:08.922045 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1338/2679] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:16:08 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:16:08.925769 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea4365-d73f-4141-ab01-6d5f5d755d29 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:08.927207 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-e0411ae8-0115-424d-8e82-e4352d2ae5c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ce5d94cd4ac4adaa7d32f3765785752', 'request_id': 'req-e0411ae8-0115-424d-8e82-e4352d2ae5c1'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:08.933939 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-e0411ae8-0115-424d-8e82-e4352d2ae5c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ce5d94cd4ac4adaa7d32f3765785752', 'request_id': 'req-e0411ae8-0115-424d-8e82-e4352d2ae5c1'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:08.948601 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-e0411ae8-0115-424d-8e82-e4352d2ae5c1 admin admin] The token cache is being invalidate because project 3ce5d94cd4ac4adaa7d32f3765785752 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:16:08.949166 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-e0411ae8-0115-424d-8e82-e4352d2ae5c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:08.949956 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-e0411ae8-0115-424d-8e82-e4352d2ae5c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:08.951729 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1342/2680] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:16:08 2022] DELETE /identity/v3/projects/3ce5d94cd4ac4adaa7d32f3765785752 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:08.955345 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0411ae8-0115-424d-8e82-e4352d2ae5c1 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:08.956805 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-e0411ae8-0115-424d-8e82-e4352d2ae5c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:08.989129 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea4365-d73f-4141-ab01-6d5f5d755d29 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:08.994711 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523535b-a6de-469f-80ce-a68df180735b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:08.995465 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523535b-a6de-469f-80ce-a68df180735b admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:08.995778 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523535b-a6de-469f-80ce-a68df180735b admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:08.996245 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523535b-a6de-469f-80ce-a68df180735b admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:08.996944 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b523535b-a6de-469f-80ce-a68df180735b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:08.998852 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b523535b-a6de-469f-80ce-a68df180735b admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:09.022138 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1339/2681] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:16:08 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:16:09.024706 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0411ae8-0115-424d-8e82-e4352d2ae5c1 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:09.026200 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523535b-a6de-469f-80ce-a68df180735b admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:09.028035 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-b523535b-a6de-469f-80ce-a68df180735b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:09.029683 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b33bc7-5dec-40f3-836b-b0238484ab32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:09.030704 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b33bc7-5dec-40f3-836b-b0238484ab32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:09.030989 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b33bc7-5dec-40f3-836b-b0238484ab32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:09.031273 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b33bc7-5dec-40f3-836b-b0238484ab32 admin admin] PATH_INFO: `/v3/users/5b2a8bf38a4949ed945df55f120d7e48` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:09.032468 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b33bc7-5dec-40f3-836b-b0238484ab32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b2a8bf38a4949ed945df55f120d7e48)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:09.034370 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b33bc7-5dec-40f3-836b-b0238484ab32 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:09.041595 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523535b-a6de-469f-80ce-a68df180735b admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:09.046314 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c23e5b-1db7-4bff-86b9-f0655c850e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:09.047025 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c23e5b-1db7-4bff-86b9-f0655c850e8a admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:09.047317 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c23e5b-1db7-4bff-86b9-f0655c850e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:09.047595 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c23e5b-1db7-4bff-86b9-f0655c850e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:09.048354 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c23e5b-1db7-4bff-86b9-f0655c850e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:09.049938 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c23e5b-1db7-4bff-86b9-f0655c850e8a admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:09.061116 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1340/2682] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:16:09.065131 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c23e5b-1db7-4bff-86b9-f0655c850e8a admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:09.083796 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c23e5b-1db7-4bff-86b9-f0655c850e8a admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:09.089539 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9456e93-1f99-45e6-a5a1-bc67442e0428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:09.090506 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9456e93-1f99-45e6-a5a1-bc67442e0428 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:09.091051 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9456e93-1f99-45e6-a5a1-bc67442e0428 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:09.091465 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9456e93-1f99-45e6-a5a1-bc67442e0428 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:09.092660 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9456e93-1f99-45e6-a5a1-bc67442e0428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:09.094591 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9456e93-1f99-45e6-a5a1-bc67442e0428 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:09.103607 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-76b33bc7-5dec-40f3-836b-b0238484ab32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b2a8bf38a4949ed945df55f120d7e48'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:09.104461 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-76b33bc7-5dec-40f3-836b-b0238484ab32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b2a8bf38a4949ed945df55f120d7e48'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:09.109117 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1341/2683] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:16:09.111725 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-76b33bc7-5dec-40f3-836b-b0238484ab32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b2a8bf38a4949ed945df55f120d7e48'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:09.113001 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9456e93-1f99-45e6-a5a1-bc67442e0428 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:09.124661 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-76b33bc7-5dec-40f3-836b-b0238484ab32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b2a8bf38a4949ed945df55f120d7e48'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:09.125395 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-76b33bc7-5dec-40f3-836b-b0238484ab32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b2a8bf38a4949ed945df55f120d7e48'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:09.127136 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9456e93-1f99-45e6-a5a1-bc67442e0428 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:09.132766 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab3c43-8a8e-40f5-b9db-90bdf02afedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:09.133993 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab3c43-8a8e-40f5-b9db-90bdf02afedc admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:09.134593 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab3c43-8a8e-40f5-b9db-90bdf02afedc admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:09.134975 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab3c43-8a8e-40f5-b9db-90bdf02afedc admin admin] PATH_INFO: `/v3/projects/777459d6ede04b3688b2aede6a8a612f/users/dc1ef411e18643cab1e02fa3871ed94d/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:09.141176 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1343/2684] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:16:08 2022] DELETE /identity/v3/users/5b2a8bf38a4949ed945df55f120d7e48 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:16:09.151751 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab3c43-8a8e-40f5-b9db-90bdf02afedc admin admin] RBAC: Authorizing `identity:create_grant(project_id=777459d6ede04b3688b2aede6a8a612f, user_id=dc1ef411e18643cab1e02fa3871ed94d, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:09.154619 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab3c43-8a8e-40f5-b9db-90bdf02afedc admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:09.169223 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1342/2685] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:16:09 2022] PUT /identity/v3/projects/777459d6ede04b3688b2aede6a8a612f/users/dc1ef411e18643cab1e02fa3871ed94d/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:16:09.179886 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e3304-f940-406a-a9d8-6d23e0624dba None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:09.180027 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e3304-f940-406a-a9d8-6d23e0624dba None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:09.180280 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e3304-f940-406a-a9d8-6d23e0624dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:09.209700 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-053e3304-f940-406a-a9d8-6d23e0624dba None None] MFA Rules not processed for user `dc1ef411e18643cab1e02fa3871ed94d`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:09.212137 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-053e3304-f940-406a-a9d8-6d23e0624dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:09.283507 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1344/2686] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:09.296080 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab3c43-8a8e-40f5-b9db-90bdf02afedc admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:09.297865 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-9cab3c43-8a8e-40f5-b9db-90bdf02afedc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:09.360761 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab3c43-8a8e-40f5-b9db-90bdf02afedc admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:09.364637 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59473725-e8ef-4cff-9a5b-0ef143063a4e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7c195f91114855acc58163631544d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:09.365289 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59473725-e8ef-4cff-9a5b-0ef143063a4e service glance] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:09.365574 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59473725-e8ef-4cff-9a5b-0ef143063a4e service glance] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:09.365852 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59473725-e8ef-4cff-9a5b-0ef143063a4e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:09.374598 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59473725-e8ef-4cff-9a5b-0ef143063a4e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:09.376058 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59473725-e8ef-4cff-9a5b-0ef143063a4e service glance] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:09.385807 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1343/2687] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:16:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:16:09.452426 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e3304-f940-406a-a9d8-6d23e0624dba None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:09.454148 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-053e3304-f940-406a-a9d8-6d23e0624dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:09.539273 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e3304-f940-406a-a9d8-6d23e0624dba None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:09.544340 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b71bea-e656-40d9-b081-e8514364810d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:09.545393 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b71bea-e656-40d9-b081-e8514364810d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:09.545672 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b71bea-e656-40d9-b081-e8514364810d admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:09.546196 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b71bea-e656-40d9-b081-e8514364810d admin admin] PATH_INFO: `/v3/projects/71a9ba05bb7d43749f5f5d1f75485ea1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:09.547395 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b71bea-e656-40d9-b081-e8514364810d admin admin] RBAC: Authorizing `identity:delete_project(project_id=71a9ba05bb7d43749f5f5d1f75485ea1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:09.549336 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b71bea-e656-40d9-b081-e8514364810d admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:09.606166 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b8b71bea-e656-40d9-b081-e8514364810d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71a9ba05bb7d43749f5f5d1f75485ea1', 'request_id': 'req-b8b71bea-e656-40d9-b081-e8514364810d'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:09.611637 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b8b71bea-e656-40d9-b081-e8514364810d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71a9ba05bb7d43749f5f5d1f75485ea1', 'request_id': 'req-b8b71bea-e656-40d9-b081-e8514364810d'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:09.617729 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b8b71bea-e656-40d9-b081-e8514364810d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71a9ba05bb7d43749f5f5d1f75485ea1', 'request_id': 'req-b8b71bea-e656-40d9-b081-e8514364810d'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:09.633684 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b8b71bea-e656-40d9-b081-e8514364810d admin admin] The token cache is being invalidate because project 71a9ba05bb7d43749f5f5d1f75485ea1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:16:09.634007 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b8b71bea-e656-40d9-b081-e8514364810d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:09.634657 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b8b71bea-e656-40d9-b081-e8514364810d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:09.636346 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1345/2688] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:16:09 2022] DELETE /identity/v3/projects/71a9ba05bb7d43749f5f5d1f75485ea1 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:09.641569 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05ac8f-3437-4708-b085-b5f939237fa6 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:09.641876 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05ac8f-3437-4708-b085-b5f939237fa6 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:09.642159 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05ac8f-3437-4708-b085-b5f939237fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:09.661836 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-ad05ac8f-3437-4708-b085-b5f939237fa6 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:09.663216 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-ad05ac8f-3437-4708-b085-b5f939237fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:09.727995 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1344/2689] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:09.735543 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8709af-88c1-4368-ac54-b0ee9fbe626f None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:09.735869 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8709af-88c1-4368-ac54-b0ee9fbe626f None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:09.736458 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8709af-88c1-4368-ac54-b0ee9fbe626f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:09.759633 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-bd8709af-88c1-4368-ac54-b0ee9fbe626f None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:09.760944 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-bd8709af-88c1-4368-ac54-b0ee9fbe626f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:09.769231 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1346/2690] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:09.774313 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05ac8f-3437-4708-b085-b5f939237fa6 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:09.785846 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05ac8f-3437-4708-b085-b5f939237fa6 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:09.790984 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a7121-b4e0-4a9f-ad72-5d61ba7cd55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:09.791655 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a7121-b4e0-4a9f-ad72-5d61ba7cd55f admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:09.792066 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a7121-b4e0-4a9f-ad72-5d61ba7cd55f admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:09.792393 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a7121-b4e0-4a9f-ad72-5d61ba7cd55f admin admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:09.793171 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a7121-b4e0-4a9f-ad72-5d61ba7cd55f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:16:09.793572 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a7121-b4e0-4a9f-ad72-5d61ba7cd55f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:09.795421 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a7121-b4e0-4a9f-ad72-5d61ba7cd55f admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:09.812290 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1345/2691] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 04:16:09.813197 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8709af-88c1-4368-ac54-b0ee9fbe626f None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:09.824295 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8709af-88c1-4368-ac54-b0ee9fbe626f None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:09.829414 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a5e14-f612-4d6a-87e2-6cded982da72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:09.830063 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a5e14-f612-4d6a-87e2-6cded982da72 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:09.830336 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a5e14-f612-4d6a-87e2-6cded982da72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:09.830994 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a5e14-f612-4d6a-87e2-6cded982da72 admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:09.832560 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a5e14-f612-4d6a-87e2-6cded982da72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:09.834559 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a5e14-f612-4d6a-87e2-6cded982da72 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:09.870095 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a7121-b4e0-4a9f-ad72-5d61ba7cd55f admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:09.871032 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1347/2692] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:16:09 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:16:09.886635 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a7121-b4e0-4a9f-ad72-5d61ba7cd55f admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:09.950853 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411622a3-549c-45d4-a992-bae512f4a266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:09.951584 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411622a3-549c-45d4-a992-bae512f4a266 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:09.951900 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411622a3-549c-45d4-a992-bae512f4a266 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:09.952201 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411622a3-549c-45d4-a992-bae512f4a266 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:09.952896 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411622a3-549c-45d4-a992-bae512f4a266 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:09.954918 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411622a3-549c-45d4-a992-bae512f4a266 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:09.976396 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1346/2693] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:16:09 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:16:09.980706 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a5e14-f612-4d6a-87e2-6cded982da72 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:09.991713 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a5e14-f612-4d6a-87e2-6cded982da72 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:09.997617 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11442c-6da1-493c-ae83-79278794ecaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:09.998305 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11442c-6da1-493c-ae83-79278794ecaf admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:09.998594 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11442c-6da1-493c-ae83-79278794ecaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:09.998880 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11442c-6da1-493c-ae83-79278794ecaf admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:09.999623 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11442c-6da1-493c-ae83-79278794ecaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:10.001287 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11442c-6da1-493c-ae83-79278794ecaf admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:10.014241 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1348/2694] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:16:10.018599 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411622a3-549c-45d4-a992-bae512f4a266 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:10.030004 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411622a3-549c-45d4-a992-bae512f4a266 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:10.035000 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f10aab-f523-42d4-bdf1-0a3391064a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:10.036202 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f10aab-f523-42d4-bdf1-0a3391064a3d admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:10.036202 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f10aab-f523-42d4-bdf1-0a3391064a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:10.036440 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f10aab-f523-42d4-bdf1-0a3391064a3d admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:10.036977 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f10aab-f523-42d4-bdf1-0a3391064a3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:10.038615 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f10aab-f523-42d4-bdf1-0a3391064a3d admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:10.050951 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1347/2695] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:16:10.057386 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11442c-6da1-493c-ae83-79278794ecaf admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:10.073340 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11442c-6da1-493c-ae83-79278794ecaf admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:10.080658 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8454aa-fe64-49c1-ac1a-8e75c32e43f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:10.081584 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8454aa-fe64-49c1-ac1a-8e75c32e43f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:10.082104 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8454aa-fe64-49c1-ac1a-8e75c32e43f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:10.082386 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8454aa-fe64-49c1-ac1a-8e75c32e43f1 admin admin] PATH_INFO: `/v3/projects/0687deb7eaff421eb21bba783ed7dff1/users/3fad801d0af24f00bd5bbabc7262dc13/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:10.100593 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8454aa-fe64-49c1-ac1a-8e75c32e43f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0687deb7eaff421eb21bba783ed7dff1, user_id=3fad801d0af24f00bd5bbabc7262dc13, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:10.103885 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8454aa-fe64-49c1-ac1a-8e75c32e43f1 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:10.122756 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1349/2696] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:16:10 2022] PUT /identity/v3/projects/0687deb7eaff421eb21bba783ed7dff1/users/3fad801d0af24f00bd5bbabc7262dc13/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:10.134638 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b983aa9-8677-4174-b0f9-28891eb68a8c None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:10.134638 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b983aa9-8677-4174-b0f9-28891eb68a8c None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:10.134836 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b983aa9-8677-4174-b0f9-28891eb68a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:10.164317 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-5b983aa9-8677-4174-b0f9-28891eb68a8c None None] MFA Rules not processed for user `3fad801d0af24f00bd5bbabc7262dc13`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:10.165720 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-5b983aa9-8677-4174-b0f9-28891eb68a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:10.236716 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1348/2697] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:10.241248 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8454aa-fe64-49c1-ac1a-8e75c32e43f1 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:10.313772 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8454aa-fe64-49c1-ac1a-8e75c32e43f1 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:10.318482 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d0e78-8041-464c-831d-bd2c95167970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:10.319138 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d0e78-8041-464c-831d-bd2c95167970 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:10.319424 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d0e78-8041-464c-831d-bd2c95167970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:10.319727 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d0e78-8041-464c-831d-bd2c95167970 admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:10.320466 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d0e78-8041-464c-831d-bd2c95167970 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:10.322359 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d0e78-8041-464c-831d-bd2c95167970 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:10.346249 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1350/2698] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:16:10 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:16:10.350339 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b983aa9-8677-4174-b0f9-28891eb68a8c None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:10.362425 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b983aa9-8677-4174-b0f9-28891eb68a8c None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:10.422154 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590b4bc-fa9c-48ed-b7b8-11796546f66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:10.422819 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590b4bc-fa9c-48ed-b7b8-11796546f66f admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:10.423100 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590b4bc-fa9c-48ed-b7b8-11796546f66f admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:10.423373 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590b4bc-fa9c-48ed-b7b8-11796546f66f admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:10.424100 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590b4bc-fa9c-48ed-b7b8-11796546f66f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:10.426003 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c590b4bc-fa9c-48ed-b7b8-11796546f66f admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:10.445454 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1349/2699] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:16:10 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:16:10.449641 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d0e78-8041-464c-831d-bd2c95167970 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:10.461398 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d0e78-8041-464c-831d-bd2c95167970 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:10.467035 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b8262d-6ab6-463d-8309-2809d7b0d9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:10.467774 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8262d-6ab6-463d-8309-2809d7b0d9d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:10.468069 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8262d-6ab6-463d-8309-2809d7b0d9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:10.468354 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8262d-6ab6-463d-8309-2809d7b0d9d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:10.469104 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b8262d-6ab6-463d-8309-2809d7b0d9d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:10.471008 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b8262d-6ab6-463d-8309-2809d7b0d9d8 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:10.483468 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1351/2700] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:16:10.486890 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590b4bc-fa9c-48ed-b7b8-11796546f66f admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:10.497344 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590b4bc-fa9c-48ed-b7b8-11796546f66f admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:10.501886 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab00d6-acb3-4a7b-ac3c-78d9b97bb259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:10.502756 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab00d6-acb3-4a7b-ac3c-78d9b97bb259 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:10.503037 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab00d6-acb3-4a7b-ac3c-78d9b97bb259 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:10.503309 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab00d6-acb3-4a7b-ac3c-78d9b97bb259 admin admin] PATH_INFO: `/v3/projects/087908904ef943929618afcc655b23ca/users/27e98c1a328240b5bff88edebabe1d43/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:10.517281 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab00d6-acb3-4a7b-ac3c-78d9b97bb259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=087908904ef943929618afcc655b23ca, user_id=27e98c1a328240b5bff88edebabe1d43, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:10.519943 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab00d6-acb3-4a7b-ac3c-78d9b97bb259 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:10.531981 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1350/2701] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:16:10 2022] PUT /identity/v3/projects/087908904ef943929618afcc655b23ca/users/27e98c1a328240b5bff88edebabe1d43/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:10.535825 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b8262d-6ab6-463d-8309-2809d7b0d9d8 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:10.547294 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b8262d-6ab6-463d-8309-2809d7b0d9d8 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:10.604409 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710134b0-87f8-4c25-9753-6eac5e45fd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:10.604981 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710134b0-87f8-4c25-9753-6eac5e45fd9b admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:10.605261 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710134b0-87f8-4c25-9753-6eac5e45fd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:10.605540 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710134b0-87f8-4c25-9753-6eac5e45fd9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:10.606253 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710134b0-87f8-4c25-9753-6eac5e45fd9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:10.607860 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710134b0-87f8-4c25-9753-6eac5e45fd9b admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:10.617692 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1352/2702] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:16:10.621838 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab00d6-acb3-4a7b-ac3c-78d9b97bb259 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:10.631781 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab00d6-acb3-4a7b-ac3c-78d9b97bb259 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:10.636250 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a3935-ef29-4340-a3e2-6c9d102ccb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:10.637113 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a3935-ef29-4340-a3e2-6c9d102ccb36 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:10.637664 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a3935-ef29-4340-a3e2-6c9d102ccb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:10.637970 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a3935-ef29-4340-a3e2-6c9d102ccb36 admin admin] PATH_INFO: `/v3/projects/087908904ef943929618afcc655b23ca/users/27e98c1a328240b5bff88edebabe1d43/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:10.640074 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a3935-ef29-4340-a3e2-6c9d102ccb36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=087908904ef943929618afcc655b23ca, user_id=27e98c1a328240b5bff88edebabe1d43, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:10.642884 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a3935-ef29-4340-a3e2-6c9d102ccb36 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:10.654859 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1351/2703] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:16:10 2022] PUT /identity/v3/projects/087908904ef943929618afcc655b23ca/users/27e98c1a328240b5bff88edebabe1d43/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:10.667007 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a498d2-aebe-4070-a80e-24b428a570f2 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:10.667341 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a498d2-aebe-4070-a80e-24b428a570f2 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:10.667621 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a498d2-aebe-4070-a80e-24b428a570f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:10.694256 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-a8a498d2-aebe-4070-a80e-24b428a570f2 None None] MFA Rules not processed for user `27e98c1a328240b5bff88edebabe1d43`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:10.695460 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-a8a498d2-aebe-4070-a80e-24b428a570f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:10.759253 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1353/2704] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:10.770068 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a3935-ef29-4340-a3e2-6c9d102ccb36 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:10.771815 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-c45a3935-ef29-4340-a3e2-6c9d102ccb36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:10.827006 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a3935-ef29-4340-a3e2-6c9d102ccb36 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:10.830555 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d65f1d-b26c-4a06-a699-2663a1633248 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:10.831195 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d65f1d-b26c-4a06-a699-2663a1633248 service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:10.831472 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d65f1d-b26c-4a06-a699-2663a1633248 service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:10.831782 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d65f1d-b26c-4a06-a699-2663a1633248 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:10.883884 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d65f1d-b26c-4a06-a699-2663a1633248 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:10.885249 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d65f1d-b26c-4a06-a699-2663a1633248 service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:10.894021 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1352/2705] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:16:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:16:15.477223 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a498d2-aebe-4070-a80e-24b428a570f2 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:15.486661 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a498d2-aebe-4070-a80e-24b428a570f2 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:15.490141 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26931e74-c459-456b-a9c9-4f03e69b49d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:15.490765 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26931e74-c459-456b-a9c9-4f03e69b49d3 service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:15.491046 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26931e74-c459-456b-a9c9-4f03e69b49d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:15.491319 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26931e74-c459-456b-a9c9-4f03e69b49d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:15.501312 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26931e74-c459-456b-a9c9-4f03e69b49d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:15.502799 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26931e74-c459-456b-a9c9-4f03e69b49d3 service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:15.512860 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1354/2706] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:16:15 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:16:15.628422 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d65f1d-b26c-4a06-a699-2663a1633248 service cinder] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:15.629836 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-34d65f1d-b26c-4a06-a699-2663a1633248 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:15.696281 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d65f1d-b26c-4a06-a699-2663a1633248 service cinder] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:15.701028 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8c751-f9d9-4293-87b6-a2c9dc88a351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:15.701930 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8c751-f9d9-4293-87b6-a2c9dc88a351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:15.702210 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8c751-f9d9-4293-87b6-a2c9dc88a351 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:15.702481 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8c751-f9d9-4293-87b6-a2c9dc88a351 admin admin] PATH_INFO: `/v3/users/a8051c58ae09469b85b52ec73cfd12f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:15.703861 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8c751-f9d9-4293-87b6-a2c9dc88a351 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8051c58ae09469b85b52ec73cfd12f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:15.708179 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8c751-f9d9-4293-87b6-a2c9dc88a351 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:15.757600 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5fe8c751-f9d9-4293-87b6-a2c9dc88a351 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8051c58ae09469b85b52ec73cfd12f1'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:15.764346 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5fe8c751-f9d9-4293-87b6-a2c9dc88a351 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8051c58ae09469b85b52ec73cfd12f1'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:15.772599 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5fe8c751-f9d9-4293-87b6-a2c9dc88a351 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8051c58ae09469b85b52ec73cfd12f1'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:15.785313 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5fe8c751-f9d9-4293-87b6-a2c9dc88a351 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8051c58ae09469b85b52ec73cfd12f1'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:15.786107 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5fe8c751-f9d9-4293-87b6-a2c9dc88a351 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8051c58ae09469b85b52ec73cfd12f1'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:15.792643 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1353/2707] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:16:15 2022] DELETE /identity/v3/users/a8051c58ae09469b85b52ec73cfd12f1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:15.796937 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625156f-2809-4a53-ba9d-0d8c4a2dbae9 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:15.797304 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625156f-2809-4a53-ba9d-0d8c4a2dbae9 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:15.797691 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625156f-2809-4a53-ba9d-0d8c4a2dbae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:15.837162 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-4625156f-2809-4a53-ba9d-0d8c4a2dbae9 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:15.838537 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-4625156f-2809-4a53-ba9d-0d8c4a2dbae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:15.910597 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1355/2708] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:15.920595 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8c751-f9d9-4293-87b6-a2c9dc88a351 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:15.921975 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-5fe8c751-f9d9-4293-87b6-a2c9dc88a351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:15.979618 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8c751-f9d9-4293-87b6-a2c9dc88a351 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:15.979964 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65b5ba-e550-4081-81cb-7c7db6ef8b6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:15.980649 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65b5ba-e550-4081-81cb-7c7db6ef8b6b service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:15.980902 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65b5ba-e550-4081-81cb-7c7db6ef8b6b service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:15.981181 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65b5ba-e550-4081-81cb-7c7db6ef8b6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:15.991092 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65b5ba-e550-4081-81cb-7c7db6ef8b6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:15.992586 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65b5ba-e550-4081-81cb-7c7db6ef8b6b service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:16.001899 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1354/2709] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:16:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:16:16.609092 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625156f-2809-4a53-ba9d-0d8c4a2dbae9 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:16.610603 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-4625156f-2809-4a53-ba9d-0d8c4a2dbae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:16.622220 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625156f-2809-4a53-ba9d-0d8c4a2dbae9 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:16.626828 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f395fbe-128e-4bf1-974c-a01945d66713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:16.627633 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f395fbe-128e-4bf1-974c-a01945d66713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:16.627948 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f395fbe-128e-4bf1-974c-a01945d66713 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:16.628224 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f395fbe-128e-4bf1-974c-a01945d66713 admin admin] PATH_INFO: `/v3/projects/77ce5a9883514b709d5a9294f2b27356` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:16.629764 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f395fbe-128e-4bf1-974c-a01945d66713 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77ce5a9883514b709d5a9294f2b27356)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:16.632715 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f395fbe-128e-4bf1-974c-a01945d66713 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:16.685315 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-8f395fbe-128e-4bf1-974c-a01945d66713 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77ce5a9883514b709d5a9294f2b27356', 'request_id': 'req-8f395fbe-128e-4bf1-974c-a01945d66713'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:16.690867 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-8f395fbe-128e-4bf1-974c-a01945d66713 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77ce5a9883514b709d5a9294f2b27356', 'request_id': 'req-8f395fbe-128e-4bf1-974c-a01945d66713'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:16.698194 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-8f395fbe-128e-4bf1-974c-a01945d66713 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77ce5a9883514b709d5a9294f2b27356', 'request_id': 'req-8f395fbe-128e-4bf1-974c-a01945d66713'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:16.710506 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-8f395fbe-128e-4bf1-974c-a01945d66713 admin admin] The token cache is being invalidate because project 77ce5a9883514b709d5a9294f2b27356 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:16:16.710789 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-8f395fbe-128e-4bf1-974c-a01945d66713 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:16.711409 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-8f395fbe-128e-4bf1-974c-a01945d66713 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:16.712942 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1356/2710] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:16:16 2022] DELETE /identity/v3/projects/77ce5a9883514b709d5a9294f2b27356 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:31.165897 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65b5ba-e550-4081-81cb-7c7db6ef8b6b service neutron] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:31.167297 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-7e65b5ba-e550-4081-81cb-7c7db6ef8b6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:31.179509 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65b5ba-e550-4081-81cb-7c7db6ef8b6b service neutron] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:31.236887 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052740a-f11d-420a-81d2-0f7a3fe0fe1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:31.237848 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052740a-f11d-420a-81d2-0f7a3fe0fe1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:31.238132 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052740a-f11d-420a-81d2-0f7a3fe0fe1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:31.238408 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052740a-f11d-420a-81d2-0f7a3fe0fe1e admin admin] PATH_INFO: `/v3/users/dc1ef411e18643cab1e02fa3871ed94d` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:31.239586 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052740a-f11d-420a-81d2-0f7a3fe0fe1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc1ef411e18643cab1e02fa3871ed94d)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:31.241547 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052740a-f11d-420a-81d2-0f7a3fe0fe1e admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:31.285022 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-7052740a-f11d-420a-81d2-0f7a3fe0fe1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc1ef411e18643cab1e02fa3871ed94d'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:31.291455 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-7052740a-f11d-420a-81d2-0f7a3fe0fe1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc1ef411e18643cab1e02fa3871ed94d'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:31.298574 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-7052740a-f11d-420a-81d2-0f7a3fe0fe1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc1ef411e18643cab1e02fa3871ed94d'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:31.309903 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-7052740a-f11d-420a-81d2-0f7a3fe0fe1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc1ef411e18643cab1e02fa3871ed94d'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:31.310526 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-7052740a-f11d-420a-81d2-0f7a3fe0fe1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc1ef411e18643cab1e02fa3871ed94d'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:31.316380 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1355/2711] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:16:31 2022] DELETE /identity/v3/users/dc1ef411e18643cab1e02fa3871ed94d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:16:31.321251 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286efb8c-8950-4af6-8de0-78e107f05210 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:31.321749 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286efb8c-8950-4af6-8de0-78e107f05210 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:31.321864 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286efb8c-8950-4af6-8de0-78e107f05210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:31.339246 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-286efb8c-8950-4af6-8de0-78e107f05210 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:31.340468 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-286efb8c-8950-4af6-8de0-78e107f05210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:31.394655 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1357/2712] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:31.404785 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052740a-f11d-420a-81d2-0f7a3fe0fe1e admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:31.406175 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-7052740a-f11d-420a-81d2-0f7a3fe0fe1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:31.461500 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052740a-f11d-420a-81d2-0f7a3fe0fe1e admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:31.465221 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dfe6e8-7d66-4a66-846b-185fad25d3ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:31.465859 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dfe6e8-7d66-4a66-846b-185fad25d3ac service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:31.466155 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dfe6e8-7d66-4a66-846b-185fad25d3ac service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:31.466407 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dfe6e8-7d66-4a66-846b-185fad25d3ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:31.475089 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dfe6e8-7d66-4a66-846b-185fad25d3ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:31.476578 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dfe6e8-7d66-4a66-846b-185fad25d3ac service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:31.485522 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1356/2713] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:16:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:16:31.785860 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286efb8c-8950-4af6-8de0-78e107f05210 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:31.787288 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-286efb8c-8950-4af6-8de0-78e107f05210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:31.798853 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286efb8c-8950-4af6-8de0-78e107f05210 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:31.803425 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca591d1-aca7-4e58-97be-02e8e17d4919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:31.804831 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca591d1-aca7-4e58-97be-02e8e17d4919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:31.805114 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca591d1-aca7-4e58-97be-02e8e17d4919 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:31.805392 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca591d1-aca7-4e58-97be-02e8e17d4919 admin admin] PATH_INFO: `/v3/projects/777459d6ede04b3688b2aede6a8a612f` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:31.806624 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca591d1-aca7-4e58-97be-02e8e17d4919 admin admin] RBAC: Authorizing `identity:delete_project(project_id=777459d6ede04b3688b2aede6a8a612f)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:31.808594 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca591d1-aca7-4e58-97be-02e8e17d4919 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:31.856993 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-2ca591d1-aca7-4e58-97be-02e8e17d4919 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '777459d6ede04b3688b2aede6a8a612f', 'request_id': 'req-2ca591d1-aca7-4e58-97be-02e8e17d4919'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:31.863018 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-2ca591d1-aca7-4e58-97be-02e8e17d4919 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '777459d6ede04b3688b2aede6a8a612f', 'request_id': 'req-2ca591d1-aca7-4e58-97be-02e8e17d4919'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:31.869588 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-2ca591d1-aca7-4e58-97be-02e8e17d4919 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '777459d6ede04b3688b2aede6a8a612f', 'request_id': 'req-2ca591d1-aca7-4e58-97be-02e8e17d4919'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:31.880847 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-2ca591d1-aca7-4e58-97be-02e8e17d4919 admin admin] The token cache is being invalidate because project 777459d6ede04b3688b2aede6a8a612f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:16:31.881136 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-2ca591d1-aca7-4e58-97be-02e8e17d4919 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:31.882356 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-2ca591d1-aca7-4e58-97be-02e8e17d4919 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:31.883907 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1358/2714] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:16:31 2022] DELETE /identity/v3/projects/777459d6ede04b3688b2aede6a8a612f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:31.888722 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6ec64-7129-424c-b233-a00b2c4aa7c0 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:31.889018 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6ec64-7129-424c-b233-a00b2c4aa7c0 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:31.889292 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6ec64-7129-424c-b233-a00b2c4aa7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:31.906191 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-68e6ec64-7129-424c-b233-a00b2c4aa7c0 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:31.907369 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-68e6ec64-7129-424c-b233-a00b2c4aa7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:31.962987 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1357/2715] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:31.970597 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7ff1d-242e-43d3-a1bd-d49e2c6aeabd None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:31.970891 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7ff1d-242e-43d3-a1bd-d49e2c6aeabd None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:31.971169 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7ff1d-242e-43d3-a1bd-d49e2c6aeabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:31.989720 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-8ec7ff1d-242e-43d3-a1bd-d49e2c6aeabd None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:31.990901 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-8ec7ff1d-242e-43d3-a1bd-d49e2c6aeabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:31.999137 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1359/2716] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:16:32.003160 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6ec64-7129-424c-b233-a00b2c4aa7c0 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:32.013287 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6ec64-7129-424c-b233-a00b2c4aa7c0 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:32.017857 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b78538-49cc-438d-a789-9bf50a89463c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:32.018444 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b78538-49cc-438d-a789-9bf50a89463c admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:32.018730 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b78538-49cc-438d-a789-9bf50a89463c admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:32.019008 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b78538-49cc-438d-a789-9bf50a89463c admin admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:32.019748 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b78538-49cc-438d-a789-9bf50a89463c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:16:32.020057 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b78538-49cc-438d-a789-9bf50a89463c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:32.021638 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b78538-49cc-438d-a789-9bf50a89463c admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:32.032803 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1358/2717] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:16:32.036518 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7ff1d-242e-43d3-a1bd-d49e2c6aeabd None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:32.055213 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7ff1d-242e-43d3-a1bd-d49e2c6aeabd None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:32.059877 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9fe8d-f106-4a4e-b1bc-3b25d1a03036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:32.060521 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9fe8d-f106-4a4e-b1bc-3b25d1a03036 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:32.060803 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9fe8d-f106-4a4e-b1bc-3b25d1a03036 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:32.061079 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9fe8d-f106-4a4e-b1bc-3b25d1a03036 admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:32.061831 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9fe8d-f106-4a4e-b1bc-3b25d1a03036 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:32.064010 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9fe8d-f106-4a4e-b1bc-3b25d1a03036 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:32.089837 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1360/2718] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:16:32 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:16:32.093996 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b78538-49cc-438d-a789-9bf50a89463c admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:32.104580 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b78538-49cc-438d-a789-9bf50a89463c admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:32.162088 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f45403-f220-4a44-aece-67a4c21150fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:32.163434 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f45403-f220-4a44-aece-67a4c21150fc admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:32.163706 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f45403-f220-4a44-aece-67a4c21150fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:32.163988 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f45403-f220-4a44-aece-67a4c21150fc admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:32.167441 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f45403-f220-4a44-aece-67a4c21150fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:32.167441 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f45403-f220-4a44-aece-67a4c21150fc admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:32.186770 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1359/2719] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:16:32 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:16:32.197470 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9fe8d-f106-4a4e-b1bc-3b25d1a03036 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:32.207529 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9fe8d-f106-4a4e-b1bc-3b25d1a03036 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:32.213686 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f800f-2fa7-4161-b090-bc75487d7e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:32.214467 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f800f-2fa7-4161-b090-bc75487d7e8f admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:32.214936 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f800f-2fa7-4161-b090-bc75487d7e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:32.215277 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f800f-2fa7-4161-b090-bc75487d7e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:32.216219 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f800f-2fa7-4161-b090-bc75487d7e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:32.218026 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f800f-2fa7-4161-b090-bc75487d7e8f admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:32.230605 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1361/2720] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:16:32.234941 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f45403-f220-4a44-aece-67a4c21150fc admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:32.245473 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f45403-f220-4a44-aece-67a4c21150fc admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:32.250105 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa8741-53a7-41d7-aa01-798fd4742c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:32.250763 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa8741-53a7-41d7-aa01-798fd4742c4f admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:32.251047 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa8741-53a7-41d7-aa01-798fd4742c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:32.251328 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa8741-53a7-41d7-aa01-798fd4742c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:32.252204 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa8741-53a7-41d7-aa01-798fd4742c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:32.253795 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa8741-53a7-41d7-aa01-798fd4742c4f admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:32.264492 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1360/2721] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:16:32.269038 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f800f-2fa7-4161-b090-bc75487d7e8f admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:32.279494 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f800f-2fa7-4161-b090-bc75487d7e8f admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:32.284103 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85c907-0884-40c9-ab11-464671f5b538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:32.285040 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85c907-0884-40c9-ab11-464671f5b538 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:32.285411 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85c907-0884-40c9-ab11-464671f5b538 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:32.285748 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85c907-0884-40c9-ab11-464671f5b538 admin admin] PATH_INFO: `/v3/projects/cecd9d25885b4bf98a6cfaf6ce96bbc4/users/ab5174ffb28c4af79dedbee6eb66e065/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:32.301302 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85c907-0884-40c9-ab11-464671f5b538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cecd9d25885b4bf98a6cfaf6ce96bbc4, user_id=ab5174ffb28c4af79dedbee6eb66e065, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:32.305069 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85c907-0884-40c9-ab11-464671f5b538 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:32.320717 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1362/2722] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:16:32 2022] PUT /identity/v3/projects/cecd9d25885b4bf98a6cfaf6ce96bbc4/users/ab5174ffb28c4af79dedbee6eb66e065/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:32.331186 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993ff13-a97c-44d5-817f-303ed3cb8b70 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:32.331504 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993ff13-a97c-44d5-817f-303ed3cb8b70 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:32.331862 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993ff13-a97c-44d5-817f-303ed3cb8b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:32.359849 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-f993ff13-a97c-44d5-817f-303ed3cb8b70 None None] MFA Rules not processed for user `ab5174ffb28c4af79dedbee6eb66e065`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:32.361077 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-f993ff13-a97c-44d5-817f-303ed3cb8b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:32.422219 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1361/2723] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:32.433186 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85c907-0884-40c9-ab11-464671f5b538 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:32.434933 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-ad85c907-0884-40c9-ab11-464671f5b538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:32.489477 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85c907-0884-40c9-ab11-464671f5b538 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:32.493170 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b067f-a9ef-4208-902d-24cbf3610e35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:32.493785 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b067f-a9ef-4208-902d-24cbf3610e35 service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:32.494071 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b067f-a9ef-4208-902d-24cbf3610e35 service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:32.494351 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b067f-a9ef-4208-902d-24cbf3610e35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:32.502438 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b067f-a9ef-4208-902d-24cbf3610e35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:32.503901 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b067f-a9ef-4208-902d-24cbf3610e35 service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:32.512489 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1363/2724] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:16:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:16:41.200876 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993ff13-a97c-44d5-817f-303ed3cb8b70 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:41.202431 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-f993ff13-a97c-44d5-817f-303ed3cb8b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:41.265800 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993ff13-a97c-44d5-817f-303ed3cb8b70 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:41.270566 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de827d-1a67-47c5-9f1b-474fe859913f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:41.271458 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de827d-1a67-47c5-9f1b-474fe859913f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:41.271768 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de827d-1a67-47c5-9f1b-474fe859913f admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:41.272044 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de827d-1a67-47c5-9f1b-474fe859913f admin admin] PATH_INFO: `/v3/users/3fad801d0af24f00bd5bbabc7262dc13` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:41.273215 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de827d-1a67-47c5-9f1b-474fe859913f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fad801d0af24f00bd5bbabc7262dc13)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:41.275669 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de827d-1a67-47c5-9f1b-474fe859913f admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:41.323200 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-57de827d-1a67-47c5-9f1b-474fe859913f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fad801d0af24f00bd5bbabc7262dc13'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:41.330428 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-57de827d-1a67-47c5-9f1b-474fe859913f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fad801d0af24f00bd5bbabc7262dc13'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:41.338948 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-57de827d-1a67-47c5-9f1b-474fe859913f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fad801d0af24f00bd5bbabc7262dc13'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:41.353542 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-57de827d-1a67-47c5-9f1b-474fe859913f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fad801d0af24f00bd5bbabc7262dc13'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:41.354264 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-57de827d-1a67-47c5-9f1b-474fe859913f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fad801d0af24f00bd5bbabc7262dc13'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:41.360364 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1362/2725] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:16:41 2022] DELETE /identity/v3/users/3fad801d0af24f00bd5bbabc7262dc13 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:41.365058 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61a3d8-4b4e-4532-9409-40ff505aab58 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:41.365535 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61a3d8-4b4e-4532-9409-40ff505aab58 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:41.365535 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61a3d8-4b4e-4532-9409-40ff505aab58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:41.382988 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-4a61a3d8-4b4e-4532-9409-40ff505aab58 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:41.385375 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-4a61a3d8-4b4e-4532-9409-40ff505aab58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:41.446570 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1364/2726] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:41.456624 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de827d-1a67-47c5-9f1b-474fe859913f admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:41.458451 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-57de827d-1a67-47c5-9f1b-474fe859913f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:41.518047 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de827d-1a67-47c5-9f1b-474fe859913f admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:41.521580 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937bf5e-1931-4cda-b6e6-b3944e7a5ce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:41.522222 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937bf5e-1931-4cda-b6e6-b3944e7a5ce8 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:41.522500 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937bf5e-1931-4cda-b6e6-b3944e7a5ce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:41.522817 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937bf5e-1931-4cda-b6e6-b3944e7a5ce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:41.532294 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6937bf5e-1931-4cda-b6e6-b3944e7a5ce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:41.533748 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6937bf5e-1931-4cda-b6e6-b3944e7a5ce8 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:41.543929 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1363/2727] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:16:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:16:41.816656 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61a3d8-4b4e-4532-9409-40ff505aab58 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:41.818270 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-4a61a3d8-4b4e-4532-9409-40ff505aab58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:41.833026 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61a3d8-4b4e-4532-9409-40ff505aab58 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:41.839759 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466a8bd-aa8d-4208-aec3-a7278cf55e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:41.841414 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466a8bd-aa8d-4208-aec3-a7278cf55e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:41.841916 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466a8bd-aa8d-4208-aec3-a7278cf55e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:41.842402 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466a8bd-aa8d-4208-aec3-a7278cf55e02 admin admin] PATH_INFO: `/v3/projects/0687deb7eaff421eb21bba783ed7dff1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:41.843874 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9466a8bd-aa8d-4208-aec3-a7278cf55e02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0687deb7eaff421eb21bba783ed7dff1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:41.847570 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9466a8bd-aa8d-4208-aec3-a7278cf55e02 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:41.900808 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-9466a8bd-aa8d-4208-aec3-a7278cf55e02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0687deb7eaff421eb21bba783ed7dff1', 'request_id': 'req-9466a8bd-aa8d-4208-aec3-a7278cf55e02'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:41.906898 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-9466a8bd-aa8d-4208-aec3-a7278cf55e02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0687deb7eaff421eb21bba783ed7dff1', 'request_id': 'req-9466a8bd-aa8d-4208-aec3-a7278cf55e02'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:41.915130 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-9466a8bd-aa8d-4208-aec3-a7278cf55e02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0687deb7eaff421eb21bba783ed7dff1', 'request_id': 'req-9466a8bd-aa8d-4208-aec3-a7278cf55e02'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:41.929078 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-9466a8bd-aa8d-4208-aec3-a7278cf55e02 admin admin] The token cache is being invalidate because project 0687deb7eaff421eb21bba783ed7dff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:16:41.929380 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-9466a8bd-aa8d-4208-aec3-a7278cf55e02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:41.930036 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-9466a8bd-aa8d-4208-aec3-a7278cf55e02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:41.931854 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1365/2728] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:16:41 2022] DELETE /identity/v3/projects/0687deb7eaff421eb21bba783ed7dff1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:41.936728 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937bf5e-1931-4cda-b6e6-b3944e7a5ce8 service neutron] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:41.950053 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937bf5e-1931-4cda-b6e6-b3944e7a5ce8 service neutron] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:42.006150 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e374a-9aa5-4688-85a3-12493aff5c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:42.007066 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e374a-9aa5-4688-85a3-12493aff5c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:42.007368 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e374a-9aa5-4688-85a3-12493aff5c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:42.007618 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e374a-9aa5-4688-85a3-12493aff5c11 admin admin] PATH_INFO: `/v3/users/27e98c1a328240b5bff88edebabe1d43` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:42.009506 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e374a-9aa5-4688-85a3-12493aff5c11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27e98c1a328240b5bff88edebabe1d43)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:42.011395 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e374a-9aa5-4688-85a3-12493aff5c11 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:42.056362 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-115e374a-9aa5-4688-85a3-12493aff5c11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27e98c1a328240b5bff88edebabe1d43'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:42.063144 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-115e374a-9aa5-4688-85a3-12493aff5c11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27e98c1a328240b5bff88edebabe1d43'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:42.071628 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-115e374a-9aa5-4688-85a3-12493aff5c11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27e98c1a328240b5bff88edebabe1d43'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:42.084524 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-115e374a-9aa5-4688-85a3-12493aff5c11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27e98c1a328240b5bff88edebabe1d43'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:42.085365 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-115e374a-9aa5-4688-85a3-12493aff5c11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27e98c1a328240b5bff88edebabe1d43'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:42.092333 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1364/2729] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:16:41 2022] DELETE /identity/v3/users/27e98c1a328240b5bff88edebabe1d43 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:42.347617 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466a8bd-aa8d-4208-aec3-a7278cf55e02 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:42.349079 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-9466a8bd-aa8d-4208-aec3-a7278cf55e02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:42.361472 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466a8bd-aa8d-4208-aec3-a7278cf55e02 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:42.419770 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705b396-9859-47fc-9d9c-6cc7d3eace0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:42.420633 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705b396-9859-47fc-9d9c-6cc7d3eace0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:42.420921 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705b396-9859-47fc-9d9c-6cc7d3eace0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:42.421204 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705b396-9859-47fc-9d9c-6cc7d3eace0a admin admin] PATH_INFO: `/v3/projects/087908904ef943929618afcc655b23ca` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:42.422384 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705b396-9859-47fc-9d9c-6cc7d3eace0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=087908904ef943929618afcc655b23ca)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:42.424326 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705b396-9859-47fc-9d9c-6cc7d3eace0a admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:42.469194 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c705b396-9859-47fc-9d9c-6cc7d3eace0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '087908904ef943929618afcc655b23ca', 'request_id': 'req-c705b396-9859-47fc-9d9c-6cc7d3eace0a'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:42.474464 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c705b396-9859-47fc-9d9c-6cc7d3eace0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '087908904ef943929618afcc655b23ca', 'request_id': 'req-c705b396-9859-47fc-9d9c-6cc7d3eace0a'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:42.480894 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c705b396-9859-47fc-9d9c-6cc7d3eace0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '087908904ef943929618afcc655b23ca', 'request_id': 'req-c705b396-9859-47fc-9d9c-6cc7d3eace0a'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:42.493242 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c705b396-9859-47fc-9d9c-6cc7d3eace0a admin admin] The token cache is being invalidate because project 087908904ef943929618afcc655b23ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:16:42.493534 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c705b396-9859-47fc-9d9c-6cc7d3eace0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:42.494276 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c705b396-9859-47fc-9d9c-6cc7d3eace0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:42.495801 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1366/2730] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:16:42 2022] DELETE /identity/v3/projects/087908904ef943929618afcc655b23ca => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:42.500582 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf1263-ac5b-4104-bcf5-8b695311953c None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:42.501066 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf1263-ac5b-4104-bcf5-8b695311953c None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:42.501166 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf1263-ac5b-4104-bcf5-8b695311953c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:42.518300 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-cddf1263-ac5b-4104-bcf5-8b695311953c None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:42.519501 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-cddf1263-ac5b-4104-bcf5-8b695311953c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:42.575373 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1365/2731] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:42.583955 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7da926-3e17-40f8-95ed-7a0201c36a09 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:42.584251 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7da926-3e17-40f8-95ed-7a0201c36a09 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:42.584536 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7da926-3e17-40f8-95ed-7a0201c36a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:42.602824 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-ba7da926-3e17-40f8-95ed-7a0201c36a09 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:42.604052 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-ba7da926-3e17-40f8-95ed-7a0201c36a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:42.611870 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1367/2732] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:42.615896 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf1263-ac5b-4104-bcf5-8b695311953c None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:42.626216 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf1263-ac5b-4104-bcf5-8b695311953c None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:42.630736 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80ff0b-e22d-4c3f-bd61-b3be0c125fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:42.631385 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80ff0b-e22d-4c3f-bd61-b3be0c125fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:42.631665 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80ff0b-e22d-4c3f-bd61-b3be0c125fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:42.631980 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80ff0b-e22d-4c3f-bd61-b3be0c125fb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:42.632693 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80ff0b-e22d-4c3f-bd61-b3be0c125fb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:16:42.633023 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80ff0b-e22d-4c3f-bd61-b3be0c125fb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:42.634670 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80ff0b-e22d-4c3f-bd61-b3be0c125fb7 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:42.645934 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1366/2733] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:16:42.650335 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7da926-3e17-40f8-95ed-7a0201c36a09 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:42.659743 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7da926-3e17-40f8-95ed-7a0201c36a09 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:42.666168 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc1e67-14da-4274-9fac-74f3e71c7cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:42.666833 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc1e67-14da-4274-9fac-74f3e71c7cce admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:42.667121 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc1e67-14da-4274-9fac-74f3e71c7cce admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:42.667402 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc1e67-14da-4274-9fac-74f3e71c7cce admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:42.668152 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc1e67-14da-4274-9fac-74f3e71c7cce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:42.670056 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc1e67-14da-4274-9fac-74f3e71c7cce admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:42.696634 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1368/2734] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:16:42 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:16:42.701144 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80ff0b-e22d-4c3f-bd61-b3be0c125fb7 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:42.710929 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80ff0b-e22d-4c3f-bd61-b3be0c125fb7 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:42.765165 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9258f91-96a6-478b-ac3b-8402e8b83ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:42.765911 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9258f91-96a6-478b-ac3b-8402e8b83ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:42.766196 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9258f91-96a6-478b-ac3b-8402e8b83ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:42.766470 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9258f91-96a6-478b-ac3b-8402e8b83ce6 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:42.767183 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9258f91-96a6-478b-ac3b-8402e8b83ce6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:42.769264 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9258f91-96a6-478b-ac3b-8402e8b83ce6 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:42.788679 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1367/2735] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:16:42 2022] POST /identity/v3/users => generated 291 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:16:42.793307 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc1e67-14da-4274-9fac-74f3e71c7cce admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:42.803316 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc1e67-14da-4274-9fac-74f3e71c7cce admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:42.808540 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6b4be-89b8-47bc-bf27-5b7c59a93b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:42.809185 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6b4be-89b8-47bc-bf27-5b7c59a93b1d admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:42.809470 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6b4be-89b8-47bc-bf27-5b7c59a93b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:42.809745 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6b4be-89b8-47bc-bf27-5b7c59a93b1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:42.810467 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6b4be-89b8-47bc-bf27-5b7c59a93b1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:42.812091 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6b4be-89b8-47bc-bf27-5b7c59a93b1d admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:42.822356 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1369/2736] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:16:42.826224 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9258f91-96a6-478b-ac3b-8402e8b83ce6 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:42.835676 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9258f91-96a6-478b-ac3b-8402e8b83ce6 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:42.840684 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b516598-c4fe-4488-b393-42f34f019ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:42.841322 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b516598-c4fe-4488-b393-42f34f019ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:42.841603 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b516598-c4fe-4488-b393-42f34f019ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:42.841878 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b516598-c4fe-4488-b393-42f34f019ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:42.842618 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b516598-c4fe-4488-b393-42f34f019ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:42.844235 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b516598-c4fe-4488-b393-42f34f019ac2 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:42.854190 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1368/2737] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:16:42.858042 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6b4be-89b8-47bc-bf27-5b7c59a93b1d admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:42.867910 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6b4be-89b8-47bc-bf27-5b7c59a93b1d admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:42.872504 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf234e-27cd-43db-9aa5-001e6fd2c54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:42.873377 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf234e-27cd-43db-9aa5-001e6fd2c54c admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:42.873664 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf234e-27cd-43db-9aa5-001e6fd2c54c admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:42.873941 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf234e-27cd-43db-9aa5-001e6fd2c54c admin admin] PATH_INFO: `/v3/projects/7fd2bbf103e14b95b6de082e4cc435f0/users/4c50ab09aafa49369919ec6b1efc09e3/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:42.887941 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf234e-27cd-43db-9aa5-001e6fd2c54c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fd2bbf103e14b95b6de082e4cc435f0, user_id=4c50ab09aafa49369919ec6b1efc09e3, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:42.890615 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf234e-27cd-43db-9aa5-001e6fd2c54c admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:42.904364 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1370/2738] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:16:42 2022] PUT /identity/v3/projects/7fd2bbf103e14b95b6de082e4cc435f0/users/4c50ab09aafa49369919ec6b1efc09e3/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:42.915361 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403027c-d16f-415e-affb-7b82140dfbd7 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:42.915649 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403027c-d16f-415e-affb-7b82140dfbd7 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:42.916065 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403027c-d16f-415e-affb-7b82140dfbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:42.942626 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-3403027c-d16f-415e-affb-7b82140dfbd7 None None] MFA Rules not processed for user `4c50ab09aafa49369919ec6b1efc09e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:42.945433 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-3403027c-d16f-415e-affb-7b82140dfbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:42.969515 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf234e-27cd-43db-9aa5-001e6fd2c54c admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:42.971395 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-40cf234e-27cd-43db-9aa5-001e6fd2c54c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:43.017933 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1369/2739] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:43.022355 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403027c-d16f-415e-affb-7b82140dfbd7 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:43.044652 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf234e-27cd-43db-9aa5-001e6fd2c54c admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:43.049678 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797342cb-0093-4faf-823b-45c3c3f3b325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:43.050840 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797342cb-0093-4faf-823b-45c3c3f3b325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:43.051155 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797342cb-0093-4faf-823b-45c3c3f3b325 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:43.051584 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797342cb-0093-4faf-823b-45c3c3f3b325 admin admin] PATH_INFO: `/v3/users/ab5174ffb28c4af79dedbee6eb66e065` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:43.052853 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797342cb-0093-4faf-823b-45c3c3f3b325 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab5174ffb28c4af79dedbee6eb66e065)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:43.054746 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797342cb-0093-4faf-823b-45c3c3f3b325 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:43.085657 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403027c-d16f-415e-affb-7b82140dfbd7 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:43.091209 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7c0de-6456-4ad3-89e9-71d6293ca887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:43.091897 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7c0de-6456-4ad3-89e9-71d6293ca887 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:43.092182 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7c0de-6456-4ad3-89e9-71d6293ca887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:43.092453 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7c0de-6456-4ad3-89e9-71d6293ca887 admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:43.093136 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b7c0de-6456-4ad3-89e9-71d6293ca887 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:43.095043 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b7c0de-6456-4ad3-89e9-71d6293ca887 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:43.105144 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-797342cb-0093-4faf-823b-45c3c3f3b325 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab5174ffb28c4af79dedbee6eb66e065'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:43.105855 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-797342cb-0093-4faf-823b-45c3c3f3b325 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab5174ffb28c4af79dedbee6eb66e065'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:43.112924 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-797342cb-0093-4faf-823b-45c3c3f3b325 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab5174ffb28c4af79dedbee6eb66e065'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:43.122237 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1370/2740] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:16:43 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:16:43.126167 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7c0de-6456-4ad3-89e9-71d6293ca887 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:43.126911 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-797342cb-0093-4faf-823b-45c3c3f3b325 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab5174ffb28c4af79dedbee6eb66e065'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:43.127597 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-797342cb-0093-4faf-823b-45c3c3f3b325 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab5174ffb28c4af79dedbee6eb66e065'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:43.140554 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1371/2741] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:16:42 2022] DELETE /identity/v3/users/ab5174ffb28c4af79dedbee6eb66e065 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:16:43.144910 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c76f9-17b5-4dc6-b5b8-1c700e600813 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:43.145570 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c76f9-17b5-4dc6-b5b8-1c700e600813 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:43.145570 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c76f9-17b5-4dc6-b5b8-1c700e600813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:43.162277 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-2f7c76f9-17b5-4dc6-b5b8-1c700e600813 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:43.163561 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-2f7c76f9-17b5-4dc6-b5b8-1c700e600813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:43.185463 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7c0de-6456-4ad3-89e9-71d6293ca887 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:43.221457 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1372/2742] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:16:43.231635 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c76f9-17b5-4dc6-b5b8-1c700e600813 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:43.233008 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-2f7c76f9-17b5-4dc6-b5b8-1c700e600813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:43.238655 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032ad71-d55c-4218-8c6d-1c1b788e984b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:43.239349 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032ad71-d55c-4218-8c6d-1c1b788e984b admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:43.239630 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032ad71-d55c-4218-8c6d-1c1b788e984b admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:43.239937 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032ad71-d55c-4218-8c6d-1c1b788e984b admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:43.240617 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032ad71-d55c-4218-8c6d-1c1b788e984b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:43.242744 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032ad71-d55c-4218-8c6d-1c1b788e984b admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:43.265141 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1371/2743] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:16:43 2022] POST /identity/v3/users => generated 296 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:16:43.266370 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032ad71-d55c-4218-8c6d-1c1b788e984b admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:43.268079 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-7032ad71-d55c-4218-8c6d-1c1b788e984b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:43.279714 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032ad71-d55c-4218-8c6d-1c1b788e984b admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:43.284764 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752235b-732a-4437-9d00-404bfc9bd6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:43.285420 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752235b-732a-4437-9d00-404bfc9bd6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:43.285846 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752235b-732a-4437-9d00-404bfc9bd6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:43.286128 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752235b-732a-4437-9d00-404bfc9bd6a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:43.286851 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752235b-732a-4437-9d00-404bfc9bd6a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:43.288635 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752235b-732a-4437-9d00-404bfc9bd6a8 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:43.292237 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c76f9-17b5-4dc6-b5b8-1c700e600813 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:43.296231 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d76df7-d6e3-4fdc-a7ba-ec4f4f811cc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:43.296862 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d76df7-d6e3-4fdc-a7ba-ec4f4f811cc0 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:43.297141 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d76df7-d6e3-4fdc-a7ba-ec4f4f811cc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:43.297417 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d76df7-d6e3-4fdc-a7ba-ec4f4f811cc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:43.298602 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1372/2744] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:16:43.302654 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752235b-732a-4437-9d00-404bfc9bd6a8 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:43.306507 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d76df7-d6e3-4fdc-a7ba-ec4f4f811cc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:43.307968 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d76df7-d6e3-4fdc-a7ba-ec4f4f811cc0 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:43.311834 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752235b-732a-4437-9d00-404bfc9bd6a8 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:43.316680 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d53bc8-d0e9-404e-8c77-75ad3d3d0ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:43.317534 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d53bc8-d0e9-404e-8c77-75ad3d3d0ba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:43.317668 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1373/2745] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:16:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:16:43.317871 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d53bc8-d0e9-404e-8c77-75ad3d3d0ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:43.318155 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d53bc8-d0e9-404e-8c77-75ad3d3d0ba0 admin admin] PATH_INFO: `/v3/projects/a433936e82f84f89bf5ee6b772a99ff3/users/dd595c8cc9ce4acba033bfaeac2b95f5/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:43.333230 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d53bc8-d0e9-404e-8c77-75ad3d3d0ba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a433936e82f84f89bf5ee6b772a99ff3, user_id=dd595c8cc9ce4acba033bfaeac2b95f5, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:43.336045 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d53bc8-d0e9-404e-8c77-75ad3d3d0ba0 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:43.349552 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1373/2746] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:16:43 2022] PUT /identity/v3/projects/a433936e82f84f89bf5ee6b772a99ff3/users/dd595c8cc9ce4acba033bfaeac2b95f5/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:43.353638 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d76df7-d6e3-4fdc-a7ba-ec4f4f811cc0 service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:43.362989 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d76df7-d6e3-4fdc-a7ba-ec4f4f811cc0 service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:43.421722 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9183b-a8e1-4cbc-9d73-52ff2acf6742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:43.422425 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9183b-a8e1-4cbc-9d73-52ff2acf6742 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:43.422700 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9183b-a8e1-4cbc-9d73-52ff2acf6742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:43.422980 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9183b-a8e1-4cbc-9d73-52ff2acf6742 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:43.423844 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c9183b-a8e1-4cbc-9d73-52ff2acf6742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:43.425352 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c9183b-a8e1-4cbc-9d73-52ff2acf6742 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:43.435306 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1374/2747] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:16:43.439901 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d53bc8-d0e9-404e-8c77-75ad3d3d0ba0 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:43.450692 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d53bc8-d0e9-404e-8c77-75ad3d3d0ba0 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:43.458078 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91349962-2329-4f8e-b51d-467802374635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:43.459088 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91349962-2329-4f8e-b51d-467802374635 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:43.459452 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91349962-2329-4f8e-b51d-467802374635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:43.459838 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91349962-2329-4f8e-b51d-467802374635 admin admin] PATH_INFO: `/v3/projects/a433936e82f84f89bf5ee6b772a99ff3/users/dd595c8cc9ce4acba033bfaeac2b95f5/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:43.462793 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91349962-2329-4f8e-b51d-467802374635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a433936e82f84f89bf5ee6b772a99ff3, user_id=dd595c8cc9ce4acba033bfaeac2b95f5, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:43.466092 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91349962-2329-4f8e-b51d-467802374635 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:43.477102 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1374/2748] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:16:43 2022] PUT /identity/v3/projects/a433936e82f84f89bf5ee6b772a99ff3/users/dd595c8cc9ce4acba033bfaeac2b95f5/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:16:43.487209 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e0da9-15a4-4b53-9c00-962952bec526 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:43.487496 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e0da9-15a4-4b53-9c00-962952bec526 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:43.487842 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e0da9-15a4-4b53-9c00-962952bec526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:43.514514 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-3d7e0da9-15a4-4b53-9c00-962952bec526 None None] MFA Rules not processed for user `dd595c8cc9ce4acba033bfaeac2b95f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:43.515746 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-3d7e0da9-15a4-4b53-9c00-962952bec526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:43.579466 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91349962-2329-4f8e-b51d-467802374635 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:43.581885 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-91349962-2329-4f8e-b51d-467802374635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:43.591861 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1375/2749] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:43.600000 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e0da9-15a4-4b53-9c00-962952bec526 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:43.601837 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-3d7e0da9-15a4-4b53-9c00-962952bec526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:43.648204 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91349962-2329-4f8e-b51d-467802374635 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:43.652823 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0dac14-36d6-4456-9436-b83219f12a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:43.653678 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dac14-36d6-4456-9436-b83219f12a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:43.653956 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dac14-36d6-4456-9436-b83219f12a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:43.654225 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dac14-36d6-4456-9436-b83219f12a30 admin admin] PATH_INFO: `/v3/projects/cecd9d25885b4bf98a6cfaf6ce96bbc4` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:43.655381 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0dac14-36d6-4456-9436-b83219f12a30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cecd9d25885b4bf98a6cfaf6ce96bbc4)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:43.657297 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0dac14-36d6-4456-9436-b83219f12a30 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:43.659570 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e0da9-15a4-4b53-9c00-962952bec526 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:43.663726 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf410a0-7ea3-429d-b8f3-8df1c559a1e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:43.664419 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf410a0-7ea3-429d-b8f3-8df1c559a1e9 service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:43.664704 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf410a0-7ea3-429d-b8f3-8df1c559a1e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:43.664982 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf410a0-7ea3-429d-b8f3-8df1c559a1e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:43.674742 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf410a0-7ea3-429d-b8f3-8df1c559a1e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:43.676288 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf410a0-7ea3-429d-b8f3-8df1c559a1e9 service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:43.686692 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1376/2750] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:16:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:16:43.704870 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-4e0dac14-36d6-4456-9436-b83219f12a30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cecd9d25885b4bf98a6cfaf6ce96bbc4', 'request_id': 'req-4e0dac14-36d6-4456-9436-b83219f12a30'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:43.710378 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-4e0dac14-36d6-4456-9436-b83219f12a30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cecd9d25885b4bf98a6cfaf6ce96bbc4', 'request_id': 'req-4e0dac14-36d6-4456-9436-b83219f12a30'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:43.716953 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-4e0dac14-36d6-4456-9436-b83219f12a30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cecd9d25885b4bf98a6cfaf6ce96bbc4', 'request_id': 'req-4e0dac14-36d6-4456-9436-b83219f12a30'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:43.729758 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-4e0dac14-36d6-4456-9436-b83219f12a30 admin admin] The token cache is being invalidate because project cecd9d25885b4bf98a6cfaf6ce96bbc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:16:43.730095 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-4e0dac14-36d6-4456-9436-b83219f12a30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:43.730694 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-4e0dac14-36d6-4456-9436-b83219f12a30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:43.732462 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1375/2751] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:16:43 2022] DELETE /identity/v3/projects/cecd9d25885b4bf98a6cfaf6ce96bbc4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:16:43.737199 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776767f-ec90-4f17-882e-ac0cfc2f1a47 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:43.737513 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776767f-ec90-4f17-882e-ac0cfc2f1a47 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:43.737791 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776767f-ec90-4f17-882e-ac0cfc2f1a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:43.755939 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-a776767f-ec90-4f17-882e-ac0cfc2f1a47 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:43.757382 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-a776767f-ec90-4f17-882e-ac0cfc2f1a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:43.823060 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1377/2752] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:43.831772 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8e28d-fe27-40f2-9e17-3abc4cebd9bf None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:43.832130 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8e28d-fe27-40f2-9e17-3abc4cebd9bf None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:43.832411 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8e28d-fe27-40f2-9e17-3abc4cebd9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:43.852339 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-5bd8e28d-fe27-40f2-9e17-3abc4cebd9bf None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:43.853531 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-5bd8e28d-fe27-40f2-9e17-3abc4cebd9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:43.861557 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1376/2753] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:43.865800 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776767f-ec90-4f17-882e-ac0cfc2f1a47 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:43.876005 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776767f-ec90-4f17-882e-ac0cfc2f1a47 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:43.881934 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141fc2a4-5b2d-4d02-bf65-22d83e3817c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:43.882631 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fc2a4-5b2d-4d02-bf65-22d83e3817c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:43.882907 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fc2a4-5b2d-4d02-bf65-22d83e3817c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:43.883836 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fc2a4-5b2d-4d02-bf65-22d83e3817c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:43.884914 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141fc2a4-5b2d-4d02-bf65-22d83e3817c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:16:43.884914 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141fc2a4-5b2d-4d02-bf65-22d83e3817c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:43.886436 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141fc2a4-5b2d-4d02-bf65-22d83e3817c7 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:43.899100 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1378/2754] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:16:43.903271 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8e28d-fe27-40f2-9e17-3abc4cebd9bf None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:43.912814 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8e28d-fe27-40f2-9e17-3abc4cebd9bf None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:43.918423 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7766283-c21b-4889-b270-3d451db669e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:43.919180 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7766283-c21b-4889-b270-3d451db669e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:43.919510 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7766283-c21b-4889-b270-3d451db669e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:43.919887 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7766283-c21b-4889-b270-3d451db669e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:43.920657 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7766283-c21b-4889-b270-3d451db669e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:43.922639 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7766283-c21b-4889-b270-3d451db669e1 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:43.951534 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1377/2755] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:16:43 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:16:43.956490 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141fc2a4-5b2d-4d02-bf65-22d83e3817c7 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:43.966615 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141fc2a4-5b2d-4d02-bf65-22d83e3817c7 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:44.013253 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7766283-c21b-4889-b270-3d451db669e1 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:44.014958 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-d7766283-c21b-4889-b270-3d451db669e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:44.024852 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf6098-a3df-4c2e-ad58-86850a661196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:44.025524 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf6098-a3df-4c2e-ad58-86850a661196 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:44.025808 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf6098-a3df-4c2e-ad58-86850a661196 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:44.026084 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf6098-a3df-4c2e-ad58-86850a661196 admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:44.026767 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf6098-a3df-4c2e-ad58-86850a661196 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:44.028830 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf6098-a3df-4c2e-ad58-86850a661196 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:44.049624 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1379/2756] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:16:43 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:16:44.053747 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf6098-a3df-4c2e-ad58-86850a661196 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:44.064112 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf6098-a3df-4c2e-ad58-86850a661196 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:44.068757 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1a812-1e0e-4d83-ae12-e71f0b8ceb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:44.069416 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1a812-1e0e-4d83-ae12-e71f0b8ceb94 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:44.069703 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1a812-1e0e-4d83-ae12-e71f0b8ceb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:44.069981 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1a812-1e0e-4d83-ae12-e71f0b8ceb94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:44.070847 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1a812-1e0e-4d83-ae12-e71f0b8ceb94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:44.072484 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1a812-1e0e-4d83-ae12-e71f0b8ceb94 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:44.083189 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1380/2757] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:16:44.086790 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1a812-1e0e-4d83-ae12-e71f0b8ceb94 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:44.089648 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7766283-c21b-4889-b270-3d451db669e1 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:44.094565 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affab495-9f9c-48ad-9729-ef07bb74ec42 tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd595c8cc9ce4acba033bfaeac2b95f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a433936e82f84f89bf5ee6b772a99ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:44.095221 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affab495-9f9c-48ad-9729-ef07bb74ec42 tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:44.095505 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affab495-9f9c-48ad-9729-ef07bb74ec42 tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:44.095815 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affab495-9f9c-48ad-9729-ef07bb74ec42 tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:44.096462 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1a812-1e0e-4d83-ae12-e71f0b8ceb94 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:44.096593 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affab495-9f9c-48ad-9729-ef07bb74ec42 tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:16:44.096826 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affab495-9f9c-48ad-9729-ef07bb74ec42 tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:44.098398 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affab495-9f9c-48ad-9729-ef07bb74ec42 tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:44.101047 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27e22e-00f6-4219-82e5-09158a564ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:44.102198 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27e22e-00f6-4219-82e5-09158a564ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:44.102464 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27e22e-00f6-4219-82e5-09158a564ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:44.102741 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27e22e-00f6-4219-82e5-09158a564ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:44.103455 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27e22e-00f6-4219-82e5-09158a564ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:44.105053 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27e22e-00f6-4219-82e5-09158a564ed9 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:44.113091 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1378/2758] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 04:16:44.118796 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1381/2759] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:16:44.118953 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affab495-9f9c-48ad-9729-ef07bb74ec42 tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:44.121795 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27e22e-00f6-4219-82e5-09158a564ed9 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:44.126476 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affab495-9f9c-48ad-9729-ef07bb74ec42 tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:44.131037 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079e8ae-2a11-498d-be5f-358b34aae19d tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd595c8cc9ce4acba033bfaeac2b95f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a433936e82f84f89bf5ee6b772a99ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:44.131262 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27e22e-00f6-4219-82e5-09158a564ed9 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:44.131696 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079e8ae-2a11-498d-be5f-358b34aae19d tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:44.131989 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079e8ae-2a11-498d-be5f-358b34aae19d tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:44.132263 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079e8ae-2a11-498d-be5f-358b34aae19d tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:44.133009 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079e8ae-2a11-498d-be5f-358b34aae19d tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:44.135086 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079e8ae-2a11-498d-be5f-358b34aae19d tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:44.136645 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987475ce-0cdb-43fa-b2fb-258038f4908e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:44.137511 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987475ce-0cdb-43fa-b2fb-258038f4908e admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:44.137794 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987475ce-0cdb-43fa-b2fb-258038f4908e admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:44.138071 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987475ce-0cdb-43fa-b2fb-258038f4908e admin admin] PATH_INFO: `/v3/projects/1957e705ba684f68bc0b1a47c235d6a6/users/56f842d811c9452995b8704fcf989093/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:44.152424 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987475ce-0cdb-43fa-b2fb-258038f4908e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1957e705ba684f68bc0b1a47c235d6a6, user_id=56f842d811c9452995b8704fcf989093, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:44.155218 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987475ce-0cdb-43fa-b2fb-258038f4908e admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:44.162164 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1379/2760] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:16:44 2022] POST /identity/v3/projects => generated 353 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:16:44.166761 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079e8ae-2a11-498d-be5f-358b34aae19d tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:44.169086 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1382/2761] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:16:44 2022] PUT /identity/v3/projects/1957e705ba684f68bc0b1a47c235d6a6/users/56f842d811c9452995b8704fcf989093/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:44.173766 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ff6d1-c797-4340-8abf-40e7d82dda5f None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:44.174059 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ff6d1-c797-4340-8abf-40e7d82dda5f None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:44.174341 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ff6d1-c797-4340-8abf-40e7d82dda5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:44.191614 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-f11ff6d1-c797-4340-8abf-40e7d82dda5f None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:44.192865 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-f11ff6d1-c797-4340-8abf-40e7d82dda5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:44.225578 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079e8ae-2a11-498d-be5f-358b34aae19d tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:44.249055 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1383/2762] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:16:44.258675 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ff6d1-c797-4340-8abf-40e7d82dda5f None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:44.260083 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-f11ff6d1-c797-4340-8abf-40e7d82dda5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:44.279146 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d21a5-9952-422c-8e2d-ee8745748eed tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd595c8cc9ce4acba033bfaeac2b95f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a433936e82f84f89bf5ee6b772a99ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:44.279845 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d21a5-9952-422c-8e2d-ee8745748eed tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:44.280134 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d21a5-9952-422c-8e2d-ee8745748eed tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:44.280413 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d21a5-9952-422c-8e2d-ee8745748eed tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:44.281130 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d21a5-9952-422c-8e2d-ee8745748eed tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:16:44.281493 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d21a5-9952-422c-8e2d-ee8745748eed tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:44.283102 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d21a5-9952-422c-8e2d-ee8745748eed tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:44.294713 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1380/2763] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 10 04:16:44.319122 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ff6d1-c797-4340-8abf-40e7d82dda5f None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:44.322760 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50589e2a-ec29-4e53-889d-59a7a12b9f5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:44.323477 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50589e2a-ec29-4e53-889d-59a7a12b9f5a service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:44.323670 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50589e2a-ec29-4e53-889d-59a7a12b9f5a service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:44.323977 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50589e2a-ec29-4e53-889d-59a7a12b9f5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:44.330078 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d21a5-9952-422c-8e2d-ee8745748eed tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:44.333735 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50589e2a-ec29-4e53-889d-59a7a12b9f5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:44.335193 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50589e2a-ec29-4e53-889d-59a7a12b9f5a service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:44.340272 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d21a5-9952-422c-8e2d-ee8745748eed tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:44.345030 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63470909-e94a-4205-ae02-8d2752e8f68c tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd595c8cc9ce4acba033bfaeac2b95f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a433936e82f84f89bf5ee6b772a99ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:44.345836 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1384/2764] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:16:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:16:44.345995 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63470909-e94a-4205-ae02-8d2752e8f68c tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:44.348451 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63470909-e94a-4205-ae02-8d2752e8f68c tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:44.348821 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63470909-e94a-4205-ae02-8d2752e8f68c tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] PATH_INFO: `/v3/projects/37d36866b89b4d8a93baaa736e7e29e0` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:44.350169 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63470909-e94a-4205-ae02-8d2752e8f68c tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] RBAC: Authorizing `identity:delete_project(project_id=37d36866b89b4d8a93baaa736e7e29e0)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:44.352866 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63470909-e94a-4205-ae02-8d2752e8f68c tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:44.400968 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-63470909-e94a-4205-ae02-8d2752e8f68c tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37d36866b89b4d8a93baaa736e7e29e0', 'request_id': 'req-63470909-e94a-4205-ae02-8d2752e8f68c'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:44.406896 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-63470909-e94a-4205-ae02-8d2752e8f68c tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37d36866b89b4d8a93baaa736e7e29e0', 'request_id': 'req-63470909-e94a-4205-ae02-8d2752e8f68c'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:44.415387 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-63470909-e94a-4205-ae02-8d2752e8f68c tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37d36866b89b4d8a93baaa736e7e29e0', 'request_id': 'req-63470909-e94a-4205-ae02-8d2752e8f68c'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:44.428004 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-63470909-e94a-4205-ae02-8d2752e8f68c tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] The token cache is being invalidate because project 37d36866b89b4d8a93baaa736e7e29e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:16:44.428289 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-63470909-e94a-4205-ae02-8d2752e8f68c tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:44.429029 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-63470909-e94a-4205-ae02-8d2752e8f68c tempest-VolumeQuotaClassesTest-239306434 tempest-VolumeQuotaClassesTest-239306434-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:44.430750 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1381/2765] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:16:44 2022] DELETE /identity/v3/projects/37d36866b89b4d8a93baaa736e7e29e0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:16:44.627044 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50589e2a-ec29-4e53-889d-59a7a12b9f5a service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:44.628600 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-50589e2a-ec29-4e53-889d-59a7a12b9f5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:44.642424 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50589e2a-ec29-4e53-889d-59a7a12b9f5a service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:44.706266 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b00c3-2b8c-4caa-bf2e-b30297ef9887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:44.707249 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b00c3-2b8c-4caa-bf2e-b30297ef9887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:44.707538 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b00c3-2b8c-4caa-bf2e-b30297ef9887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:44.707850 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b00c3-2b8c-4caa-bf2e-b30297ef9887 admin admin] PATH_INFO: `/v3/users/4c50ab09aafa49369919ec6b1efc09e3` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:44.709107 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b00c3-2b8c-4caa-bf2e-b30297ef9887 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c50ab09aafa49369919ec6b1efc09e3)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:44.711848 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b00c3-2b8c-4caa-bf2e-b30297ef9887 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:44.764386 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b46b00c3-2b8c-4caa-bf2e-b30297ef9887 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c50ab09aafa49369919ec6b1efc09e3'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:44.765054 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b46b00c3-2b8c-4caa-bf2e-b30297ef9887 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c50ab09aafa49369919ec6b1efc09e3'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:44.771832 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b46b00c3-2b8c-4caa-bf2e-b30297ef9887 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c50ab09aafa49369919ec6b1efc09e3'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:44.783729 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b46b00c3-2b8c-4caa-bf2e-b30297ef9887 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c50ab09aafa49369919ec6b1efc09e3'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:44.784500 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b46b00c3-2b8c-4caa-bf2e-b30297ef9887 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c50ab09aafa49369919ec6b1efc09e3'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:44.796988 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1385/2766] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:16:44 2022] DELETE /identity/v3/users/4c50ab09aafa49369919ec6b1efc09e3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:44.801227 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5401f7-ea5b-4e65-bb32-2f6e634680f0 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:44.801746 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5401f7-ea5b-4e65-bb32-2f6e634680f0 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:44.801923 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5401f7-ea5b-4e65-bb32-2f6e634680f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:44.818782 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-bd5401f7-ea5b-4e65-bb32-2f6e634680f0 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:44.819861 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-bd5401f7-ea5b-4e65-bb32-2f6e634680f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:44.878641 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1382/2767] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:44.889288 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b00c3-2b8c-4caa-bf2e-b30297ef9887 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:44.890700 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-b46b00c3-2b8c-4caa-bf2e-b30297ef9887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:44.946350 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3785958-19ef-4920-84f8-864e6c410e34 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:44.946807 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3785958-19ef-4920-84f8-864e6c410e34 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:44.947151 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3785958-19ef-4920-84f8-864e6c410e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:44.953354 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b00c3-2b8c-4caa-bf2e-b30297ef9887 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:44.957538 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be82bc-cb4c-402e-9471-dc5cc12b6454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:44.958148 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be82bc-cb4c-402e-9471-dc5cc12b6454 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:44.959942 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be82bc-cb4c-402e-9471-dc5cc12b6454 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:44.959942 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be82bc-cb4c-402e-9471-dc5cc12b6454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:44.972209 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be82bc-cb4c-402e-9471-dc5cc12b6454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:44.973969 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be82bc-cb4c-402e-9471-dc5cc12b6454 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:44.975491 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-a3785958-19ef-4920-84f8-864e6c410e34 None None] MFA Rules not processed for user `56f842d811c9452995b8704fcf989093`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:44.976904 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-a3785958-19ef-4920-84f8-864e6c410e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:44.985332 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1386/2768] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:16:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:16:45.087669 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1383/2769] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:16:45.096965 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be82bc-cb4c-402e-9471-dc5cc12b6454 service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:45.098907 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-a2be82bc-cb4c-402e-9471-dc5cc12b6454 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:45.178292 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be82bc-cb4c-402e-9471-dc5cc12b6454 service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:45.182674 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64447eb9-12e4-4872-b416-4aea2e5848c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:45.183382 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64447eb9-12e4-4872-b416-4aea2e5848c9 service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:45.183757 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64447eb9-12e4-4872-b416-4aea2e5848c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:45.184098 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64447eb9-12e4-4872-b416-4aea2e5848c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:45.193283 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64447eb9-12e4-4872-b416-4aea2e5848c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:45.195353 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64447eb9-12e4-4872-b416-4aea2e5848c9 service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:45.206328 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1387/2770] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:16:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:16:45.323450 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3785958-19ef-4920-84f8-864e6c410e34 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:45.325069 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-a3785958-19ef-4920-84f8-864e6c410e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:45.344094 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3785958-19ef-4920-84f8-864e6c410e34 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:45.348732 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535aed3-08ca-4406-8e3f-4c90654ab699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:45.349650 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535aed3-08ca-4406-8e3f-4c90654ab699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:45.349945 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535aed3-08ca-4406-8e3f-4c90654ab699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:45.350244 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535aed3-08ca-4406-8e3f-4c90654ab699 admin admin] PATH_INFO: `/v3/projects/7fd2bbf103e14b95b6de082e4cc435f0` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:45.351472 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535aed3-08ca-4406-8e3f-4c90654ab699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fd2bbf103e14b95b6de082e4cc435f0)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:45.353980 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535aed3-08ca-4406-8e3f-4c90654ab699 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:45.403618 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-9535aed3-08ca-4406-8e3f-4c90654ab699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fd2bbf103e14b95b6de082e4cc435f0', 'request_id': 'req-9535aed3-08ca-4406-8e3f-4c90654ab699'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:45.409307 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-9535aed3-08ca-4406-8e3f-4c90654ab699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fd2bbf103e14b95b6de082e4cc435f0', 'request_id': 'req-9535aed3-08ca-4406-8e3f-4c90654ab699'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:45.416550 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-9535aed3-08ca-4406-8e3f-4c90654ab699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fd2bbf103e14b95b6de082e4cc435f0', 'request_id': 'req-9535aed3-08ca-4406-8e3f-4c90654ab699'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:45.428989 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-9535aed3-08ca-4406-8e3f-4c90654ab699 admin admin] The token cache is being invalidate because project 7fd2bbf103e14b95b6de082e4cc435f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:16:45.429279 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-9535aed3-08ca-4406-8e3f-4c90654ab699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:45.429934 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-9535aed3-08ca-4406-8e3f-4c90654ab699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:45.431454 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1384/2771] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:16:45 2022] DELETE /identity/v3/projects/7fd2bbf103e14b95b6de082e4cc435f0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:45.435646 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64447eb9-12e4-4872-b416-4aea2e5848c9 service cinder] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:45.448361 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64447eb9-12e4-4872-b416-4aea2e5848c9 service cinder] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:45.511105 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59963346-e21a-4c74-aca5-c130415056f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:45.512003 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59963346-e21a-4c74-aca5-c130415056f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:45.512282 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59963346-e21a-4c74-aca5-c130415056f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:45.512561 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59963346-e21a-4c74-aca5-c130415056f2 admin admin] PATH_INFO: `/v3/users/dd595c8cc9ce4acba033bfaeac2b95f5` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:45.513759 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59963346-e21a-4c74-aca5-c130415056f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd595c8cc9ce4acba033bfaeac2b95f5)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:45.515655 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59963346-e21a-4c74-aca5-c130415056f2 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:45.564504 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-59963346-e21a-4c74-aca5-c130415056f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd595c8cc9ce4acba033bfaeac2b95f5'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:45.565173 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-59963346-e21a-4c74-aca5-c130415056f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd595c8cc9ce4acba033bfaeac2b95f5'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:45.572384 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-59963346-e21a-4c74-aca5-c130415056f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd595c8cc9ce4acba033bfaeac2b95f5'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:45.583733 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-59963346-e21a-4c74-aca5-c130415056f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd595c8cc9ce4acba033bfaeac2b95f5'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:45.584336 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-59963346-e21a-4c74-aca5-c130415056f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd595c8cc9ce4acba033bfaeac2b95f5'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:45.596539 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1388/2772] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:16:45 2022] DELETE /identity/v3/users/dd595c8cc9ce4acba033bfaeac2b95f5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:45.855474 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535aed3-08ca-4406-8e3f-4c90654ab699 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:45.857017 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-9535aed3-08ca-4406-8e3f-4c90654ab699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:45.870111 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535aed3-08ca-4406-8e3f-4c90654ab699 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:45.923715 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946bfda1-6318-4e3d-a820-55eda196a64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:45.924580 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bfda1-6318-4e3d-a820-55eda196a64b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:45.924860 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bfda1-6318-4e3d-a820-55eda196a64b admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:45.925132 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946bfda1-6318-4e3d-a820-55eda196a64b admin admin] PATH_INFO: `/v3/projects/a433936e82f84f89bf5ee6b772a99ff3` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:45.926278 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946bfda1-6318-4e3d-a820-55eda196a64b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a433936e82f84f89bf5ee6b772a99ff3)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:45.928190 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946bfda1-6318-4e3d-a820-55eda196a64b admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:45.971664 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-946bfda1-6318-4e3d-a820-55eda196a64b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a433936e82f84f89bf5ee6b772a99ff3', 'request_id': 'req-946bfda1-6318-4e3d-a820-55eda196a64b'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:45.977459 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-946bfda1-6318-4e3d-a820-55eda196a64b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a433936e82f84f89bf5ee6b772a99ff3', 'request_id': 'req-946bfda1-6318-4e3d-a820-55eda196a64b'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:45.983716 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-946bfda1-6318-4e3d-a820-55eda196a64b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a433936e82f84f89bf5ee6b772a99ff3', 'request_id': 'req-946bfda1-6318-4e3d-a820-55eda196a64b'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:45.996569 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-946bfda1-6318-4e3d-a820-55eda196a64b admin admin] The token cache is being invalidate because project a433936e82f84f89bf5ee6b772a99ff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:16:45.996857 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-946bfda1-6318-4e3d-a820-55eda196a64b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:45.997508 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-946bfda1-6318-4e3d-a820-55eda196a64b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:45.999040 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1385/2773] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:16:45 2022] DELETE /identity/v3/projects/a433936e82f84f89bf5ee6b772a99ff3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:46.003937 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58249af5-8aa7-4a4c-947c-3896ad9a2259 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:46.004393 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58249af5-8aa7-4a4c-947c-3896ad9a2259 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:46.004487 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58249af5-8aa7-4a4c-947c-3896ad9a2259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:46.021465 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-58249af5-8aa7-4a4c-947c-3896ad9a2259 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:46.022658 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-58249af5-8aa7-4a4c-947c-3896ad9a2259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:46.079428 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1389/2774] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:46.088276 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8d2ca-ada5-4a7c-aa97-b16efb836fd7 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:46.088533 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8d2ca-ada5-4a7c-aa97-b16efb836fd7 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:46.088813 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8d2ca-ada5-4a7c-aa97-b16efb836fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:46.108087 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-a7d8d2ca-ada5-4a7c-aa97-b16efb836fd7 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:46.109305 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-a7d8d2ca-ada5-4a7c-aa97-b16efb836fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:46.117223 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1386/2775] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:46.121301 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58249af5-8aa7-4a4c-947c-3896ad9a2259 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:46.130832 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58249af5-8aa7-4a4c-947c-3896ad9a2259 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:46.135299 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ddf05-16ca-4701-b66c-131a4847e7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:46.135966 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ddf05-16ca-4701-b66c-131a4847e7ee admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:46.136247 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ddf05-16ca-4701-b66c-131a4847e7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:46.136526 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ddf05-16ca-4701-b66c-131a4847e7ee admin admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:46.137270 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ddf05-16ca-4701-b66c-131a4847e7ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:16:46.137570 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ddf05-16ca-4701-b66c-131a4847e7ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:46.139147 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ddf05-16ca-4701-b66c-131a4847e7ee admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:46.150575 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1390/2776] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:16:46.154655 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8d2ca-ada5-4a7c-aa97-b16efb836fd7 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:46.163641 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8d2ca-ada5-4a7c-aa97-b16efb836fd7 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:46.168863 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cca2fe-ad41-41c6-bc95-2923ae27e922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:46.169500 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cca2fe-ad41-41c6-bc95-2923ae27e922 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:46.169788 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cca2fe-ad41-41c6-bc95-2923ae27e922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:46.170067 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cca2fe-ad41-41c6-bc95-2923ae27e922 admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:46.171095 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cca2fe-ad41-41c6-bc95-2923ae27e922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:46.173435 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cca2fe-ad41-41c6-bc95-2923ae27e922 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:46.202509 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1387/2777] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:16:46 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:16:46.203650 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ddf05-16ca-4701-b66c-131a4847e7ee admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:46.213981 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ddf05-16ca-4701-b66c-131a4847e7ee admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:46.267626 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27fac5-1b2a-438a-bb3e-39e5b964a619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:46.268444 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27fac5-1b2a-438a-bb3e-39e5b964a619 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:46.268744 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27fac5-1b2a-438a-bb3e-39e5b964a619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:46.269023 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27fac5-1b2a-438a-bb3e-39e5b964a619 admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:46.269703 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27fac5-1b2a-438a-bb3e-39e5b964a619 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:46.271605 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27fac5-1b2a-438a-bb3e-39e5b964a619 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:46.292188 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1391/2778] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:16:46 2022] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:16:46.296255 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cca2fe-ad41-41c6-bc95-2923ae27e922 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:46.306206 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cca2fe-ad41-41c6-bc95-2923ae27e922 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:46.310763 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e50cd8-92eb-4429-b643-f4b1b4145fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:46.311417 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e50cd8-92eb-4429-b643-f4b1b4145fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:46.311708 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e50cd8-92eb-4429-b643-f4b1b4145fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:46.312002 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e50cd8-92eb-4429-b643-f4b1b4145fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:46.312980 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e50cd8-92eb-4429-b643-f4b1b4145fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:46.314551 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e50cd8-92eb-4429-b643-f4b1b4145fd9 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:46.326226 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1388/2779] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:16:46.330189 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27fac5-1b2a-438a-bb3e-39e5b964a619 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:46.342608 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27fac5-1b2a-438a-bb3e-39e5b964a619 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:46.347140 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26433161-fee5-43bf-af7c-1feace33b47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:46.347832 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26433161-fee5-43bf-af7c-1feace33b47c admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:46.348121 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26433161-fee5-43bf-af7c-1feace33b47c admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:46.348404 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26433161-fee5-43bf-af7c-1feace33b47c admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:46.349123 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26433161-fee5-43bf-af7c-1feace33b47c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:46.350706 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26433161-fee5-43bf-af7c-1feace33b47c admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:46.360330 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1392/2780] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:16:46.364273 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e50cd8-92eb-4429-b643-f4b1b4145fd9 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:46.373798 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e50cd8-92eb-4429-b643-f4b1b4145fd9 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:46.378343 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36078cb4-be0a-44de-bd4b-356c7066798a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:46.379201 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36078cb4-be0a-44de-bd4b-356c7066798a admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:46.379479 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36078cb4-be0a-44de-bd4b-356c7066798a admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:46.379781 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36078cb4-be0a-44de-bd4b-356c7066798a admin admin] PATH_INFO: `/v3/projects/418598daea194d049446b10c8a9b1366/users/b8789417f3214afea3a41f4133ad743b/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:46.393997 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36078cb4-be0a-44de-bd4b-356c7066798a admin admin] RBAC: Authorizing `identity:create_grant(project_id=418598daea194d049446b10c8a9b1366, user_id=b8789417f3214afea3a41f4133ad743b, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:46.396649 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36078cb4-be0a-44de-bd4b-356c7066798a admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:46.409733 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1389/2781] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:16:46 2022] PUT /identity/v3/projects/418598daea194d049446b10c8a9b1366/users/b8789417f3214afea3a41f4133ad743b/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:16:46.419874 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b03fe-c13f-4a46-9bd1-497628ec52c1 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:46.420245 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b03fe-c13f-4a46-9bd1-497628ec52c1 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:46.420596 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b03fe-c13f-4a46-9bd1-497628ec52c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:46.447156 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-cd8b03fe-c13f-4a46-9bd1-497628ec52c1 None None] MFA Rules not processed for user `b8789417f3214afea3a41f4133ad743b`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:46.448405 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-cd8b03fe-c13f-4a46-9bd1-497628ec52c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:46.510766 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1393/2782] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:46.513886 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36078cb4-be0a-44de-bd4b-356c7066798a admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:46.555087 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bd156-32e7-4c5c-bb95-e635a18db363 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:46.555378 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bd156-32e7-4c5c-bb95-e635a18db363 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:46.555662 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bd156-32e7-4c5c-bb95-e635a18db363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:46.573293 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36078cb4-be0a-44de-bd4b-356c7066798a admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:46.573538 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-f32bd156-32e7-4c5c-bb95-e635a18db363 None None] MFA Rules not processed for user `56f842d811c9452995b8704fcf989093`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:46.574741 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-f32bd156-32e7-4c5c-bb95-e635a18db363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:46.577947 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dce547-17a4-41f7-92bf-0010c817fb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:46.578595 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dce547-17a4-41f7-92bf-0010c817fb1e admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:46.578874 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dce547-17a4-41f7-92bf-0010c817fb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:46.579147 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dce547-17a4-41f7-92bf-0010c817fb1e admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:46.579870 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dce547-17a4-41f7-92bf-0010c817fb1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:46.581744 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dce547-17a4-41f7-92bf-0010c817fb1e admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:46.609702 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1390/2783] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:16:46 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:16:46.610612 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dce547-17a4-41f7-92bf-0010c817fb1e admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:46.634717 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1394/2784] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:16:46.672543 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dce547-17a4-41f7-92bf-0010c817fb1e admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:46.677112 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7880bae-b125-44a5-926d-1b7c9d15237a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:46.677770 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7880bae-b125-44a5-926d-1b7c9d15237a admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:46.678049 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7880bae-b125-44a5-926d-1b7c9d15237a admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:46.678322 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7880bae-b125-44a5-926d-1b7c9d15237a admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:46.679025 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7880bae-b125-44a5-926d-1b7c9d15237a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:46.681636 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7880bae-b125-44a5-926d-1b7c9d15237a admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:46.704781 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1391/2785] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:16:46 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:16:46.706514 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32bd156-32e7-4c5c-bb95-e635a18db363 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:46.717564 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32bd156-32e7-4c5c-bb95-e635a18db363 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:46.722482 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfe5a6-3621-42c1-a1e5-f7b0af8937fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:46.723141 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfe5a6-3621-42c1-a1e5-f7b0af8937fe admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:46.723428 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfe5a6-3621-42c1-a1e5-f7b0af8937fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:46.723731 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfe5a6-3621-42c1-a1e5-f7b0af8937fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:46.724463 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcfe5a6-3621-42c1-a1e5-f7b0af8937fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:46.726057 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcfe5a6-3621-42c1-a1e5-f7b0af8937fe admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:46.736201 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1395/2786] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:16:46.740471 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7880bae-b125-44a5-926d-1b7c9d15237a admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:46.750989 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7880bae-b125-44a5-926d-1b7c9d15237a admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:46.755635 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df370548-b2fd-47ea-83f1-76bb2b45e475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:46.756537 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df370548-b2fd-47ea-83f1-76bb2b45e475 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:46.756815 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df370548-b2fd-47ea-83f1-76bb2b45e475 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:46.757092 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df370548-b2fd-47ea-83f1-76bb2b45e475 admin admin] PATH_INFO: `/v3/projects/bc1edaafe4b047a793b899a228df9c34/users/6074d2b9cbf74d3aa79d9b233bd6b82e/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:46.772992 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df370548-b2fd-47ea-83f1-76bb2b45e475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc1edaafe4b047a793b899a228df9c34, user_id=6074d2b9cbf74d3aa79d9b233bd6b82e, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:46.775650 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df370548-b2fd-47ea-83f1-76bb2b45e475 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:46.789364 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1392/2787] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:16:46 2022] PUT /identity/v3/projects/bc1edaafe4b047a793b899a228df9c34/users/6074d2b9cbf74d3aa79d9b233bd6b82e/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:46.793505 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfe5a6-3621-42c1-a1e5-f7b0af8937fe admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:46.803257 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfe5a6-3621-42c1-a1e5-f7b0af8937fe admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:46.858744 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f16518-66c7-47cd-b39c-4b46816720af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:46.859411 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f16518-66c7-47cd-b39c-4b46816720af admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:46.859802 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f16518-66c7-47cd-b39c-4b46816720af admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:46.860013 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f16518-66c7-47cd-b39c-4b46816720af admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:46.860756 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f16518-66c7-47cd-b39c-4b46816720af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:46.862324 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f16518-66c7-47cd-b39c-4b46816720af admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:46.872444 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1396/2788] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:16:46.876802 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df370548-b2fd-47ea-83f1-76bb2b45e475 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:46.887520 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df370548-b2fd-47ea-83f1-76bb2b45e475 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:46.892109 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba6000-8a11-495b-a63c-bcd696803761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:46.892984 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba6000-8a11-495b-a63c-bcd696803761 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:46.893288 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba6000-8a11-495b-a63c-bcd696803761 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:46.893563 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba6000-8a11-495b-a63c-bcd696803761 admin admin] PATH_INFO: `/v3/projects/bc1edaafe4b047a793b899a228df9c34/users/6074d2b9cbf74d3aa79d9b233bd6b82e/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:46.895504 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba6000-8a11-495b-a63c-bcd696803761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc1edaafe4b047a793b899a228df9c34, user_id=6074d2b9cbf74d3aa79d9b233bd6b82e, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:46.898129 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba6000-8a11-495b-a63c-bcd696803761 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:46.908635 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1393/2789] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:16:46 2022] PUT /identity/v3/projects/bc1edaafe4b047a793b899a228df9c34/users/6074d2b9cbf74d3aa79d9b233bd6b82e/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:16:46.920279 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69a980-5ba8-4353-8d9a-84426e247b59 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:46.920764 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69a980-5ba8-4353-8d9a-84426e247b59 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:46.921136 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69a980-5ba8-4353-8d9a-84426e247b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:46.948560 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-da69a980-5ba8-4353-8d9a-84426e247b59 None None] MFA Rules not processed for user `6074d2b9cbf74d3aa79d9b233bd6b82e`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:46.949794 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-da69a980-5ba8-4353-8d9a-84426e247b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:47.017859 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1397/2790] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:47.029707 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba6000-8a11-495b-a63c-bcd696803761 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:47.031897 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-4cba6000-8a11-495b-a63c-bcd696803761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:47.069247 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69a980-5ba8-4353-8d9a-84426e247b59 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:47.070836 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-da69a980-5ba8-4353-8d9a-84426e247b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:47.090951 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba6000-8a11-495b-a63c-bcd696803761 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:47.094753 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6783ef5-8237-4060-92b9-888a60e22e0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:47.095528 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6783ef5-8237-4060-92b9-888a60e22e0d service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:47.095946 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6783ef5-8237-4060-92b9-888a60e22e0d service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:47.096320 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6783ef5-8237-4060-92b9-888a60e22e0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:47.106621 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6783ef5-8237-4060-92b9-888a60e22e0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:47.108281 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6783ef5-8237-4060-92b9-888a60e22e0d service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:47.122744 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1394/2791] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:16:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:16:47.141929 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69a980-5ba8-4353-8d9a-84426e247b59 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:47.145825 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ee1b1-32b5-4a8d-a380-6ffe68614d15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:47.146642 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ee1b1-32b5-4a8d-a380-6ffe68614d15 service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:47.146957 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ee1b1-32b5-4a8d-a380-6ffe68614d15 service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:47.147473 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ee1b1-32b5-4a8d-a380-6ffe68614d15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:47.149242 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-619ee1b1-32b5-4a8d-a380-6ffe68614d15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:47.228229 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6783ef5-8237-4060-92b9-888a60e22e0d service cinder] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:47.236593 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6783ef5-8237-4060-92b9-888a60e22e0d service cinder] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:47.240240 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817dd563-893f-4ab2-8716-dc81255495be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:47.240940 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817dd563-893f-4ab2-8716-dc81255495be service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:47.241283 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817dd563-893f-4ab2-8716-dc81255495be service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:47.242455 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817dd563-893f-4ab2-8716-dc81255495be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:47.244438 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ee1b1-32b5-4a8d-a380-6ffe68614d15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:47.245916 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ee1b1-32b5-4a8d-a380-6ffe68614d15 service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:47.255599 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1398/2792] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:16:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:16:47.306745 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817dd563-893f-4ab2-8716-dc81255495be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:47.308225 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817dd563-893f-4ab2-8716-dc81255495be service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:47.317666 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1395/2793] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:16:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:16:47.631079 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ee1b1-32b5-4a8d-a380-6ffe68614d15 service cinder] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:47.696535 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ee1b1-32b5-4a8d-a380-6ffe68614d15 service cinder] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:47.701079 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af319d34-25cb-4305-96c1-5d15180c1818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:47.702052 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af319d34-25cb-4305-96c1-5d15180c1818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:47.702390 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af319d34-25cb-4305-96c1-5d15180c1818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:47.702716 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af319d34-25cb-4305-96c1-5d15180c1818 admin admin] PATH_INFO: `/v3/users/b8789417f3214afea3a41f4133ad743b` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:47.704022 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af319d34-25cb-4305-96c1-5d15180c1818 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8789417f3214afea3a41f4133ad743b)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:47.705952 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af319d34-25cb-4305-96c1-5d15180c1818 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:47.750823 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-af319d34-25cb-4305-96c1-5d15180c1818 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8789417f3214afea3a41f4133ad743b'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:47.751477 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-af319d34-25cb-4305-96c1-5d15180c1818 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8789417f3214afea3a41f4133ad743b'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:47.757957 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-af319d34-25cb-4305-96c1-5d15180c1818 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8789417f3214afea3a41f4133ad743b'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:47.769076 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-af319d34-25cb-4305-96c1-5d15180c1818 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8789417f3214afea3a41f4133ad743b'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:47.769738 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-af319d34-25cb-4305-96c1-5d15180c1818 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8789417f3214afea3a41f4133ad743b'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:47.782055 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1399/2794] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:16:47 2022] DELETE /identity/v3/users/b8789417f3214afea3a41f4133ad743b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:47.786613 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59130f44-fae4-4f62-8c83-68d6250bda8a None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:47.786899 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59130f44-fae4-4f62-8c83-68d6250bda8a None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:47.787173 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59130f44-fae4-4f62-8c83-68d6250bda8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:47.804573 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-59130f44-fae4-4f62-8c83-68d6250bda8a None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:47.806299 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-59130f44-fae4-4f62-8c83-68d6250bda8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:47.863830 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1396/2795] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:47.874090 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af319d34-25cb-4305-96c1-5d15180c1818 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:47.875415 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-af319d34-25cb-4305-96c1-5d15180c1818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:47.929557 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af319d34-25cb-4305-96c1-5d15180c1818 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:47.933834 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49145316-f35d-4384-9bd0-12469bc311d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:47.934466 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49145316-f35d-4384-9bd0-12469bc311d3 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:47.934756 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49145316-f35d-4384-9bd0-12469bc311d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:47.935031 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49145316-f35d-4384-9bd0-12469bc311d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:47.944048 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49145316-f35d-4384-9bd0-12469bc311d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:47.945528 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49145316-f35d-4384-9bd0-12469bc311d3 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:47.954798 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1400/2796] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:16:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:16:48.220084 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59130f44-fae4-4f62-8c83-68d6250bda8a None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:48.223119 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-59130f44-fae4-4f62-8c83-68d6250bda8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:48.262017 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59130f44-fae4-4f62-8c83-68d6250bda8a None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:48.272138 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de962a27-4ac6-4735-8eed-564d6b01f6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:48.273069 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de962a27-4ac6-4735-8eed-564d6b01f6cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:48.273343 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de962a27-4ac6-4735-8eed-564d6b01f6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:48.273865 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de962a27-4ac6-4735-8eed-564d6b01f6cf admin admin] PATH_INFO: `/v3/projects/418598daea194d049446b10c8a9b1366` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:48.275324 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de962a27-4ac6-4735-8eed-564d6b01f6cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=418598daea194d049446b10c8a9b1366)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:48.277358 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de962a27-4ac6-4735-8eed-564d6b01f6cf admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:48.350735 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-de962a27-4ac6-4735-8eed-564d6b01f6cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '418598daea194d049446b10c8a9b1366', 'request_id': 'req-de962a27-4ac6-4735-8eed-564d6b01f6cf'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:48.356671 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-de962a27-4ac6-4735-8eed-564d6b01f6cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '418598daea194d049446b10c8a9b1366', 'request_id': 'req-de962a27-4ac6-4735-8eed-564d6b01f6cf'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:48.362952 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-de962a27-4ac6-4735-8eed-564d6b01f6cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '418598daea194d049446b10c8a9b1366', 'request_id': 'req-de962a27-4ac6-4735-8eed-564d6b01f6cf'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:48.381036 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-de962a27-4ac6-4735-8eed-564d6b01f6cf admin admin] The token cache is being invalidate because project 418598daea194d049446b10c8a9b1366 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:16:48.381631 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-de962a27-4ac6-4735-8eed-564d6b01f6cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:48.382492 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-de962a27-4ac6-4735-8eed-564d6b01f6cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:48.385885 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1397/2797] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:16:48 2022] DELETE /identity/v3/projects/418598daea194d049446b10c8a9b1366 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:48.390010 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49145316-f35d-4384-9bd0-12469bc311d3 service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:48.400374 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49145316-f35d-4384-9bd0-12469bc311d3 service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:48.460426 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960434d6-03d9-4952-901b-554fc475eb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:48.461468 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960434d6-03d9-4952-901b-554fc475eb16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:48.461827 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960434d6-03d9-4952-901b-554fc475eb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:48.462183 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960434d6-03d9-4952-901b-554fc475eb16 admin admin] PATH_INFO: `/v3/users/6074d2b9cbf74d3aa79d9b233bd6b82e` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:48.463479 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960434d6-03d9-4952-901b-554fc475eb16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6074d2b9cbf74d3aa79d9b233bd6b82e)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:48.465571 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960434d6-03d9-4952-901b-554fc475eb16 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:48.519042 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-960434d6-03d9-4952-901b-554fc475eb16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6074d2b9cbf74d3aa79d9b233bd6b82e'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:48.519939 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-960434d6-03d9-4952-901b-554fc475eb16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6074d2b9cbf74d3aa79d9b233bd6b82e'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:48.526486 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-960434d6-03d9-4952-901b-554fc475eb16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6074d2b9cbf74d3aa79d9b233bd6b82e'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:48.537937 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-960434d6-03d9-4952-901b-554fc475eb16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6074d2b9cbf74d3aa79d9b233bd6b82e'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:48.538657 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-960434d6-03d9-4952-901b-554fc475eb16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6074d2b9cbf74d3aa79d9b233bd6b82e'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:48.551195 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1401/2798] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:16:48 2022] DELETE /identity/v3/users/6074d2b9cbf74d3aa79d9b233bd6b82e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:48.818983 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de962a27-4ac6-4735-8eed-564d6b01f6cf admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:48.820608 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-de962a27-4ac6-4735-8eed-564d6b01f6cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:48.866268 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de962a27-4ac6-4735-8eed-564d6b01f6cf admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:48.925609 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31996b26-496a-4fae-92dc-a3a8513f9063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:48.926569 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31996b26-496a-4fae-92dc-a3a8513f9063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:48.926912 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31996b26-496a-4fae-92dc-a3a8513f9063 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:48.927242 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31996b26-496a-4fae-92dc-a3a8513f9063 admin admin] PATH_INFO: `/v3/projects/bc1edaafe4b047a793b899a228df9c34` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:48.928679 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31996b26-496a-4fae-92dc-a3a8513f9063 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc1edaafe4b047a793b899a228df9c34)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:48.931275 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31996b26-496a-4fae-92dc-a3a8513f9063 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:48.978290 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-31996b26-496a-4fae-92dc-a3a8513f9063 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc1edaafe4b047a793b899a228df9c34', 'request_id': 'req-31996b26-496a-4fae-92dc-a3a8513f9063'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:48.983402 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-31996b26-496a-4fae-92dc-a3a8513f9063 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc1edaafe4b047a793b899a228df9c34', 'request_id': 'req-31996b26-496a-4fae-92dc-a3a8513f9063'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:48.989815 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-31996b26-496a-4fae-92dc-a3a8513f9063 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc1edaafe4b047a793b899a228df9c34', 'request_id': 'req-31996b26-496a-4fae-92dc-a3a8513f9063'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:49.002274 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-31996b26-496a-4fae-92dc-a3a8513f9063 admin admin] The token cache is being invalidate because project bc1edaafe4b047a793b899a228df9c34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:16:49.002569 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-31996b26-496a-4fae-92dc-a3a8513f9063 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:49.003273 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-31996b26-496a-4fae-92dc-a3a8513f9063 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:16:49.004856 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1398/2799] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:16:48 2022] DELETE /identity/v3/projects/bc1edaafe4b047a793b899a228df9c34 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:49.009666 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66595ad-d5f2-40bb-82e3-9cb2ef538c17 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:49.009961 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66595ad-d5f2-40bb-82e3-9cb2ef538c17 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:49.010243 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66595ad-d5f2-40bb-82e3-9cb2ef538c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:49.029134 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-a66595ad-d5f2-40bb-82e3-9cb2ef538c17 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:49.030477 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-a66595ad-d5f2-40bb-82e3-9cb2ef538c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:49.090636 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1402/2800] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:16:49.098427 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a343a01-0870-4bb2-94d3-97b21dc70745 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:49.098712 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a343a01-0870-4bb2-94d3-97b21dc70745 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:49.098998 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a343a01-0870-4bb2-94d3-97b21dc70745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:49.118419 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-7a343a01-0870-4bb2-94d3-97b21dc70745 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:49.119633 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-7a343a01-0870-4bb2-94d3-97b21dc70745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:49.127568 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1399/2801] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:49.131750 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66595ad-d5f2-40bb-82e3-9cb2ef538c17 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:49.141780 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66595ad-d5f2-40bb-82e3-9cb2ef538c17 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:49.146485 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca83ef-8142-4547-b4c6-febcf91eee7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:49.147148 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca83ef-8142-4547-b4c6-febcf91eee7c admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:49.147433 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca83ef-8142-4547-b4c6-febcf91eee7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:49.147751 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca83ef-8142-4547-b4c6-febcf91eee7c admin admin] PATH_INFO: `/v3/domains` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:49.149039 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca83ef-8142-4547-b4c6-febcf91eee7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79560) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:16:49.149349 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca83ef-8142-4547-b4c6-febcf91eee7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:49.150952 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca83ef-8142-4547-b4c6-febcf91eee7c admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:49.162420 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1403/2802] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:16:49.167158 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a343a01-0870-4bb2-94d3-97b21dc70745 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:49.176075 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a343a01-0870-4bb2-94d3-97b21dc70745 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:49.181349 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a578ef-db19-4160-9858-290bd118f49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:49.182002 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a578ef-db19-4160-9858-290bd118f49f admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:49.182291 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a578ef-db19-4160-9858-290bd118f49f admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:49.182571 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a578ef-db19-4160-9858-290bd118f49f admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:49.183265 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a578ef-db19-4160-9858-290bd118f49f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:49.185204 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a578ef-db19-4160-9858-290bd118f49f admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:49.211099 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1400/2803] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:16:49 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:16:49.214825 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca83ef-8142-4547-b4c6-febcf91eee7c admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:49.224817 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca83ef-8142-4547-b4c6-febcf91eee7c admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:49.284721 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22b0ce-6055-4300-9e56-ca8b9806dc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:49.285402 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22b0ce-6055-4300-9e56-ca8b9806dc77 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:49.285688 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22b0ce-6055-4300-9e56-ca8b9806dc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:49.286008 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22b0ce-6055-4300-9e56-ca8b9806dc77 admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:49.286852 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22b0ce-6055-4300-9e56-ca8b9806dc77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:49.288819 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22b0ce-6055-4300-9e56-ca8b9806dc77 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:49.311335 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1404/2804] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:16:49 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:16:49.315777 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a578ef-db19-4160-9858-290bd118f49f admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:49.326872 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a578ef-db19-4160-9858-290bd118f49f admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:49.331608 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed90672-c400-407d-9658-84bcbf64b5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:49.332317 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed90672-c400-407d-9658-84bcbf64b5ea admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:49.332598 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed90672-c400-407d-9658-84bcbf64b5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:49.332880 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed90672-c400-407d-9658-84bcbf64b5ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:49.333606 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed90672-c400-407d-9658-84bcbf64b5ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:49.335209 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed90672-c400-407d-9658-84bcbf64b5ea admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:49.347654 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1401/2805] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:16:49.351736 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22b0ce-6055-4300-9e56-ca8b9806dc77 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:49.366467 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22b0ce-6055-4300-9e56-ca8b9806dc77 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:49.371346 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1e6fc-0d19-4a66-9972-496772a3b602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:49.372061 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1e6fc-0d19-4a66-9972-496772a3b602 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:49.372346 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1e6fc-0d19-4a66-9972-496772a3b602 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:49.372625 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1e6fc-0d19-4a66-9972-496772a3b602 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:49.373360 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1e6fc-0d19-4a66-9972-496772a3b602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:49.374975 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1e6fc-0d19-4a66-9972-496772a3b602 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:49.389325 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1405/2806] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:16:49.391210 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed90672-c400-407d-9658-84bcbf64b5ea admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:49.403409 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed90672-c400-407d-9658-84bcbf64b5ea admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:49.408519 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf1060-0d82-4017-bda1-6676a94cd676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:49.409560 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf1060-0d82-4017-bda1-6676a94cd676 admin admin] REQUEST_METHOD: `PUT` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:49.409904 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf1060-0d82-4017-bda1-6676a94cd676 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:49.410243 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf1060-0d82-4017-bda1-6676a94cd676 admin admin] PATH_INFO: `/v3/projects/cf36cbf070504cd2bdde57fc82f161c0/users/1f5ee97c7962473490795d1723cb0883/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:49.426496 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf1060-0d82-4017-bda1-6676a94cd676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf36cbf070504cd2bdde57fc82f161c0, user_id=1f5ee97c7962473490795d1723cb0883, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:49.430747 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf1060-0d82-4017-bda1-6676a94cd676 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:49.453021 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1402/2807] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:16:49 2022] PUT /identity/v3/projects/cf36cbf070504cd2bdde57fc82f161c0/users/1f5ee97c7962473490795d1723cb0883/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:16:49.458073 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c917b1-8b3b-4c67-8f35-01e4997f89f7 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:49.458611 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c917b1-8b3b-4c67-8f35-01e4997f89f7 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:49.458737 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c917b1-8b3b-4c67-8f35-01e4997f89f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:49.478974 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-94c917b1-8b3b-4c67-8f35-01e4997f89f7 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:49.480233 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-94c917b1-8b3b-4c67-8f35-01e4997f89f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:49.547904 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1406/2808] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:49.557570 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf1060-0d82-4017-bda1-6676a94cd676 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:49.559248 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-66bf1060-0d82-4017-bda1-6676a94cd676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:49.615871 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf1060-0d82-4017-bda1-6676a94cd676 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:49.620572 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b5624-bdd5-4258-a886-6ea654bd6d46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:49.621215 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b5624-bdd5-4258-a886-6ea654bd6d46 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:49.621495 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b5624-bdd5-4258-a886-6ea654bd6d46 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:49.621771 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b5624-bdd5-4258-a886-6ea654bd6d46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:49.631202 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b5624-bdd5-4258-a886-6ea654bd6d46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:49.632752 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b5624-bdd5-4258-a886-6ea654bd6d46 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:49.642660 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1403/2809] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:16:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:16:50.297232 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1a6ec-34f5-4b46-8688-cb15a82dc458 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:50.297535 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1a6ec-34f5-4b46-8688-cb15a82dc458 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:50.297791 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1a6ec-34f5-4b46-8688-cb15a82dc458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:50.324365 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-3ac1a6ec-34f5-4b46-8688-cb15a82dc458 None None] MFA Rules not processed for user `1f5ee97c7962473490795d1723cb0883`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:50.325604 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-3ac1a6ec-34f5-4b46-8688-cb15a82dc458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:50.391996 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1407/2810] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:50.396673 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b5624-bdd5-4258-a886-6ea654bd6d46 service neutron] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:50.407804 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b5624-bdd5-4258-a886-6ea654bd6d46 service neutron] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:50.412472 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f9d50-eeff-4cff-b906-27d5db3b7738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:50.413120 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f9d50-eeff-4cff-b906-27d5db3b7738 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:50.413556 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f9d50-eeff-4cff-b906-27d5db3b7738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:50.413934 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f9d50-eeff-4cff-b906-27d5db3b7738 admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:50.415336 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f9d50-eeff-4cff-b906-27d5db3b7738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:50.417287 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f9d50-eeff-4cff-b906-27d5db3b7738 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:50.447654 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1404/2811] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:16:50 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:16:50.451714 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1a6ec-34f5-4b46-8688-cb15a82dc458 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:50.463934 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1a6ec-34f5-4b46-8688-cb15a82dc458 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:50.521178 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ef790-1120-47fc-bcff-02b9f640b2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:50.521843 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ef790-1120-47fc-bcff-02b9f640b2ef admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:50.522135 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ef790-1120-47fc-bcff-02b9f640b2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:50.522403 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ef790-1120-47fc-bcff-02b9f640b2ef admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:50.523085 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ef790-1120-47fc-bcff-02b9f640b2ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:50.525606 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ef790-1120-47fc-bcff-02b9f640b2ef admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:50.547042 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1408/2812] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:16:50 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:16:50.551295 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f9d50-eeff-4cff-b906-27d5db3b7738 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:50.561795 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f9d50-eeff-4cff-b906-27d5db3b7738 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:50.567046 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b495d2-98aa-41e9-b198-5e6402dab095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:50.567843 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b495d2-98aa-41e9-b198-5e6402dab095 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:50.568059 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b495d2-98aa-41e9-b198-5e6402dab095 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:50.568346 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b495d2-98aa-41e9-b198-5e6402dab095 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:50.569074 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b495d2-98aa-41e9-b198-5e6402dab095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:50.570663 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b495d2-98aa-41e9-b198-5e6402dab095 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:50.581444 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1405/2813] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:16:50.585689 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ef790-1120-47fc-bcff-02b9f640b2ef admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:50.597069 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ef790-1120-47fc-bcff-02b9f640b2ef admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:50.602285 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5683e-b1b4-4c1d-b4a1-71003437eed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:50.603168 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5683e-b1b4-4c1d-b4a1-71003437eed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:50.603448 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5683e-b1b4-4c1d-b4a1-71003437eed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:50.603744 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5683e-b1b4-4c1d-b4a1-71003437eed4 admin admin] PATH_INFO: `/v3/projects/0983bd6d47a9460aabfffa312087af85/users/fd36fa2dbb7a4242966f63c044b4f878/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:50.617745 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5683e-b1b4-4c1d-b4a1-71003437eed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0983bd6d47a9460aabfffa312087af85, user_id=fd36fa2dbb7a4242966f63c044b4f878, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:50.620401 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5683e-b1b4-4c1d-b4a1-71003437eed4 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:50.632955 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1409/2814] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:16:50 2022] PUT /identity/v3/projects/0983bd6d47a9460aabfffa312087af85/users/fd36fa2dbb7a4242966f63c044b4f878/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:50.636865 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b495d2-98aa-41e9-b198-5e6402dab095 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:50.646365 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b495d2-98aa-41e9-b198-5e6402dab095 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:50.703243 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7de80-c663-4f46-9bd1-2d8e4595220a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:50.703946 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7de80-c663-4f46-9bd1-2d8e4595220a admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:50.704255 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7de80-c663-4f46-9bd1-2d8e4595220a admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:50.704532 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7de80-c663-4f46-9bd1-2d8e4595220a admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:50.705211 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7de80-c663-4f46-9bd1-2d8e4595220a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:50.706766 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7de80-c663-4f46-9bd1-2d8e4595220a admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:50.717004 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1406/2815] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:16:50.721001 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5683e-b1b4-4c1d-b4a1-71003437eed4 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:50.731928 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5683e-b1b4-4c1d-b4a1-71003437eed4 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:50.736641 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5baf4ee-a9b8-4935-95b4-ca2c21bbe7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:50.737524 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5baf4ee-a9b8-4935-95b4-ca2c21bbe7a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:50.737812 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5baf4ee-a9b8-4935-95b4-ca2c21bbe7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:50.738093 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5baf4ee-a9b8-4935-95b4-ca2c21bbe7a7 admin admin] PATH_INFO: `/v3/projects/0983bd6d47a9460aabfffa312087af85/users/fd36fa2dbb7a4242966f63c044b4f878/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:50.740128 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5baf4ee-a9b8-4935-95b4-ca2c21bbe7a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0983bd6d47a9460aabfffa312087af85, user_id=fd36fa2dbb7a4242966f63c044b4f878, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:50.742762 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5baf4ee-a9b8-4935-95b4-ca2c21bbe7a7 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:50.753103 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1410/2816] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:16:50 2022] PUT /identity/v3/projects/0983bd6d47a9460aabfffa312087af85/users/fd36fa2dbb7a4242966f63c044b4f878/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:16:51.371414 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6c555-1e47-473a-950c-52a98fc21e67 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:51.371778 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6c555-1e47-473a-950c-52a98fc21e67 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:51.372031 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6c555-1e47-473a-950c-52a98fc21e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:51.397656 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-7cb6c555-1e47-473a-950c-52a98fc21e67 None None] MFA Rules not processed for user `fd36fa2dbb7a4242966f63c044b4f878`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:16:51.399993 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-7cb6c555-1e47-473a-950c-52a98fc21e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:51.472349 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1407/2817] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:16:51 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:16:51.484144 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5baf4ee-a9b8-4935-95b4-ca2c21bbe7a7 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:16:51.486312 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-e5baf4ee-a9b8-4935-95b4-ca2c21bbe7a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:16:51.544285 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5baf4ee-a9b8-4935-95b4-ca2c21bbe7a7 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:16:51.547900 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f802835-32a9-4e42-9f95-2e2b18bbac24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:16:51.548553 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f802835-32a9-4e42-9f95-2e2b18bbac24 service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:16:51.548839 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f802835-32a9-4e42-9f95-2e2b18bbac24 service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:16:51.549118 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f802835-32a9-4e42-9f95-2e2b18bbac24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:16:51.612789 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f802835-32a9-4e42-9f95-2e2b18bbac24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:16:51.614273 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f802835-32a9-4e42-9f95-2e2b18bbac24 service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:16:51.623428 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1411/2818] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:16:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:17:19.708409 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6c555-1e47-473a-950c-52a98fc21e67 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:17:19.709791 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-7cb6c555-1e47-473a-950c-52a98fc21e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:17:19.775251 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6c555-1e47-473a-950c-52a98fc21e67 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:17:19.780777 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5438306-df9d-4f31-8c6e-a11bf517c253 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319da006b10c41f8aa8a9d5aa2225b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:17:19.781404 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5438306-df9d-4f31-8c6e-a11bf517c253 service placement] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:17:19.781682 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5438306-df9d-4f31-8c6e-a11bf517c253 service placement] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:17:19.781953 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5438306-df9d-4f31-8c6e-a11bf517c253 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:17:19.783645 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-d5438306-df9d-4f31-8c6e-a11bf517c253 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:17:19.794583 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5438306-df9d-4f31-8c6e-a11bf517c253 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:17:19.796200 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5438306-df9d-4f31-8c6e-a11bf517c253 service placement] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:17:19.805683 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1408/2819] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:17:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:18:10.608302 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f802835-32a9-4e42-9f95-2e2b18bbac24 service cinder] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:18:10.610279 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-0f802835-32a9-4e42-9f95-2e2b18bbac24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:18:10.694958 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f802835-32a9-4e42-9f95-2e2b18bbac24 service cinder] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:18:10.702633 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66b582-d098-4e4b-b56f-b612fd5fa980 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:18:10.703372 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66b582-d098-4e4b-b56f-b612fd5fa980 service nova] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:18:10.703899 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66b582-d098-4e4b-b56f-b612fd5fa980 service nova] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:18:10.704188 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66b582-d098-4e4b-b56f-b612fd5fa980 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:18:10.706158 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-df66b582-d098-4e4b-b56f-b612fd5fa980 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:18:10.719165 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66b582-d098-4e4b-b56f-b612fd5fa980 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:18:10.720906 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66b582-d098-4e4b-b56f-b612fd5fa980 service nova] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:18:10.740349 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1412/2820] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:18:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:18:37.214190 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5438306-df9d-4f31-8c6e-a11bf517c253 service placement] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:18:37.226750 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5438306-df9d-4f31-8c6e-a11bf517c253 service placement] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:18:37.232118 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86adc6-8ac2-478b-a489-7dd9b0607ad2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:18:37.232744 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86adc6-8ac2-478b-a489-7dd9b0607ad2 service nova] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:18:37.233027 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86adc6-8ac2-478b-a489-7dd9b0607ad2 service nova] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:18:37.233303 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86adc6-8ac2-478b-a489-7dd9b0607ad2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:18:37.235049 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-5e86adc6-8ac2-478b-a489-7dd9b0607ad2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:18:37.289198 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86adc6-8ac2-478b-a489-7dd9b0607ad2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:18:37.290762 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86adc6-8ac2-478b-a489-7dd9b0607ad2 service nova] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:18:37.299302 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1409/2821] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:18:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:19:11.193112 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66b582-d098-4e4b-b56f-b612fd5fa980 service nova] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:19:11.194521 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-df66b582-d098-4e4b-b56f-b612fd5fa980 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:19:11.247999 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66b582-d098-4e4b-b56f-b612fd5fa980 service nova] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:19:11.251547 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014fce5-7904-4dea-8a76-39c61cc468f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:19:11.252194 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014fce5-7904-4dea-8a76-39c61cc468f8 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:19:11.252479 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014fce5-7904-4dea-8a76-39c61cc468f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:19:11.252760 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014fce5-7904-4dea-8a76-39c61cc468f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:19:11.254467 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-a014fce5-7904-4dea-8a76-39c61cc468f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:19:11.267420 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a014fce5-7904-4dea-8a76-39c61cc468f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:19:11.268882 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a014fce5-7904-4dea-8a76-39c61cc468f8 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:19:11.279363 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1413/2822] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:19:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:19:12.380145 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86adc6-8ac2-478b-a489-7dd9b0607ad2 service nova] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:19:12.389204 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86adc6-8ac2-478b-a489-7dd9b0607ad2 service nova] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:19:12.392853 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8947d-0746-4439-9eeb-8b5b35fb030d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:19:12.393491 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8947d-0746-4439-9eeb-8b5b35fb030d service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:19:12.393854 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8947d-0746-4439-9eeb-8b5b35fb030d service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:19:12.394133 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8947d-0746-4439-9eeb-8b5b35fb030d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:19:12.395952 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-e6a8947d-0746-4439-9eeb-8b5b35fb030d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:19:12.409277 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8947d-0746-4439-9eeb-8b5b35fb030d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:19:12.410691 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8947d-0746-4439-9eeb-8b5b35fb030d service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:19:12.422126 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1410/2823] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:19:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:20:20.399220 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014fce5-7904-4dea-8a76-39c61cc468f8 service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:20:20.409684 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014fce5-7904-4dea-8a76-39c61cc468f8 service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:20:20.421259 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590d5ac-63d2-4a50-804b-54c47bf24906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:20:20.421928 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590d5ac-63d2-4a50-804b-54c47bf24906 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:20:20.422209 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590d5ac-63d2-4a50-804b-54c47bf24906 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:20:20.422482 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590d5ac-63d2-4a50-804b-54c47bf24906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:20:20.424463 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-e590d5ac-63d2-4a50-804b-54c47bf24906 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:20:20.434476 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e590d5ac-63d2-4a50-804b-54c47bf24906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:20:20.435925 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e590d5ac-63d2-4a50-804b-54c47bf24906 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:20:20.445050 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1414/2824] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:20:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:21:45.105324 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8947d-0746-4439-9eeb-8b5b35fb030d service neutron] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:21:45.114706 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8947d-0746-4439-9eeb-8b5b35fb030d service neutron] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:21:45.118435 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7717cbd9-d333-4474-8c7a-e4ea7440a138 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:21:45.119099 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717cbd9-d333-4474-8c7a-e4ea7440a138 service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:21:45.119384 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717cbd9-d333-4474-8c7a-e4ea7440a138 service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:21:45.119706 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717cbd9-d333-4474-8c7a-e4ea7440a138 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:21:45.121519 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-7717cbd9-d333-4474-8c7a-e4ea7440a138 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:21:45.177554 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7717cbd9-d333-4474-8c7a-e4ea7440a138 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:21:45.179016 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7717cbd9-d333-4474-8c7a-e4ea7440a138 service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:21:45.187703 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1411/2825] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:21:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:21:46.274650 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590d5ac-63d2-4a50-804b-54c47bf24906 service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:21:46.284405 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590d5ac-63d2-4a50-804b-54c47bf24906 service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:21:46.288100 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b75f39-28a0-450a-bb78-566598703a62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:21:46.288752 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b75f39-28a0-450a-bb78-566598703a62 service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:21:46.289035 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b75f39-28a0-450a-bb78-566598703a62 service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:21:46.289315 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b75f39-28a0-450a-bb78-566598703a62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:21:46.291102 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-d1b75f39-28a0-450a-bb78-566598703a62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:21:46.367764 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b75f39-28a0-450a-bb78-566598703a62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:21:46.369211 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b75f39-28a0-450a-bb78-566598703a62 service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:21:46.386945 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1415/2826] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:21:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:21:52.285145 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7717cbd9-d333-4474-8c7a-e4ea7440a138 service cinder] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:21:52.293308 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7717cbd9-d333-4474-8c7a-e4ea7440a138 service cinder] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:21:52.297030 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adb17b-c83d-440f-9a83-f41a1d524712 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:21:52.297673 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adb17b-c83d-440f-9a83-f41a1d524712 service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:21:52.297955 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adb17b-c83d-440f-9a83-f41a1d524712 service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:21:52.298230 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adb17b-c83d-440f-9a83-f41a1d524712 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:21:52.306582 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38adb17b-c83d-440f-9a83-f41a1d524712 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:21:52.308041 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38adb17b-c83d-440f-9a83-f41a1d524712 service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:21:52.317280 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1412/2827] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:21:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:22:24.670892 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b75f39-28a0-450a-bb78-566598703a62 service cinder] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:22:24.672336 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-d1b75f39-28a0-450a-bb78-566598703a62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:22:24.773754 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b75f39-28a0-450a-bb78-566598703a62 service cinder] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:22:24.778890 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d197b8-c9fc-4941-ba2a-daf36ce31793 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319da006b10c41f8aa8a9d5aa2225b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:22:24.779521 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d197b8-c9fc-4941-ba2a-daf36ce31793 service placement] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:22:24.779826 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d197b8-c9fc-4941-ba2a-daf36ce31793 service placement] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:22:24.780101 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d197b8-c9fc-4941-ba2a-daf36ce31793 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:22:24.789437 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d197b8-c9fc-4941-ba2a-daf36ce31793 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:22:24.790904 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d197b8-c9fc-4941-ba2a-daf36ce31793 service placement] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:22:24.801364 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1416/2828] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:22:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:22:58.543284 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adb17b-c83d-440f-9a83-f41a1d524712 service cinder] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:22:58.544938 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-38adb17b-c83d-440f-9a83-f41a1d524712 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:22:58.619857 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adb17b-c83d-440f-9a83-f41a1d524712 service cinder] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:22:58.625542 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf04541-1223-44ca-97cc-8e3c7375635c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:22:58.626184 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf04541-1223-44ca-97cc-8e3c7375635c service nova] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:22:58.626463 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf04541-1223-44ca-97cc-8e3c7375635c service nova] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:22:58.626764 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf04541-1223-44ca-97cc-8e3c7375635c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:22:58.628632 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-cbf04541-1223-44ca-97cc-8e3c7375635c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:22:58.641182 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf04541-1223-44ca-97cc-8e3c7375635c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:22:58.643280 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf04541-1223-44ca-97cc-8e3c7375635c service nova] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:22:58.655132 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1413/2829] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:22:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:23:37.326081 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d197b8-c9fc-4941-ba2a-daf36ce31793 service placement] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:23:37.338773 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d197b8-c9fc-4941-ba2a-daf36ce31793 service placement] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:23:37.344440 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa907d7-5656-4764-801c-c4d2bff78a46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:23:37.345085 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa907d7-5656-4764-801c-c4d2bff78a46 service nova] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:23:37.345373 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa907d7-5656-4764-801c-c4d2bff78a46 service nova] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:23:37.345651 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa907d7-5656-4764-801c-c4d2bff78a46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:23:37.353732 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa907d7-5656-4764-801c-c4d2bff78a46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:23:37.355290 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa907d7-5656-4764-801c-c4d2bff78a46 service nova] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:23:37.383248 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1417/2830] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:23:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:24:10.236750 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf04541-1223-44ca-97cc-8e3c7375635c service nova] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:24:10.256080 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf04541-1223-44ca-97cc-8e3c7375635c service nova] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:24:10.259635 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec629d-934f-416a-912b-7cde9c5f8d12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:24:10.260291 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec629d-934f-416a-912b-7cde9c5f8d12 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:24:10.260570 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec629d-934f-416a-912b-7cde9c5f8d12 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:24:10.260847 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec629d-934f-416a-912b-7cde9c5f8d12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:24:10.271351 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec629d-934f-416a-912b-7cde9c5f8d12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:24:10.272827 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec629d-934f-416a-912b-7cde9c5f8d12 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:24:10.283365 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1414/2831] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:24:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:24:11.610600 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa907d7-5656-4764-801c-c4d2bff78a46 service nova] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:24:11.619985 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa907d7-5656-4764-801c-c4d2bff78a46 service nova] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:24:11.623510 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848cf27a-739b-4aaa-ae66-602cf9faabc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:24:11.624180 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848cf27a-739b-4aaa-ae66-602cf9faabc4 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:24:11.624460 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848cf27a-739b-4aaa-ae66-602cf9faabc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:24:11.624737 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848cf27a-739b-4aaa-ae66-602cf9faabc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:24:11.626512 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-848cf27a-739b-4aaa-ae66-602cf9faabc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:24:11.706323 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848cf27a-739b-4aaa-ae66-602cf9faabc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:24:11.708414 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848cf27a-739b-4aaa-ae66-602cf9faabc4 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:24:11.726248 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1418/2832] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:24:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:24:18.087945 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec629d-934f-416a-912b-7cde9c5f8d12 service neutron] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:24:18.091517 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-d7ec629d-934f-416a-912b-7cde9c5f8d12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:24:18.106636 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec629d-934f-416a-912b-7cde9c5f8d12 service neutron] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:24:18.111359 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283dbb2-b313-4d0a-ad3e-abd6a71e28ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:24:18.112430 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283dbb2-b313-4d0a-ad3e-abd6a71e28ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:24:18.112719 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283dbb2-b313-4d0a-ad3e-abd6a71e28ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:24:18.112994 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283dbb2-b313-4d0a-ad3e-abd6a71e28ec admin admin] PATH_INFO: `/v3/users/01285d0eaa394db3900074a9ee48e784` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:24:18.130240 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283dbb2-b313-4d0a-ad3e-abd6a71e28ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=01285d0eaa394db3900074a9ee48e784)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:24:18.132213 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283dbb2-b313-4d0a-ad3e-abd6a71e28ec admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:24:18.179196 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-4283dbb2-b313-4d0a-ad3e-abd6a71e28ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01285d0eaa394db3900074a9ee48e784'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:24:18.185795 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-4283dbb2-b313-4d0a-ad3e-abd6a71e28ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01285d0eaa394db3900074a9ee48e784'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:24:18.193481 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-4283dbb2-b313-4d0a-ad3e-abd6a71e28ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01285d0eaa394db3900074a9ee48e784'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:24:18.206459 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-4283dbb2-b313-4d0a-ad3e-abd6a71e28ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01285d0eaa394db3900074a9ee48e784'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:24:18.207210 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-4283dbb2-b313-4d0a-ad3e-abd6a71e28ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01285d0eaa394db3900074a9ee48e784'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:24:18.213755 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1415/2833] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:24:18 2022] DELETE /identity/v3/users/01285d0eaa394db3900074a9ee48e784 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:24:18.389953 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848cf27a-739b-4aaa-ae66-602cf9faabc4 service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:24:18.400805 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848cf27a-739b-4aaa-ae66-602cf9faabc4 service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:24:18.456631 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79f5ba-99ee-46d7-ad37-d1ee0c2185e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:24:18.457517 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79f5ba-99ee-46d7-ad37-d1ee0c2185e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:24:18.457800 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79f5ba-99ee-46d7-ad37-d1ee0c2185e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:24:18.458080 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79f5ba-99ee-46d7-ad37-d1ee0c2185e7 admin admin] PATH_INFO: `/v3/projects/8147c8a0a0e84e209d510fa08576189e` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:24:18.459252 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c79f5ba-99ee-46d7-ad37-d1ee0c2185e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8147c8a0a0e84e209d510fa08576189e)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:24:18.461187 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c79f5ba-99ee-46d7-ad37-d1ee0c2185e7 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:24:18.505164 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-5c79f5ba-99ee-46d7-ad37-d1ee0c2185e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8147c8a0a0e84e209d510fa08576189e', 'request_id': 'req-5c79f5ba-99ee-46d7-ad37-d1ee0c2185e7'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:24:18.510358 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-5c79f5ba-99ee-46d7-ad37-d1ee0c2185e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8147c8a0a0e84e209d510fa08576189e', 'request_id': 'req-5c79f5ba-99ee-46d7-ad37-d1ee0c2185e7'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:24:18.516301 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-5c79f5ba-99ee-46d7-ad37-d1ee0c2185e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8147c8a0a0e84e209d510fa08576189e', 'request_id': 'req-5c79f5ba-99ee-46d7-ad37-d1ee0c2185e7'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:24:18.527799 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-5c79f5ba-99ee-46d7-ad37-d1ee0c2185e7 admin admin] The token cache is being invalidate because project 8147c8a0a0e84e209d510fa08576189e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:24:18.528090 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-5c79f5ba-99ee-46d7-ad37-d1ee0c2185e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:24:18.528709 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-5c79f5ba-99ee-46d7-ad37-d1ee0c2185e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:24:18.530197 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1419/2834] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:24:18 2022] DELETE /identity/v3/projects/8147c8a0a0e84e209d510fa08576189e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:24:18.534208 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283dbb2-b313-4d0a-ad3e-abd6a71e28ec admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:24:18.536126 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-4283dbb2-b313-4d0a-ad3e-abd6a71e28ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:24:18.548761 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283dbb2-b313-4d0a-ad3e-abd6a71e28ec admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:24:18.602300 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628b197-93a3-44db-8b39-62450b8397ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:24:18.603166 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628b197-93a3-44db-8b39-62450b8397ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:24:18.603447 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628b197-93a3-44db-8b39-62450b8397ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:24:18.603743 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628b197-93a3-44db-8b39-62450b8397ce admin admin] PATH_INFO: `/v3/users/6efe0911e4bf427288ae51f3aa85bcbc` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:24:18.617254 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628b197-93a3-44db-8b39-62450b8397ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=6efe0911e4bf427288ae51f3aa85bcbc)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:24:18.619259 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628b197-93a3-44db-8b39-62450b8397ce admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:24:18.662023 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-0628b197-93a3-44db-8b39-62450b8397ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6efe0911e4bf427288ae51f3aa85bcbc'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:24:18.668462 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-0628b197-93a3-44db-8b39-62450b8397ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6efe0911e4bf427288ae51f3aa85bcbc'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:24:18.675449 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-0628b197-93a3-44db-8b39-62450b8397ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6efe0911e4bf427288ae51f3aa85bcbc'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:24:18.687325 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-0628b197-93a3-44db-8b39-62450b8397ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6efe0911e4bf427288ae51f3aa85bcbc'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:24:18.687996 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-0628b197-93a3-44db-8b39-62450b8397ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6efe0911e4bf427288ae51f3aa85bcbc'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:24:18.693945 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1416/2835] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:24:18 2022] DELETE /identity/v3/users/6efe0911e4bf427288ae51f3aa85bcbc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:24:18.862426 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79f5ba-99ee-46d7-ad37-d1ee0c2185e7 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:24:18.863927 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-5c79f5ba-99ee-46d7-ad37-d1ee0c2185e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:24:18.877596 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79f5ba-99ee-46d7-ad37-d1ee0c2185e7 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:24:18.933330 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11cd9a2-4332-4923-a302-7f26bc85b4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:24:18.934186 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11cd9a2-4332-4923-a302-7f26bc85b4c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:24:18.934480 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11cd9a2-4332-4923-a302-7f26bc85b4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:24:18.934746 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11cd9a2-4332-4923-a302-7f26bc85b4c6 admin admin] PATH_INFO: `/v3/projects/7f2da1ebe03a4aa1ba7a099897e07957` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:24:18.944836 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11cd9a2-4332-4923-a302-7f26bc85b4c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f2da1ebe03a4aa1ba7a099897e07957)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:24:18.947014 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11cd9a2-4332-4923-a302-7f26bc85b4c6 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:24:18.992944 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c11cd9a2-4332-4923-a302-7f26bc85b4c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f2da1ebe03a4aa1ba7a099897e07957', 'request_id': 'req-c11cd9a2-4332-4923-a302-7f26bc85b4c6'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:24:18.998061 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c11cd9a2-4332-4923-a302-7f26bc85b4c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f2da1ebe03a4aa1ba7a099897e07957', 'request_id': 'req-c11cd9a2-4332-4923-a302-7f26bc85b4c6'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:24:19.004319 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c11cd9a2-4332-4923-a302-7f26bc85b4c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f2da1ebe03a4aa1ba7a099897e07957', 'request_id': 'req-c11cd9a2-4332-4923-a302-7f26bc85b4c6'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:24:19.015533 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c11cd9a2-4332-4923-a302-7f26bc85b4c6 admin admin] The token cache is being invalidate because project 7f2da1ebe03a4aa1ba7a099897e07957 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:24:19.015848 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c11cd9a2-4332-4923-a302-7f26bc85b4c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:24:19.016457 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c11cd9a2-4332-4923-a302-7f26bc85b4c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:24:19.017988 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1420/2836] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:24:18 2022] DELETE /identity/v3/projects/7f2da1ebe03a4aa1ba7a099897e07957 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:25:26.378874 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628b197-93a3-44db-8b39-62450b8397ce admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:25:26.380343 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-0628b197-93a3-44db-8b39-62450b8397ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:25:26.445193 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628b197-93a3-44db-8b39-62450b8397ce admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:25:26.497327 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5b5d5-2bb3-4bac-9e41-5d6cf966260d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:25:26.497962 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5b5d5-2bb3-4bac-9e41-5d6cf966260d service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:25:26.498238 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5b5d5-2bb3-4bac-9e41-5d6cf966260d service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:25:26.498509 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5b5d5-2bb3-4bac-9e41-5d6cf966260d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:25:26.500285 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-65c5b5d5-2bb3-4bac-9e41-5d6cf966260d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:25:26.509729 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5b5d5-2bb3-4bac-9e41-5d6cf966260d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:25:26.511127 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5b5d5-2bb3-4bac-9e41-5d6cf966260d service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:25:26.518725 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1417/2837] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:25:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:26:44.952220 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11cd9a2-4332-4923-a302-7f26bc85b4c6 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:26:44.953644 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-c11cd9a2-4332-4923-a302-7f26bc85b4c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:26:45.028572 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11cd9a2-4332-4923-a302-7f26bc85b4c6 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:26:45.032187 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515ae6d-7db0-4995-9788-66779ae9a059 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:26:45.032812 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515ae6d-7db0-4995-9788-66779ae9a059 service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:26:45.033101 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515ae6d-7db0-4995-9788-66779ae9a059 service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:26:45.033377 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515ae6d-7db0-4995-9788-66779ae9a059 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:26:45.035108 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-1515ae6d-7db0-4995-9788-66779ae9a059 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:26:45.110843 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515ae6d-7db0-4995-9788-66779ae9a059 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:26:45.112335 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515ae6d-7db0-4995-9788-66779ae9a059 service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:26:45.130577 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1421/2838] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:26:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:26:47.209234 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5b5d5-2bb3-4bac-9e41-5d6cf966260d service neutron] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:26:47.218843 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5b5d5-2bb3-4bac-9e41-5d6cf966260d service neutron] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:26:47.222474 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6943716-7059-4a03-9d2a-ca0ef7cc5909 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:26:47.223119 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6943716-7059-4a03-9d2a-ca0ef7cc5909 service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:26:47.223514 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6943716-7059-4a03-9d2a-ca0ef7cc5909 service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:26:47.223834 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6943716-7059-4a03-9d2a-ca0ef7cc5909 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:26:47.225583 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-a6943716-7059-4a03-9d2a-ca0ef7cc5909 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:26:47.281726 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6943716-7059-4a03-9d2a-ca0ef7cc5909 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:26:47.283076 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6943716-7059-4a03-9d2a-ca0ef7cc5909 service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:26:47.292398 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1418/2839] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:26:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:26:53.286771 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515ae6d-7db0-4995-9788-66779ae9a059 service cinder] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:26:53.296316 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515ae6d-7db0-4995-9788-66779ae9a059 service cinder] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:26:53.300880 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b003b3-b95a-46f4-97dd-5a43a4241307 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:26:53.301523 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b003b3-b95a-46f4-97dd-5a43a4241307 service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:26:53.305287 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b003b3-b95a-46f4-97dd-5a43a4241307 service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:26:53.305287 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b003b3-b95a-46f4-97dd-5a43a4241307 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:26:53.305287 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-c5b003b3-b95a-46f4-97dd-5a43a4241307 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:26:53.394598 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b003b3-b95a-46f4-97dd-5a43a4241307 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:26:53.396172 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b003b3-b95a-46f4-97dd-5a43a4241307 service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:26:53.415973 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1422/2840] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:26:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:27:29.261701 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6943716-7059-4a03-9d2a-ca0ef7cc5909 service cinder] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:27:29.263025 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-a6943716-7059-4a03-9d2a-ca0ef7cc5909 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:27:29.328748 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6943716-7059-4a03-9d2a-ca0ef7cc5909 service cinder] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:27:29.333675 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd070d3-baaa-4957-a434-94b28bd6fdb6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319da006b10c41f8aa8a9d5aa2225b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:27:29.334310 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd070d3-baaa-4957-a434-94b28bd6fdb6 service placement] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:27:29.334589 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd070d3-baaa-4957-a434-94b28bd6fdb6 service placement] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:27:29.334864 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd070d3-baaa-4957-a434-94b28bd6fdb6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:27:29.336645 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-ddd070d3-baaa-4957-a434-94b28bd6fdb6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:27:29.347809 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd070d3-baaa-4957-a434-94b28bd6fdb6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:27:29.349378 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd070d3-baaa-4957-a434-94b28bd6fdb6 service placement] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:27:29.358920 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1419/2841] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:27:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:28:49.806797 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b003b3-b95a-46f4-97dd-5a43a4241307 service cinder] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:28:49.808304 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-c5b003b3-b95a-46f4-97dd-5a43a4241307 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:28:49.881233 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b003b3-b95a-46f4-97dd-5a43a4241307 service cinder] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:28:49.887527 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b286f9-39f3-4c7b-bbf7-e39b55b74c26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:28:49.888205 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b286f9-39f3-4c7b-bbf7-e39b55b74c26 service nova] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:28:49.888488 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b286f9-39f3-4c7b-bbf7-e39b55b74c26 service nova] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:28:49.888825 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b286f9-39f3-4c7b-bbf7-e39b55b74c26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:28:49.890647 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-08b286f9-39f3-4c7b-bbf7-e39b55b74c26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:28:49.907320 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b286f9-39f3-4c7b-bbf7-e39b55b74c26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:28:49.913377 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b286f9-39f3-4c7b-bbf7-e39b55b74c26 service nova] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:28:49.928637 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1423/2842] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:28:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:28:51.035113 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd070d3-baaa-4957-a434-94b28bd6fdb6 service placement] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:28:51.050472 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd070d3-baaa-4957-a434-94b28bd6fdb6 service placement] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:28:51.056220 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c90881-c883-42b4-bfb7-fca325534f6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:28:51.056855 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c90881-c883-42b4-bfb7-fca325534f6b service nova] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:28:51.057204 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c90881-c883-42b4-bfb7-fca325534f6b service nova] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:28:51.057610 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c90881-c883-42b4-bfb7-fca325534f6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:28:51.059456 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-02c90881-c883-42b4-bfb7-fca325534f6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:28:51.073451 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c90881-c883-42b4-bfb7-fca325534f6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:28:51.075107 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c90881-c883-42b4-bfb7-fca325534f6b service nova] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:28:51.085666 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1420/2843] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:28:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:28:52.610889 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b286f9-39f3-4c7b-bbf7-e39b55b74c26 service nova] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:28:52.612280 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-08b286f9-39f3-4c7b-bbf7-e39b55b74c26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:28:52.623272 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b286f9-39f3-4c7b-bbf7-e39b55b74c26 service nova] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:28:52.626800 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67b48e-9a91-4ac4-bb5b-4ae02f9d7011 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:28:52.627418 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67b48e-9a91-4ac4-bb5b-4ae02f9d7011 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:28:52.627706 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67b48e-9a91-4ac4-bb5b-4ae02f9d7011 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:28:52.628001 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67b48e-9a91-4ac4-bb5b-4ae02f9d7011 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:28:52.629680 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-bf67b48e-9a91-4ac4-bb5b-4ae02f9d7011 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:28:52.642273 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67b48e-9a91-4ac4-bb5b-4ae02f9d7011 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:28:52.643672 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67b48e-9a91-4ac4-bb5b-4ae02f9d7011 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:28:52.654738 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1424/2844] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:28:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:29:11.236066 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c90881-c883-42b4-bfb7-fca325534f6b service nova] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:29:11.245630 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c90881-c883-42b4-bfb7-fca325534f6b service nova] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:29:11.249159 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d3a3d-67cf-42a8-9d31-4414f755724f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:29:11.249780 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d3a3d-67cf-42a8-9d31-4414f755724f service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:29:11.250064 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d3a3d-67cf-42a8-9d31-4414f755724f service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:29:11.250341 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d3a3d-67cf-42a8-9d31-4414f755724f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:29:11.252100 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-136d3a3d-67cf-42a8-9d31-4414f755724f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:29:11.266017 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d3a3d-67cf-42a8-9d31-4414f755724f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:29:11.267421 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d3a3d-67cf-42a8-9d31-4414f755724f service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:29:11.278162 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1421/2845] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:29:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:31:44.746221 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67b48e-9a91-4ac4-bb5b-4ae02f9d7011 service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:31:44.755101 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67b48e-9a91-4ac4-bb5b-4ae02f9d7011 service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:31:44.759248 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18a337-a961-4d39-b9fa-992f477ef8e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:31:44.759906 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18a337-a961-4d39-b9fa-992f477ef8e3 service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:31:44.760188 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18a337-a961-4d39-b9fa-992f477ef8e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:31:44.760460 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18a337-a961-4d39-b9fa-992f477ef8e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:31:44.768451 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18a337-a961-4d39-b9fa-992f477ef8e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:31:44.769857 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18a337-a961-4d39-b9fa-992f477ef8e3 service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:31:44.778403 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1425/2846] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:31:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:31:46.667968 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d3a3d-67cf-42a8-9d31-4414f755724f service neutron] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:31:46.669386 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-136d3a3d-67cf-42a8-9d31-4414f755724f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:31:46.683298 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d3a3d-67cf-42a8-9d31-4414f755724f service neutron] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:31:46.688611 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201f6d8-f53f-46a2-a75e-0d4f9c87f069 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:31:46.689230 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201f6d8-f53f-46a2-a75e-0d4f9c87f069 service nova] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:31:46.689509 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201f6d8-f53f-46a2-a75e-0d4f9c87f069 service nova] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:31:46.689781 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201f6d8-f53f-46a2-a75e-0d4f9c87f069 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:31:46.699228 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201f6d8-f53f-46a2-a75e-0d4f9c87f069 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:31:46.700823 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201f6d8-f53f-46a2-a75e-0d4f9c87f069 service nova] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:31:46.728468 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1422/2847] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:31:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:31:53.083543 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18a337-a961-4d39-b9fa-992f477ef8e3 service cinder] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:31:53.092152 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18a337-a961-4d39-b9fa-992f477ef8e3 service cinder] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:31:53.095748 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e9d5a-a065-4c23-a3ef-c0668277750e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:31:53.096407 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e9d5a-a065-4c23-a3ef-c0668277750e service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:31:53.096687 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e9d5a-a065-4c23-a3ef-c0668277750e service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:31:53.096961 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e9d5a-a065-4c23-a3ef-c0668277750e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:31:53.104984 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e9d5a-a065-4c23-a3ef-c0668277750e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:31:53.106395 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e9d5a-a065-4c23-a3ef-c0668277750e service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:31:53.115135 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1426/2848] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:31:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:32:31.628020 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201f6d8-f53f-46a2-a75e-0d4f9c87f069 service nova] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:32:31.663038 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201f6d8-f53f-46a2-a75e-0d4f9c87f069 service nova] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:32:31.668320 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af26e6-b6df-480b-8fc7-12bbd6ec3c53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319da006b10c41f8aa8a9d5aa2225b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:32:31.668962 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af26e6-b6df-480b-8fc7-12bbd6ec3c53 service placement] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:32:31.669249 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af26e6-b6df-480b-8fc7-12bbd6ec3c53 service placement] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:32:31.669529 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af26e6-b6df-480b-8fc7-12bbd6ec3c53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:32:31.678009 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af26e6-b6df-480b-8fc7-12bbd6ec3c53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:32:31.679576 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af26e6-b6df-480b-8fc7-12bbd6ec3c53 service placement] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:32:31.689280 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1423/2849] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:32:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:33:52.381417 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e9d5a-a065-4c23-a3ef-c0668277750e service cinder] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:33:52.399655 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e9d5a-a065-4c23-a3ef-c0668277750e service cinder] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:33:52.403200 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06c1c5-1474-4416-aa93-42e4fc1286c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:33:52.403857 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06c1c5-1474-4416-aa93-42e4fc1286c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:33:52.404138 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06c1c5-1474-4416-aa93-42e4fc1286c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:33:52.404413 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06c1c5-1474-4416-aa93-42e4fc1286c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:33:52.435809 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f06c1c5-1474-4416-aa93-42e4fc1286c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:33:52.437245 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f06c1c5-1474-4416-aa93-42e4fc1286c2 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:33:52.458325 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1427/2850] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:33:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:34:13.218616 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af26e6-b6df-480b-8fc7-12bbd6ec3c53 service placement] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:34:13.248647 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af26e6-b6df-480b-8fc7-12bbd6ec3c53 service placement] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:34:13.255977 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d371a-2153-4be3-b049-c452f517336e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:34:13.256614 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d371a-2153-4be3-b049-c452f517336e service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:34:13.256897 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d371a-2153-4be3-b049-c452f517336e service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:34:13.257173 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d371a-2153-4be3-b049-c452f517336e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:34:13.267355 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d371a-2153-4be3-b049-c452f517336e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:34:13.269377 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d371a-2153-4be3-b049-c452f517336e service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:34:13.281755 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1424/2851] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:34:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:36:44.167571 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06c1c5-1474-4416-aa93-42e4fc1286c2 service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:36:44.177282 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06c1c5-1474-4416-aa93-42e4fc1286c2 service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:36:44.180787 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb40f68-2475-46ae-a4f7-731178857e9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:36:44.181413 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb40f68-2475-46ae-a4f7-731178857e9c service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:36:44.181693 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb40f68-2475-46ae-a4f7-731178857e9c service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:36:44.181967 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb40f68-2475-46ae-a4f7-731178857e9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:36:44.190558 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb40f68-2475-46ae-a4f7-731178857e9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:36:44.192004 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb40f68-2475-46ae-a4f7-731178857e9c service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:36:44.200840 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1428/2852] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:36:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:36:45.909008 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d371a-2153-4be3-b049-c452f517336e service neutron] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:36:45.910547 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-166d371a-2153-4be3-b049-c452f517336e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:36:45.992774 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d371a-2153-4be3-b049-c452f517336e service neutron] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:36:45.996379 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c9c3a-b417-4966-9e60-c472b8c70789 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:36:45.997014 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c9c3a-b417-4966-9e60-c472b8c70789 service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:36:45.997293 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c9c3a-b417-4966-9e60-c472b8c70789 service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:36:45.997565 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c9c3a-b417-4966-9e60-c472b8c70789 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:36:46.005650 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c9c3a-b417-4966-9e60-c472b8c70789 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:36:46.007060 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c9c3a-b417-4966-9e60-c472b8c70789 service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:36:46.015607 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1425/2853] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:36:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:36:52.376780 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb40f68-2475-46ae-a4f7-731178857e9c service cinder] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:36:52.378226 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-acb40f68-2475-46ae-a4f7-731178857e9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:36:52.440843 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb40f68-2475-46ae-a4f7-731178857e9c service cinder] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:36:52.444499 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54865f-7a0c-4a50-bdb2-4931664741a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:36:52.445378 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54865f-7a0c-4a50-bdb2-4931664741a7 service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:36:52.445486 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54865f-7a0c-4a50-bdb2-4931664741a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:36:52.445951 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54865f-7a0c-4a50-bdb2-4931664741a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:36:52.454390 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54865f-7a0c-4a50-bdb2-4931664741a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:36:52.456496 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54865f-7a0c-4a50-bdb2-4931664741a7 service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:36:52.465051 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1429/2854] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:36:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:37:33.578643 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c9c3a-b417-4966-9e60-c472b8c70789 service cinder] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:37:33.580071 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-d79c9c3a-b417-4966-9e60-c472b8c70789 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:37:33.656448 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c9c3a-b417-4966-9e60-c472b8c70789 service cinder] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:37:33.661225 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563fe59-283c-492d-ac28-54af6b8accc6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319da006b10c41f8aa8a9d5aa2225b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:37:33.661851 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563fe59-283c-492d-ac28-54af6b8accc6 service placement] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:37:33.662129 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563fe59-283c-492d-ac28-54af6b8accc6 service placement] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:37:33.662402 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563fe59-283c-492d-ac28-54af6b8accc6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:37:33.664245 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-6563fe59-283c-492d-ac28-54af6b8accc6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:37:33.675551 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563fe59-283c-492d-ac28-54af6b8accc6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:37:33.677124 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563fe59-283c-492d-ac28-54af6b8accc6 service placement] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:37:33.686529 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1426/2855] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:37:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:40:51.539736 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54865f-7a0c-4a50-bdb2-4931664741a7 service cinder] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:40:51.541962 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-9a54865f-7a0c-4a50-bdb2-4931664741a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:40:51.609884 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54865f-7a0c-4a50-bdb2-4931664741a7 service cinder] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:40:51.613496 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc379ca-a740-48be-8128-d2a61bc78314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:40:51.614129 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc379ca-a740-48be-8128-d2a61bc78314 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:40:51.614413 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc379ca-a740-48be-8128-d2a61bc78314 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:40:51.614691 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc379ca-a740-48be-8128-d2a61bc78314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:40:51.616609 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-2dc379ca-a740-48be-8128-d2a61bc78314 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:40:51.695571 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc379ca-a740-48be-8128-d2a61bc78314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:40:51.697161 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc379ca-a740-48be-8128-d2a61bc78314 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:40:51.716196 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1430/2856] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:40:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:40:58.053467 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563fe59-283c-492d-ac28-54af6b8accc6 service placement] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:40:58.054906 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-6563fe59-283c-492d-ac28-54af6b8accc6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:40:58.070043 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563fe59-283c-492d-ac28-54af6b8accc6 service placement] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:40:58.074618 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f387c6-c689-4dfc-9d04-63db01592d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:40:58.075481 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f387c6-c689-4dfc-9d04-63db01592d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:40:58.075796 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f387c6-c689-4dfc-9d04-63db01592d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:40:58.076074 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f387c6-c689-4dfc-9d04-63db01592d42 admin admin] PATH_INFO: `/v3/users/78c3042fa768466e9a519b4fdb52edd3` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:40:58.089437 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f387c6-c689-4dfc-9d04-63db01592d42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78c3042fa768466e9a519b4fdb52edd3)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:40:58.091343 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f387c6-c689-4dfc-9d04-63db01592d42 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:40:58.134573 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-74f387c6-c689-4dfc-9d04-63db01592d42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78c3042fa768466e9a519b4fdb52edd3'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:40:58.140997 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-74f387c6-c689-4dfc-9d04-63db01592d42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78c3042fa768466e9a519b4fdb52edd3'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:40:58.147517 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-74f387c6-c689-4dfc-9d04-63db01592d42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78c3042fa768466e9a519b4fdb52edd3'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:40:58.158583 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-74f387c6-c689-4dfc-9d04-63db01592d42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78c3042fa768466e9a519b4fdb52edd3'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:40:58.159217 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-74f387c6-c689-4dfc-9d04-63db01592d42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78c3042fa768466e9a519b4fdb52edd3'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:40:58.164888 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1427/2857] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:40:58 2022] DELETE /identity/v3/users/78c3042fa768466e9a519b4fdb52edd3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:40:58.332955 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc379ca-a740-48be-8128-d2a61bc78314 service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:40:58.345147 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc379ca-a740-48be-8128-d2a61bc78314 service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:40:58.401043 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a03688-bc26-4ee3-a32d-481ce34821f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:40:58.401886 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a03688-bc26-4ee3-a32d-481ce34821f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:40:58.402166 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a03688-bc26-4ee3-a32d-481ce34821f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:40:58.402437 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a03688-bc26-4ee3-a32d-481ce34821f1 admin admin] PATH_INFO: `/v3/projects/91e8c3a1fca04f8094024519d894a9a8` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:40:58.403585 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a03688-bc26-4ee3-a32d-481ce34821f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91e8c3a1fca04f8094024519d894a9a8)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:40:58.406032 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a03688-bc26-4ee3-a32d-481ce34821f1 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:40:58.449941 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-25a03688-bc26-4ee3-a32d-481ce34821f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91e8c3a1fca04f8094024519d894a9a8', 'request_id': 'req-25a03688-bc26-4ee3-a32d-481ce34821f1'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:40:58.455042 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-25a03688-bc26-4ee3-a32d-481ce34821f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91e8c3a1fca04f8094024519d894a9a8', 'request_id': 'req-25a03688-bc26-4ee3-a32d-481ce34821f1'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:40:58.460826 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-25a03688-bc26-4ee3-a32d-481ce34821f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91e8c3a1fca04f8094024519d894a9a8', 'request_id': 'req-25a03688-bc26-4ee3-a32d-481ce34821f1'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:40:58.472857 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-25a03688-bc26-4ee3-a32d-481ce34821f1 admin admin] The token cache is being invalidate because project 91e8c3a1fca04f8094024519d894a9a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:40:58.473140 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-25a03688-bc26-4ee3-a32d-481ce34821f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:40:58.473754 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-25a03688-bc26-4ee3-a32d-481ce34821f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:40:58.475248 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1431/2858] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:40:58 2022] DELETE /identity/v3/projects/91e8c3a1fca04f8094024519d894a9a8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:40:58.479203 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f387c6-c689-4dfc-9d04-63db01592d42 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:40:58.480620 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-74f387c6-c689-4dfc-9d04-63db01592d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:40:58.494247 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f387c6-c689-4dfc-9d04-63db01592d42 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:40:58.547404 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0aae4-a204-4dde-b6f4-ad87bb8be1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:40:58.548289 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0aae4-a204-4dde-b6f4-ad87bb8be1e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:40:58.548574 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0aae4-a204-4dde-b6f4-ad87bb8be1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:40:58.548852 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0aae4-a204-4dde-b6f4-ad87bb8be1e7 admin admin] PATH_INFO: `/v3/users/30722537103c4596b8437efcf1faec57` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:40:58.568330 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0aae4-a204-4dde-b6f4-ad87bb8be1e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30722537103c4596b8437efcf1faec57)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:40:58.570177 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0aae4-a204-4dde-b6f4-ad87bb8be1e7 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:40:58.619325 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-eff0aae4-a204-4dde-b6f4-ad87bb8be1e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30722537103c4596b8437efcf1faec57'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:40:58.626050 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-eff0aae4-a204-4dde-b6f4-ad87bb8be1e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30722537103c4596b8437efcf1faec57'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:40:58.633737 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-eff0aae4-a204-4dde-b6f4-ad87bb8be1e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30722537103c4596b8437efcf1faec57'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:40:58.645181 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-eff0aae4-a204-4dde-b6f4-ad87bb8be1e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30722537103c4596b8437efcf1faec57'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:40:58.645817 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-eff0aae4-a204-4dde-b6f4-ad87bb8be1e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30722537103c4596b8437efcf1faec57'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:40:58.651915 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1428/2859] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:40:58 2022] DELETE /identity/v3/users/30722537103c4596b8437efcf1faec57 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:40:58.830847 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a03688-bc26-4ee3-a32d-481ce34821f1 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:40:58.832481 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-25a03688-bc26-4ee3-a32d-481ce34821f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:40:58.845963 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a03688-bc26-4ee3-a32d-481ce34821f1 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:40:58.901630 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5357c11-25c2-4a1b-90ca-0c1f5cca661a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:40:58.902487 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5357c11-25c2-4a1b-90ca-0c1f5cca661a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:40:58.902771 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5357c11-25c2-4a1b-90ca-0c1f5cca661a admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:40:58.903046 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5357c11-25c2-4a1b-90ca-0c1f5cca661a admin admin] PATH_INFO: `/v3/projects/29e5e51d084e48cdaa93eacc0c264723` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:40:58.914520 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5357c11-25c2-4a1b-90ca-0c1f5cca661a admin admin] RBAC: Authorizing `identity:delete_project(project_id=29e5e51d084e48cdaa93eacc0c264723)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:40:58.916544 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5357c11-25c2-4a1b-90ca-0c1f5cca661a admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:40:58.963447 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c5357c11-25c2-4a1b-90ca-0c1f5cca661a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29e5e51d084e48cdaa93eacc0c264723', 'request_id': 'req-c5357c11-25c2-4a1b-90ca-0c1f5cca661a'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:40:58.969281 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c5357c11-25c2-4a1b-90ca-0c1f5cca661a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29e5e51d084e48cdaa93eacc0c264723', 'request_id': 'req-c5357c11-25c2-4a1b-90ca-0c1f5cca661a'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:40:58.975791 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c5357c11-25c2-4a1b-90ca-0c1f5cca661a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29e5e51d084e48cdaa93eacc0c264723', 'request_id': 'req-c5357c11-25c2-4a1b-90ca-0c1f5cca661a'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:40:58.991811 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c5357c11-25c2-4a1b-90ca-0c1f5cca661a admin admin] The token cache is being invalidate because project 29e5e51d084e48cdaa93eacc0c264723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:40:58.992100 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c5357c11-25c2-4a1b-90ca-0c1f5cca661a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:40:58.992760 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-c5357c11-25c2-4a1b-90ca-0c1f5cca661a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:40:58.994348 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1432/2860] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:40:58 2022] DELETE /identity/v3/projects/29e5e51d084e48cdaa93eacc0c264723 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:41:44.239937 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0aae4-a204-4dde-b6f4-ad87bb8be1e7 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:41:44.241348 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-eff0aae4-a204-4dde-b6f4-ad87bb8be1e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:41:44.296744 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0aae4-a204-4dde-b6f4-ad87bb8be1e7 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:41:44.345511 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9b8e6-e749-4c41-8146-df9cd3b49160 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:41:44.346140 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9b8e6-e749-4c41-8146-df9cd3b49160 service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:41:44.346417 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9b8e6-e749-4c41-8146-df9cd3b49160 service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:41:44.346685 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9b8e6-e749-4c41-8146-df9cd3b49160 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:41:44.348466 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-30b9b8e6-e749-4c41-8146-df9cd3b49160 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:41:44.424729 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9b8e6-e749-4c41-8146-df9cd3b49160 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:41:44.426145 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9b8e6-e749-4c41-8146-df9cd3b49160 service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:41:44.443414 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1429/2861] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:41:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:41:52.754864 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5357c11-25c2-4a1b-90ca-0c1f5cca661a admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:41:52.756331 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-c5357c11-25c2-4a1b-90ca-0c1f5cca661a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:41:52.769104 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5357c11-25c2-4a1b-90ca-0c1f5cca661a admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:41:52.772666 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883568a-c401-4b01-afe9-adff2a31d8b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:41:52.773299 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883568a-c401-4b01-afe9-adff2a31d8b8 service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:41:52.773584 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883568a-c401-4b01-afe9-adff2a31d8b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:41:52.773865 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883568a-c401-4b01-afe9-adff2a31d8b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:41:52.775603 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-9883568a-c401-4b01-afe9-adff2a31d8b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:41:52.855220 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883568a-c401-4b01-afe9-adff2a31d8b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:41:52.856690 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883568a-c401-4b01-afe9-adff2a31d8b8 service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:41:52.874228 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1433/2862] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:41:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:42:36.565502 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9b8e6-e749-4c41-8146-df9cd3b49160 service cinder] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:42:36.566889 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-30b9b8e6-e749-4c41-8146-df9cd3b49160 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:42:36.656472 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9b8e6-e749-4c41-8146-df9cd3b49160 service cinder] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:42:36.661459 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6062b-368d-41ee-8e97-10560e96d111 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319da006b10c41f8aa8a9d5aa2225b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:42:36.662094 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6062b-368d-41ee-8e97-10560e96d111 service placement] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:42:36.662380 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6062b-368d-41ee-8e97-10560e96d111 service placement] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:42:36.662661 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6062b-368d-41ee-8e97-10560e96d111 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:42:36.664438 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-89e6062b-368d-41ee-8e97-10560e96d111 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:42:36.677222 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6062b-368d-41ee-8e97-10560e96d111 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:42:36.678788 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6062b-368d-41ee-8e97-10560e96d111 service placement] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:42:36.688490 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1430/2863] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:42:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:46:44.930277 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883568a-c401-4b01-afe9-adff2a31d8b8 service cinder] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:46:44.931701 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-9883568a-c401-4b01-afe9-adff2a31d8b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:46:44.951832 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883568a-c401-4b01-afe9-adff2a31d8b8 service cinder] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:46:44.955457 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f6941-b1f9-4f1a-b571-877e17924cec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:46:44.956115 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f6941-b1f9-4f1a-b571-877e17924cec service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:46:44.956399 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f6941-b1f9-4f1a-b571-877e17924cec service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:46:44.956678 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f6941-b1f9-4f1a-b571-877e17924cec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:46:44.979203 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f6941-b1f9-4f1a-b571-877e17924cec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:46:44.980649 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f6941-b1f9-4f1a-b571-877e17924cec service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:46:44.989413 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1434/2864] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:46:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:46:52.256773 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6062b-368d-41ee-8e97-10560e96d111 service placement] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:46:52.275665 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6062b-368d-41ee-8e97-10560e96d111 service placement] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:46:52.279396 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39503a-f57f-44fb-8407-08a829306792 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:46:52.280066 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39503a-f57f-44fb-8407-08a829306792 service cinder] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:46:52.280350 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39503a-f57f-44fb-8407-08a829306792 service cinder] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:46:52.280626 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39503a-f57f-44fb-8407-08a829306792 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:46:52.288793 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c39503a-f57f-44fb-8407-08a829306792 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:46:52.290242 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c39503a-f57f-44fb-8407-08a829306792 service cinder] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:46:52.298694 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1431/2865] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:46:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:46:54.688304 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f6941-b1f9-4f1a-b571-877e17924cec service cinder] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:46:54.689682 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-190f6941-b1f9-4f1a-b571-877e17924cec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:46:54.764220 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f6941-b1f9-4f1a-b571-877e17924cec service cinder] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:46:54.767750 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe440e-e9b1-4191-8a97-1ee83ee4bca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:46:54.768381 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe440e-e9b1-4191-8a97-1ee83ee4bca2 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:46:54.768661 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe440e-e9b1-4191-8a97-1ee83ee4bca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:46:54.768935 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe440e-e9b1-4191-8a97-1ee83ee4bca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:46:54.770660 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-dafe440e-e9b1-4191-8a97-1ee83ee4bca2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:46:54.828680 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe440e-e9b1-4191-8a97-1ee83ee4bca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:46:54.830086 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe440e-e9b1-4191-8a97-1ee83ee4bca2 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:46:54.839188 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1435/2866] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:46:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:46:55.793663 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39503a-f57f-44fb-8407-08a829306792 service cinder] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:46:55.795882 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-9c39503a-f57f-44fb-8407-08a829306792 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:46:55.810942 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39503a-f57f-44fb-8407-08a829306792 service cinder] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:46:55.816012 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261349ef-6a7f-407e-8ff9-e5df038532bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:46:55.816884 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261349ef-6a7f-407e-8ff9-e5df038532bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:46:55.817168 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261349ef-6a7f-407e-8ff9-e5df038532bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:46:55.817446 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261349ef-6a7f-407e-8ff9-e5df038532bb admin admin] PATH_INFO: `/v3/users/1f5ee97c7962473490795d1723cb0883` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:46:55.818615 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261349ef-6a7f-407e-8ff9-e5df038532bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f5ee97c7962473490795d1723cb0883)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:46:55.821097 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261349ef-6a7f-407e-8ff9-e5df038532bb admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:46:55.866311 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-261349ef-6a7f-407e-8ff9-e5df038532bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f5ee97c7962473490795d1723cb0883'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:46:55.873349 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-261349ef-6a7f-407e-8ff9-e5df038532bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f5ee97c7962473490795d1723cb0883'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:46:55.880068 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-261349ef-6a7f-407e-8ff9-e5df038532bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f5ee97c7962473490795d1723cb0883'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:46:55.892138 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-261349ef-6a7f-407e-8ff9-e5df038532bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f5ee97c7962473490795d1723cb0883'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:46:55.892768 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-261349ef-6a7f-407e-8ff9-e5df038532bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f5ee97c7962473490795d1723cb0883'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:46:55.898412 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1432/2867] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:46:55 2022] DELETE /identity/v3/users/1f5ee97c7962473490795d1723cb0883 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:46:56.070860 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe440e-e9b1-4191-8a97-1ee83ee4bca2 service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:46:56.080975 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe440e-e9b1-4191-8a97-1ee83ee4bca2 service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:46:56.136937 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7202df0-422c-4a08-b13c-0e38dc700161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:46:56.137796 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7202df0-422c-4a08-b13c-0e38dc700161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:46:56.138078 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7202df0-422c-4a08-b13c-0e38dc700161 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:46:56.138352 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7202df0-422c-4a08-b13c-0e38dc700161 admin admin] PATH_INFO: `/v3/projects/cf36cbf070504cd2bdde57fc82f161c0` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:46:56.139552 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7202df0-422c-4a08-b13c-0e38dc700161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf36cbf070504cd2bdde57fc82f161c0)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:46:56.141487 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7202df0-422c-4a08-b13c-0e38dc700161 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:46:56.184117 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-d7202df0-422c-4a08-b13c-0e38dc700161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf36cbf070504cd2bdde57fc82f161c0', 'request_id': 'req-d7202df0-422c-4a08-b13c-0e38dc700161'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:46:56.189245 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-d7202df0-422c-4a08-b13c-0e38dc700161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf36cbf070504cd2bdde57fc82f161c0', 'request_id': 'req-d7202df0-422c-4a08-b13c-0e38dc700161'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:46:56.195952 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-d7202df0-422c-4a08-b13c-0e38dc700161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf36cbf070504cd2bdde57fc82f161c0', 'request_id': 'req-d7202df0-422c-4a08-b13c-0e38dc700161'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:46:56.207584 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-d7202df0-422c-4a08-b13c-0e38dc700161 admin admin] The token cache is being invalidate because project cf36cbf070504cd2bdde57fc82f161c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:46:56.208055 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-d7202df0-422c-4a08-b13c-0e38dc700161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:46:56.208675 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-d7202df0-422c-4a08-b13c-0e38dc700161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:46:56.210160 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1436/2868] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:46:56 2022] DELETE /identity/v3/projects/cf36cbf070504cd2bdde57fc82f161c0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:46:56.214289 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261349ef-6a7f-407e-8ff9-e5df038532bb admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:46:56.215956 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-261349ef-6a7f-407e-8ff9-e5df038532bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:46:56.229176 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261349ef-6a7f-407e-8ff9-e5df038532bb admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:46:56.281391 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57dba2-bc6b-4b14-918a-ce2f800f3727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:46:56.282177 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57dba2-bc6b-4b14-918a-ce2f800f3727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:46:56.282455 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57dba2-bc6b-4b14-918a-ce2f800f3727 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:46:56.282726 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57dba2-bc6b-4b14-918a-ce2f800f3727 admin admin] PATH_INFO: `/v3/users/fd36fa2dbb7a4242966f63c044b4f878` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:46:56.295369 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57dba2-bc6b-4b14-918a-ce2f800f3727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd36fa2dbb7a4242966f63c044b4f878)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:46:56.297310 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57dba2-bc6b-4b14-918a-ce2f800f3727 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:46:56.341341 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-8c57dba2-bc6b-4b14-918a-ce2f800f3727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd36fa2dbb7a4242966f63c044b4f878'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:46:56.347745 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-8c57dba2-bc6b-4b14-918a-ce2f800f3727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd36fa2dbb7a4242966f63c044b4f878'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:46:56.354385 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-8c57dba2-bc6b-4b14-918a-ce2f800f3727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd36fa2dbb7a4242966f63c044b4f878'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:46:56.365172 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-8c57dba2-bc6b-4b14-918a-ce2f800f3727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd36fa2dbb7a4242966f63c044b4f878'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:46:56.365790 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-8c57dba2-bc6b-4b14-918a-ce2f800f3727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd36fa2dbb7a4242966f63c044b4f878'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:46:56.371415 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1433/2869] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:46:56 2022] DELETE /identity/v3/users/fd36fa2dbb7a4242966f63c044b4f878 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:46:56.544869 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7202df0-422c-4a08-b13c-0e38dc700161 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:46:56.546423 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-d7202df0-422c-4a08-b13c-0e38dc700161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:46:56.558776 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7202df0-422c-4a08-b13c-0e38dc700161 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:46:56.615018 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccccf9-ae14-47ba-b0e4-b48e10dff75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:46:56.615905 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccccf9-ae14-47ba-b0e4-b48e10dff75b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:46:56.616185 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccccf9-ae14-47ba-b0e4-b48e10dff75b admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:46:56.616454 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccccf9-ae14-47ba-b0e4-b48e10dff75b admin admin] PATH_INFO: `/v3/projects/0983bd6d47a9460aabfffa312087af85` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:46:56.626952 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ccccf9-ae14-47ba-b0e4-b48e10dff75b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0983bd6d47a9460aabfffa312087af85)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:46:56.628883 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ccccf9-ae14-47ba-b0e4-b48e10dff75b admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:46:56.673338 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-71ccccf9-ae14-47ba-b0e4-b48e10dff75b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0983bd6d47a9460aabfffa312087af85', 'request_id': 'req-71ccccf9-ae14-47ba-b0e4-b48e10dff75b'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:46:56.678663 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-71ccccf9-ae14-47ba-b0e4-b48e10dff75b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0983bd6d47a9460aabfffa312087af85', 'request_id': 'req-71ccccf9-ae14-47ba-b0e4-b48e10dff75b'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:46:56.685639 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-71ccccf9-ae14-47ba-b0e4-b48e10dff75b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0983bd6d47a9460aabfffa312087af85', 'request_id': 'req-71ccccf9-ae14-47ba-b0e4-b48e10dff75b'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:46:56.698421 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-71ccccf9-ae14-47ba-b0e4-b48e10dff75b admin admin] The token cache is being invalidate because project 0983bd6d47a9460aabfffa312087af85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:46:56.698708 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-71ccccf9-ae14-47ba-b0e4-b48e10dff75b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:46:56.699341 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-71ccccf9-ae14-47ba-b0e4-b48e10dff75b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:46:56.700896 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1437/2870] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:46:56 2022] DELETE /identity/v3/projects/0983bd6d47a9460aabfffa312087af85 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:46:56.706577 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc532b8-895d-4521-8b46-9136393d843f None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:46:56.706866 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc532b8-895d-4521-8b46-9136393d843f None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:46:56.707144 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc532b8-895d-4521-8b46-9136393d843f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:46:56.762425 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-7dc532b8-895d-4521-8b46-9136393d843f None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:46:56.763637 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-7dc532b8-895d-4521-8b46-9136393d843f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:46:56.818608 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1434/2871] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:46:56.826982 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb6790-120c-4afa-a0cb-528dfaca3220 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:46:56.827272 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb6790-120c-4afa-a0cb-528dfaca3220 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:46:56.827579 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb6790-120c-4afa-a0cb-528dfaca3220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:46:56.844879 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-d5eb6790-120c-4afa-a0cb-528dfaca3220 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:46:56.846066 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-d5eb6790-120c-4afa-a0cb-528dfaca3220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:46:56.853779 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1438/2872] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:46:56.857854 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc532b8-895d-4521-8b46-9136393d843f None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:46:56.867705 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc532b8-895d-4521-8b46-9136393d843f None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:46:56.872205 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d917854-0d55-4c86-a2bc-44567f5f5f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:46:56.872847 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d917854-0d55-4c86-a2bc-44567f5f5f5d admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:46:56.873130 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d917854-0d55-4c86-a2bc-44567f5f5f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:46:56.873407 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d917854-0d55-4c86-a2bc-44567f5f5f5d admin admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:46:56.874123 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d917854-0d55-4c86-a2bc-44567f5f5f5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:46:56.874428 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d917854-0d55-4c86-a2bc-44567f5f5f5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:46:56.876025 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d917854-0d55-4c86-a2bc-44567f5f5f5d admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:46:56.887871 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1435/2873] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:46:56.891760 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb6790-120c-4afa-a0cb-528dfaca3220 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:46:56.900519 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb6790-120c-4afa-a0cb-528dfaca3220 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:46:56.905042 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad46d0-418a-4ea3-9b7c-2edc0d00d9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:46:56.905675 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad46d0-418a-4ea3-9b7c-2edc0d00d9b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:46:56.905955 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad46d0-418a-4ea3-9b7c-2edc0d00d9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:46:56.906230 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad46d0-418a-4ea3-9b7c-2edc0d00d9b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:46:56.906915 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad46d0-418a-4ea3-9b7c-2edc0d00d9b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:46:56.908833 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad46d0-418a-4ea3-9b7c-2edc0d00d9b4 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:46:56.942489 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1439/2874] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:46:56 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:46:56.946964 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d917854-0d55-4c86-a2bc-44567f5f5f5d admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:46:56.956566 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d917854-0d55-4c86-a2bc-44567f5f5f5d admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:46:57.008579 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a75b3-7c57-4b94-a665-6440e16503f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:46:57.009228 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a75b3-7c57-4b94-a665-6440e16503f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:46:57.009516 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a75b3-7c57-4b94-a665-6440e16503f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:46:57.009792 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a75b3-7c57-4b94-a665-6440e16503f0 admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:46:57.010463 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a75b3-7c57-4b94-a665-6440e16503f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:46:57.012406 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a75b3-7c57-4b94-a665-6440e16503f0 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:46:57.031676 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1436/2875] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:46:56 2022] POST /identity/v3/users => generated 286 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:46:57.035887 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad46d0-418a-4ea3-9b7c-2edc0d00d9b4 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:46:57.046398 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad46d0-418a-4ea3-9b7c-2edc0d00d9b4 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:46:57.050867 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16654ce0-e515-4280-90f7-17f290bcb5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:46:57.051509 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16654ce0-e515-4280-90f7-17f290bcb5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:46:57.051825 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16654ce0-e515-4280-90f7-17f290bcb5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:46:57.052105 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16654ce0-e515-4280-90f7-17f290bcb5c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:46:57.052820 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16654ce0-e515-4280-90f7-17f290bcb5c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:46:57.055022 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16654ce0-e515-4280-90f7-17f290bcb5c4 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:46:57.064529 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1440/2876] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:46:57.068699 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a75b3-7c57-4b94-a665-6440e16503f0 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:46:57.078444 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a75b3-7c57-4b94-a665-6440e16503f0 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:46:57.082878 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ede19f-7e58-498a-bd5a-634e02c953ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:46:57.083531 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ede19f-7e58-498a-bd5a-634e02c953ea admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:46:57.083841 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ede19f-7e58-498a-bd5a-634e02c953ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:46:57.084117 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ede19f-7e58-498a-bd5a-634e02c953ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:46:57.084853 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ede19f-7e58-498a-bd5a-634e02c953ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:46:57.086496 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ede19f-7e58-498a-bd5a-634e02c953ea admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:46:57.096411 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1437/2877] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:46:57.100482 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16654ce0-e515-4280-90f7-17f290bcb5c4 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:46:57.110843 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16654ce0-e515-4280-90f7-17f290bcb5c4 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:46:57.115643 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb142b9-1701-4967-81ac-f5b0d533b610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:46:57.116660 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb142b9-1701-4967-81ac-f5b0d533b610 admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:46:57.117548 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb142b9-1701-4967-81ac-f5b0d533b610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:46:57.117824 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb142b9-1701-4967-81ac-f5b0d533b610 admin admin] PATH_INFO: `/v3/projects/fc7cc38a8f664396a323a35606bc7d80/users/0a846837120f43cfb3b5ba065b7ecc6b/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:46:57.132177 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb142b9-1701-4967-81ac-f5b0d533b610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc7cc38a8f664396a323a35606bc7d80, user_id=0a846837120f43cfb3b5ba065b7ecc6b, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:46:57.134850 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb142b9-1701-4967-81ac-f5b0d533b610 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:46:57.146680 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1441/2878] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:46:57 2022] PUT /identity/v3/projects/fc7cc38a8f664396a323a35606bc7d80/users/0a846837120f43cfb3b5ba065b7ecc6b/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:46:57.157746 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572e98c-1e94-49a9-884d-30a372246279 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:46:57.158038 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572e98c-1e94-49a9-884d-30a372246279 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:46:57.158346 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572e98c-1e94-49a9-884d-30a372246279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:46:57.185841 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-2572e98c-1e94-49a9-884d-30a372246279 None None] MFA Rules not processed for user `0a846837120f43cfb3b5ba065b7ecc6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:46:57.187034 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-2572e98c-1e94-49a9-884d-30a372246279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:46:57.249127 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1438/2879] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:46:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:46:57.260239 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb142b9-1701-4967-81ac-f5b0d533b610 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:46:57.261888 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-5bb142b9-1701-4967-81ac-f5b0d533b610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:46:57.336806 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb142b9-1701-4967-81ac-f5b0d533b610 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:46:57.340385 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c6948-c0a6-46f4-ad8c-c1215b1226d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6baa51b91a74ebbab55d644894acd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:46:57.341022 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c6948-c0a6-46f4-ad8c-c1215b1226d6 service cinder] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:46:57.341309 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c6948-c0a6-46f4-ad8c-c1215b1226d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:46:57.341588 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c6948-c0a6-46f4-ad8c-c1215b1226d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:46:57.349721 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c6948-c0a6-46f4-ad8c-c1215b1226d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:46:57.351758 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c6948-c0a6-46f4-ad8c-c1215b1226d6 service cinder] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:46:57.360284 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1442/2880] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:46:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:46:57.379617 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572e98c-1e94-49a9-884d-30a372246279 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:46:57.437079 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572e98c-1e94-49a9-884d-30a372246279 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:46:57.441857 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d740c6-4111-4cd3-a6d6-0684a5b8cee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:46:57.442715 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d740c6-4111-4cd3-a6d6-0684a5b8cee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:46:57.443000 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d740c6-4111-4cd3-a6d6-0684a5b8cee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:46:57.443277 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d740c6-4111-4cd3-a6d6-0684a5b8cee0 admin admin] PATH_INFO: `/v3/users/0a846837120f43cfb3b5ba065b7ecc6b` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:46:57.444480 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d740c6-4111-4cd3-a6d6-0684a5b8cee0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a846837120f43cfb3b5ba065b7ecc6b)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:46:57.446427 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d740c6-4111-4cd3-a6d6-0684a5b8cee0 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:46:57.489556 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-54d740c6-4111-4cd3-a6d6-0684a5b8cee0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a846837120f43cfb3b5ba065b7ecc6b'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:46:57.496057 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-54d740c6-4111-4cd3-a6d6-0684a5b8cee0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a846837120f43cfb3b5ba065b7ecc6b'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:46:57.502907 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-54d740c6-4111-4cd3-a6d6-0684a5b8cee0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a846837120f43cfb3b5ba065b7ecc6b'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:46:57.514121 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-54d740c6-4111-4cd3-a6d6-0684a5b8cee0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a846837120f43cfb3b5ba065b7ecc6b'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:46:57.514761 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-54d740c6-4111-4cd3-a6d6-0684a5b8cee0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a846837120f43cfb3b5ba065b7ecc6b'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:46:57.520667 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1439/2881] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:46:57 2022] DELETE /identity/v3/users/0a846837120f43cfb3b5ba065b7ecc6b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:46:57.525700 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a6e23-d6b9-4d39-b5d3-5689d48ffbed None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:46:57.525991 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a6e23-d6b9-4d39-b5d3-5689d48ffbed None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:46:57.526296 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a6e23-d6b9-4d39-b5d3-5689d48ffbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:46:57.543532 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-356a6e23-d6b9-4d39-b5d3-5689d48ffbed None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:46:57.544753 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-356a6e23-d6b9-4d39-b5d3-5689d48ffbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:46:57.600554 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1443/2882] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:46:57.610591 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d740c6-4111-4cd3-a6d6-0684a5b8cee0 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:46:57.611998 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-54d740c6-4111-4cd3-a6d6-0684a5b8cee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:46:57.665246 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d740c6-4111-4cd3-a6d6-0684a5b8cee0 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:46:57.668789 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8efd6-a08f-466a-b5f6-e6517482af1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:46:57.669408 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8efd6-a08f-466a-b5f6-e6517482af1e service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:46:57.669687 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8efd6-a08f-466a-b5f6-e6517482af1e service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:46:57.669957 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8efd6-a08f-466a-b5f6-e6517482af1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:46:57.678610 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8efd6-a08f-466a-b5f6-e6517482af1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:46:57.680141 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8efd6-a08f-466a-b5f6-e6517482af1e service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:46:57.689461 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1440/2883] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:46:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:46:57.936709 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a6e23-d6b9-4d39-b5d3-5689d48ffbed None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:46:57.938127 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-356a6e23-d6b9-4d39-b5d3-5689d48ffbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:46:57.950873 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a6e23-d6b9-4d39-b5d3-5689d48ffbed None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:46:57.955503 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f71dac-794d-4b06-b513-12ad0d2db691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:46:57.956390 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f71dac-794d-4b06-b513-12ad0d2db691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:46:57.956668 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f71dac-794d-4b06-b513-12ad0d2db691 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:46:57.956942 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f71dac-794d-4b06-b513-12ad0d2db691 admin admin] PATH_INFO: `/v3/projects/fc7cc38a8f664396a323a35606bc7d80` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:46:57.958248 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f71dac-794d-4b06-b513-12ad0d2db691 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc7cc38a8f664396a323a35606bc7d80)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:46:57.960386 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f71dac-794d-4b06-b513-12ad0d2db691 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:46:58.005446 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b6f71dac-794d-4b06-b513-12ad0d2db691 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc7cc38a8f664396a323a35606bc7d80', 'request_id': 'req-b6f71dac-794d-4b06-b513-12ad0d2db691'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:46:58.011109 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b6f71dac-794d-4b06-b513-12ad0d2db691 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc7cc38a8f664396a323a35606bc7d80', 'request_id': 'req-b6f71dac-794d-4b06-b513-12ad0d2db691'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:46:58.016882 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b6f71dac-794d-4b06-b513-12ad0d2db691 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc7cc38a8f664396a323a35606bc7d80', 'request_id': 'req-b6f71dac-794d-4b06-b513-12ad0d2db691'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:46:58.028683 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b6f71dac-794d-4b06-b513-12ad0d2db691 admin admin] The token cache is being invalidate because project fc7cc38a8f664396a323a35606bc7d80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79560) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:46:58.028966 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b6f71dac-794d-4b06-b513-12ad0d2db691 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:46:58.029573 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-b6f71dac-794d-4b06-b513-12ad0d2db691 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:46:58.035417 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1444/2884] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:46:57 2022] DELETE /identity/v3/projects/fc7cc38a8f664396a323a35606bc7d80 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:46:58.040385 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04074b2f-5bf4-4ab8-8311-46eff83bdb00 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:46:58.040837 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04074b2f-5bf4-4ab8-8311-46eff83bdb00 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:46:58.040931 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04074b2f-5bf4-4ab8-8311-46eff83bdb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:46:58.057855 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-04074b2f-5bf4-4ab8-8311-46eff83bdb00 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:46:58.059082 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-04074b2f-5bf4-4ab8-8311-46eff83bdb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:46:58.116292 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1441/2885] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:46:58.124694 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935571c-9bfb-46cf-ae41-c7b9ee647a6e None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:46:58.125148 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935571c-9bfb-46cf-ae41-c7b9ee647a6e None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:46:58.125241 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935571c-9bfb-46cf-ae41-c7b9ee647a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:46:58.143912 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-7935571c-9bfb-46cf-ae41-c7b9ee647a6e None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:46:58.145143 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-7935571c-9bfb-46cf-ae41-c7b9ee647a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:46:58.152907 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1445/2886] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:46:58.156930 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04074b2f-5bf4-4ab8-8311-46eff83bdb00 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:46:58.166473 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04074b2f-5bf4-4ab8-8311-46eff83bdb00 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:46:58.171468 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9db968-01aa-467b-89e0-19cb237bbe8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:46:58.172145 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9db968-01aa-467b-89e0-19cb237bbe8b admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:46:58.172426 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9db968-01aa-467b-89e0-19cb237bbe8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:46:58.172700 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9db968-01aa-467b-89e0-19cb237bbe8b admin admin] PATH_INFO: `/v3/domains` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:46:58.173406 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9db968-01aa-467b-89e0-19cb237bbe8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 10 04:46:58.173707 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9db968-01aa-467b-89e0-19cb237bbe8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:46:58.175277 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9db968-01aa-467b-89e0-19cb237bbe8b admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:46:58.187001 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1442/2887] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Mar 10 04:46:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 10 04:46:58.191527 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7935571c-9bfb-46cf-ae41-c7b9ee647a6e None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:46:58.201305 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7935571c-9bfb-46cf-ae41-c7b9ee647a6e None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:46:58.205931 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22419e7-a487-403c-a667-bcfb92e64bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:46:58.206565 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22419e7-a487-403c-a667-bcfb92e64bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:46:58.206854 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22419e7-a487-403c-a667-bcfb92e64bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:46:58.207129 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22419e7-a487-403c-a667-bcfb92e64bc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:46:58.207853 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22419e7-a487-403c-a667-bcfb92e64bc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:46:58.209726 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22419e7-a487-403c-a667-bcfb92e64bc7 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:46:58.233523 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1446/2888] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:46:58 2022] POST /identity/v3/projects => generated 385 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 10 04:46:58.237613 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9db968-01aa-467b-89e0-19cb237bbe8b admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:46:58.247826 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9db968-01aa-467b-89e0-19cb237bbe8b admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:46:58.300850 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7033ce3-82ee-4e77-8f37-23503b2e5dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:46:58.301504 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7033ce3-82ee-4e77-8f37-23503b2e5dbe admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:46:58.301786 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7033ce3-82ee-4e77-8f37-23503b2e5dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:46:58.302060 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7033ce3-82ee-4e77-8f37-23503b2e5dbe admin admin] PATH_INFO: `/v3/users` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:46:58.302743 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7033ce3-82ee-4e77-8f37-23503b2e5dbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:46:58.305203 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7033ce3-82ee-4e77-8f37-23503b2e5dbe admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:46:58.324787 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1443/2889] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:46:58 2022] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:46:58.328869 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22419e7-a487-403c-a667-bcfb92e64bc7 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:46:58.339027 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22419e7-a487-403c-a667-bcfb92e64bc7 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:46:58.343546 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7334edb-bf38-4765-aa45-ffdd9edba5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:46:58.344221 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7334edb-bf38-4765-aa45-ffdd9edba5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:46:58.344503 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7334edb-bf38-4765-aa45-ffdd9edba5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:46:58.344778 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7334edb-bf38-4765-aa45-ffdd9edba5c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:46:58.345501 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7334edb-bf38-4765-aa45-ffdd9edba5c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:46:58.347079 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7334edb-bf38-4765-aa45-ffdd9edba5c1 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:46:58.357173 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1447/2890] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:46:58.360839 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7033ce3-82ee-4e77-8f37-23503b2e5dbe admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:46:58.371019 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7033ce3-82ee-4e77-8f37-23503b2e5dbe admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:46:58.375524 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1712a-dd1c-4f5d-ab60-a16da40e93ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:46:58.376205 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1712a-dd1c-4f5d-ab60-a16da40e93ba admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:46:58.376490 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1712a-dd1c-4f5d-ab60-a16da40e93ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:46:58.376767 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1712a-dd1c-4f5d-ab60-a16da40e93ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:46:58.377487 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1712a-dd1c-4f5d-ab60-a16da40e93ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:46:58.379063 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1712a-dd1c-4f5d-ab60-a16da40e93ba admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:46:58.389439 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1444/2891] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:46:58.393629 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7334edb-bf38-4765-aa45-ffdd9edba5c1 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:46:58.403884 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7334edb-bf38-4765-aa45-ffdd9edba5c1 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:46:58.408493 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1ee6c-fd10-4810-99a6-8ed38e2d782a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:46:58.409370 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1ee6c-fd10-4810-99a6-8ed38e2d782a admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:46:58.409655 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1ee6c-fd10-4810-99a6-8ed38e2d782a admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:46:58.409929 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1ee6c-fd10-4810-99a6-8ed38e2d782a admin admin] PATH_INFO: `/v3/projects/1788531279f54f90ad7bce82b504685c/users/26cdd297a2d34ab68168c78f06db42a2/roles/73b2aee45a2d4be19addaf4a33414295` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:46:58.424312 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1ee6c-fd10-4810-99a6-8ed38e2d782a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1788531279f54f90ad7bce82b504685c, user_id=26cdd297a2d34ab68168c78f06db42a2, role_id=73b2aee45a2d4be19addaf4a33414295)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:46:58.426953 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1ee6c-fd10-4810-99a6-8ed38e2d782a admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:46:58.440182 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1448/2892] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:46:58 2022] PUT /identity/v3/projects/1788531279f54f90ad7bce82b504685c/users/26cdd297a2d34ab68168c78f06db42a2/roles/73b2aee45a2d4be19addaf4a33414295 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:46:58.445807 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05f4e4-25ef-481a-832c-991f1f1fd3d3 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:46:58.446097 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05f4e4-25ef-481a-832c-991f1f1fd3d3 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:46:58.446374 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05f4e4-25ef-481a-832c-991f1f1fd3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:46:58.463418 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-1a05f4e4-25ef-481a-832c-991f1f1fd3d3 None None] MFA Rules not processed for user `7d6bd1d36bd94be08e18367ce0063fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:46:58.464645 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-1a05f4e4-25ef-481a-832c-991f1f1fd3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:46:58.519675 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1445/2893] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:46:58.529370 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1ee6c-fd10-4810-99a6-8ed38e2d782a admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:46:58.531037 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-3ef1ee6c-fd10-4810-99a6-8ed38e2d782a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:46:58.585580 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1ee6c-fd10-4810-99a6-8ed38e2d782a admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:46:58.589146 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d45093-8ce0-4bf6-814b-7f41714191db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:46:58.589775 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d45093-8ce0-4bf6-814b-7f41714191db service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:46:58.590060 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d45093-8ce0-4bf6-814b-7f41714191db service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:46:58.590335 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d45093-8ce0-4bf6-814b-7f41714191db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:46:58.599494 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d45093-8ce0-4bf6-814b-7f41714191db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:46:58.601707 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d45093-8ce0-4bf6-814b-7f41714191db service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:46:58.611465 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1449/2894] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:46:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:47:01.254088 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05f4e4-25ef-481a-832c-991f1f1fd3d3 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:47:01.267136 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05f4e4-25ef-481a-832c-991f1f1fd3d3 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:47:01.271182 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d75d36-6b11-4238-8930-2b916dc19745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:47:01.272007 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d75d36-6b11-4238-8930-2b916dc19745 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:47:01.272364 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d75d36-6b11-4238-8930-2b916dc19745 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:47:01.272710 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d75d36-6b11-4238-8930-2b916dc19745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:47:01.274863 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-b7d75d36-6b11-4238-8930-2b916dc19745 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:47:01.287721 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d75d36-6b11-4238-8930-2b916dc19745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:47:01.289328 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d75d36-6b11-4238-8930-2b916dc19745 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:47:01.315583 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1446/2895] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:47:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:47:01.980379 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d45093-8ce0-4bf6-814b-7f41714191db service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:47:01.981885 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-50d45093-8ce0-4bf6-814b-7f41714191db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:47:01.996474 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d45093-8ce0-4bf6-814b-7f41714191db service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:47:02.001644 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea05ffd-78ac-4403-abd8-8989ced91839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:47:02.002717 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea05ffd-78ac-4403-abd8-8989ced91839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:47:02.003165 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea05ffd-78ac-4403-abd8-8989ced91839 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:47:02.003623 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea05ffd-78ac-4403-abd8-8989ced91839 admin admin] PATH_INFO: `/v3/users/56f842d811c9452995b8704fcf989093` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:47:02.005580 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea05ffd-78ac-4403-abd8-8989ced91839 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56f842d811c9452995b8704fcf989093)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:47:02.007616 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea05ffd-78ac-4403-abd8-8989ced91839 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:47:02.062545 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-4ea05ffd-78ac-4403-abd8-8989ced91839 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56f842d811c9452995b8704fcf989093'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:47:02.063205 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-4ea05ffd-78ac-4403-abd8-8989ced91839 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56f842d811c9452995b8704fcf989093'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:47:02.072732 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-4ea05ffd-78ac-4403-abd8-8989ced91839 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56f842d811c9452995b8704fcf989093'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:47:02.090322 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-4ea05ffd-78ac-4403-abd8-8989ced91839 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56f842d811c9452995b8704fcf989093'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:47:02.091127 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-4ea05ffd-78ac-4403-abd8-8989ced91839 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56f842d811c9452995b8704fcf989093'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:47:02.106881 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1450/2896] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:47:01 2022] DELETE /identity/v3/users/56f842d811c9452995b8704fcf989093 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:47:02.353431 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d75d36-6b11-4238-8930-2b916dc19745 service neutron] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:47:02.364804 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d75d36-6b11-4238-8930-2b916dc19745 service neutron] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:47:02.456778 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c0c48-d1cb-4313-8396-db6f16d354cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:47:02.457746 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c0c48-d1cb-4313-8396-db6f16d354cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:47:02.458039 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c0c48-d1cb-4313-8396-db6f16d354cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:47:02.458317 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c0c48-d1cb-4313-8396-db6f16d354cf admin admin] PATH_INFO: `/v3/projects/1957e705ba684f68bc0b1a47c235d6a6` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:47:02.459567 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c0c48-d1cb-4313-8396-db6f16d354cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1957e705ba684f68bc0b1a47c235d6a6)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:47:02.461602 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c0c48-d1cb-4313-8396-db6f16d354cf admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:47:02.514677 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-746c0c48-d1cb-4313-8396-db6f16d354cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1957e705ba684f68bc0b1a47c235d6a6', 'request_id': 'req-746c0c48-d1cb-4313-8396-db6f16d354cf'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:47:02.520046 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-746c0c48-d1cb-4313-8396-db6f16d354cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1957e705ba684f68bc0b1a47c235d6a6', 'request_id': 'req-746c0c48-d1cb-4313-8396-db6f16d354cf'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:47:02.526763 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-746c0c48-d1cb-4313-8396-db6f16d354cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1957e705ba684f68bc0b1a47c235d6a6', 'request_id': 'req-746c0c48-d1cb-4313-8396-db6f16d354cf'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:47:02.549148 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-746c0c48-d1cb-4313-8396-db6f16d354cf admin admin] The token cache is being invalidate because project 1957e705ba684f68bc0b1a47c235d6a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:47:02.549415 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-746c0c48-d1cb-4313-8396-db6f16d354cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:47:02.550259 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-746c0c48-d1cb-4313-8396-db6f16d354cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:47:02.551864 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1447/2897] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:47:02 2022] DELETE /identity/v3/projects/1957e705ba684f68bc0b1a47c235d6a6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:47:03.090778 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f55182-625a-4a50-af0a-4ff1b04bd546 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:47:03.091270 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f55182-625a-4a50-af0a-4ff1b04bd546 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:47:03.091344 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f55182-625a-4a50-af0a-4ff1b04bd546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:47:03.119734 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-03f55182-625a-4a50-af0a-4ff1b04bd546 None None] MFA Rules not processed for user `26cdd297a2d34ab68168c78f06db42a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:47:03.120974 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-03f55182-625a-4a50-af0a-4ff1b04bd546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:47:03.183829 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1451/2898] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:47:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:47:03.188400 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c0c48-d1cb-4313-8396-db6f16d354cf admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:47:03.190160 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-746c0c48-d1cb-4313-8396-db6f16d354cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:47:03.253533 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c0c48-d1cb-4313-8396-db6f16d354cf admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:47:03.258576 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6fdc7-2ad5-47c5-a131-046b7f232e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:47:03.259236 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6fdc7-2ad5-47c5-a131-046b7f232e79 admin admin] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:47:03.259520 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6fdc7-2ad5-47c5-a131-046b7f232e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:47:03.259835 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6fdc7-2ad5-47c5-a131-046b7f232e79 admin admin] PATH_INFO: `/v3/projects` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:47:03.260677 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6fdc7-2ad5-47c5-a131-046b7f232e79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:47:03.262585 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd6fdc7-2ad5-47c5-a131-046b7f232e79 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:47:03.294260 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1448/2899] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Mar 10 04:47:03 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:47:03.295529 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f55182-625a-4a50-af0a-4ff1b04bd546 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:47:03.306917 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f55182-625a-4a50-af0a-4ff1b04bd546 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:47:03.361918 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecfb62-c485-4847-9339-fbeda1555bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:47:03.362578 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecfb62-c485-4847-9339-fbeda1555bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:47:03.362859 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecfb62-c485-4847-9339-fbeda1555bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:47:03.363135 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecfb62-c485-4847-9339-fbeda1555bd0 admin admin] PATH_INFO: `/v3/users` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:47:03.363852 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ecfb62-c485-4847-9339-fbeda1555bd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:47:03.365784 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ecfb62-c485-4847-9339-fbeda1555bd0 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:47:03.388821 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1452/2900] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Mar 10 04:47:03 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 10 04:47:03.392830 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6fdc7-2ad5-47c5-a131-046b7f232e79 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:47:03.403203 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6fdc7-2ad5-47c5-a131-046b7f232e79 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:47:03.407896 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00890919-115d-43aa-a903-9e2755f2c807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:47:03.408543 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00890919-115d-43aa-a903-9e2755f2c807 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:47:03.408824 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00890919-115d-43aa-a903-9e2755f2c807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:47:03.409095 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00890919-115d-43aa-a903-9e2755f2c807 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:47:03.409843 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00890919-115d-43aa-a903-9e2755f2c807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:47:03.411406 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00890919-115d-43aa-a903-9e2755f2c807 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:47:03.423017 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1449/2901] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 10 04:47:03.426856 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecfb62-c485-4847-9339-fbeda1555bd0 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:47:03.437770 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecfb62-c485-4847-9339-fbeda1555bd0 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:47:03.442977 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff1a3b-e412-4524-a84a-16d90acfd14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:47:03.443911 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff1a3b-e412-4524-a84a-16d90acfd14d admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:47:03.444192 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff1a3b-e412-4524-a84a-16d90acfd14d admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:47:03.444463 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff1a3b-e412-4524-a84a-16d90acfd14d admin admin] PATH_INFO: `/v3/projects/e600b161d8d44ce2821132e22e2f853d/users/b6706ed9db5245b48490a3ca1ce1f274/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:47:03.460304 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff1a3b-e412-4524-a84a-16d90acfd14d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e600b161d8d44ce2821132e22e2f853d, user_id=b6706ed9db5245b48490a3ca1ce1f274, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:47:03.462822 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff1a3b-e412-4524-a84a-16d90acfd14d admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:47:03.477203 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1453/2902] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:47:03 2022] PUT /identity/v3/projects/e600b161d8d44ce2821132e22e2f853d/users/b6706ed9db5245b48490a3ca1ce1f274/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:47:03.481181 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00890919-115d-43aa-a903-9e2755f2c807 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:47:03.491270 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00890919-115d-43aa-a903-9e2755f2c807 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:47:03.545441 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7536e5-ed14-4a7b-9878-c17201873153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:47:03.546107 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7536e5-ed14-4a7b-9878-c17201873153 admin admin] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:47:03.546388 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7536e5-ed14-4a7b-9878-c17201873153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:47:03.546691 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7536e5-ed14-4a7b-9878-c17201873153 admin admin] PATH_INFO: `/v3/roles` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:47:03.547449 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7536e5-ed14-4a7b-9878-c17201873153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:47:03.549063 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7536e5-ed14-4a7b-9878-c17201873153 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:47:03.558903 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1450/2903] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Mar 10 04:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 10 04:47:03.563144 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff1a3b-e412-4524-a84a-16d90acfd14d admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:47:03.574257 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff1a3b-e412-4524-a84a-16d90acfd14d admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:47:03.579073 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad878cc6-31cf-4f83-b3d6-2b1abcdbaf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:47:03.579989 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad878cc6-31cf-4f83-b3d6-2b1abcdbaf2b admin admin] REQUEST_METHOD: `PUT` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:47:03.580270 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad878cc6-31cf-4f83-b3d6-2b1abcdbaf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:47:03.580570 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad878cc6-31cf-4f83-b3d6-2b1abcdbaf2b admin admin] PATH_INFO: `/v3/projects/e600b161d8d44ce2821132e22e2f853d/users/b6706ed9db5245b48490a3ca1ce1f274/roles/a8b2a5887cec4a31b7304792af3dd3f1` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:47:03.582609 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad878cc6-31cf-4f83-b3d6-2b1abcdbaf2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e600b161d8d44ce2821132e22e2f853d, user_id=b6706ed9db5245b48490a3ca1ce1f274, role_id=a8b2a5887cec4a31b7304792af3dd3f1)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:47:03.585333 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad878cc6-31cf-4f83-b3d6-2b1abcdbaf2b admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:47:03.595722 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1454/2904] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Mar 10 04:47:03 2022] PUT /identity/v3/projects/e600b161d8d44ce2821132e22e2f853d/users/b6706ed9db5245b48490a3ca1ce1f274/roles/a8b2a5887cec4a31b7304792af3dd3f1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 10 04:47:08.089357 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5e8d2-7b88-4b98-a240-1c0ad7e8a07e None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:47:08.089909 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5e8d2-7b88-4b98-a240-1c0ad7e8a07e None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:47:08.089909 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5e8d2-7b88-4b98-a240-1c0ad7e8a07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:47:08.119521 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-69a5e8d2-7b88-4b98-a240-1c0ad7e8a07e None None] MFA Rules not processed for user `b6706ed9db5245b48490a3ca1ce1f274`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:47:08.120851 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-69a5e8d2-7b88-4b98-a240-1c0ad7e8a07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:47:08.194632 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1451/2905] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:47:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:47:08.206419 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad878cc6-31cf-4f83-b3d6-2b1abcdbaf2b admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:47:08.208340 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-ad878cc6-31cf-4f83-b3d6-2b1abcdbaf2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:47:08.289197 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad878cc6-31cf-4f83-b3d6-2b1abcdbaf2b admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:47:08.292945 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecfcaf-4ef4-4664-9ba1-235c559b5f6f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7c195f91114855acc58163631544d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:47:08.293603 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecfcaf-4ef4-4664-9ba1-235c559b5f6f service glance] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:47:08.293885 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecfcaf-4ef4-4664-9ba1-235c559b5f6f service glance] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:47:08.294166 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecfcaf-4ef4-4664-9ba1-235c559b5f6f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:47:08.352259 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ecfcaf-4ef4-4664-9ba1-235c559b5f6f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:47:08.353717 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ecfcaf-4ef4-4664-9ba1-235c559b5f6f service glance] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:47:08.363230 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1455/2906] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:47:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:47:08.461967 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce12af2-3014-459d-b308-256e26c881d6 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:47:08.462257 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce12af2-3014-459d-b308-256e26c881d6 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:47:08.462538 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce12af2-3014-459d-b308-256e26c881d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:47:08.521465 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-0ce12af2-3014-459d-b308-256e26c881d6 None None] MFA Rules not processed for user `7eb560db53cd4af192bb82abdfad3590`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:47:08.522680 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-0ce12af2-3014-459d-b308-256e26c881d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:47:08.592906 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1452/2907] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Mar 10 04:47:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:47:08.640409 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecfcaf-4ef4-4664-9ba1-235c559b5f6f service glance] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:47:08.641811 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-f9ecfcaf-4ef4-4664-9ba1-235c559b5f6f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:47:08.726807 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecfcaf-4ef4-4664-9ba1-235c559b5f6f service glance] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:47:08.731779 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5869c-e9e5-4fc4-837c-a75c353fba80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260f561c676b4d049553eac4626b5502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:47:08.732412 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5869c-e9e5-4fc4-837c-a75c353fba80 service swift] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:47:08.732697 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5869c-e9e5-4fc4-837c-a75c353fba80 service swift] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:47:08.732973 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5869c-e9e5-4fc4-837c-a75c353fba80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:47:08.740694 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5869c-e9e5-4fc4-837c-a75c353fba80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:47:08.742778 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5869c-e9e5-4fc4-837c-a75c353fba80 service swift] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:47:08.750531 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1456/2908] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Mar 10 04:47:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 10 04:47:17.368261 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bf754-915d-4422-86ab-79ac48d121f4 None None] REQUEST_METHOD: `POST` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:47:17.368788 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bf754-915d-4422-86ab-79ac48d121f4 None None] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:47:17.368872 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bf754-915d-4422-86ab-79ac48d121f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:47:17.386342 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.auth.core [None req-067bf754-915d-4422-86ab-79ac48d121f4 None None] MFA Rules not processed for user `26cdd297a2d34ab68168c78f06db42a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:47:17.387531 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-067bf754-915d-4422-86ab-79ac48d121f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:47:17.394331 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1453/2909] 10.222.0.15 () {58 vars in 957 bytes} [Thu Mar 10 04:47:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:47:17.434205 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5869c-e9e5-4fc4-837c-a75c353fba80 service swift] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:47:17.443722 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5869c-e9e5-4fc4-837c-a75c353fba80 service swift] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:47:17.447868 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba341a31-7141-4751-a58b-4ee7aef07e73 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7c195f91114855acc58163631544d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:47:17.448498 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba341a31-7141-4751-a58b-4ee7aef07e73 service glance] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:47:17.448784 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba341a31-7141-4751-a58b-4ee7aef07e73 service glance] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:47:17.449094 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba341a31-7141-4751-a58b-4ee7aef07e73 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:47:17.450844 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-ba341a31-7141-4751-a58b-4ee7aef07e73 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:47:17.530109 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba341a31-7141-4751-a58b-4ee7aef07e73 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:47:17.531542 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba341a31-7141-4751-a58b-4ee7aef07e73 service glance] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:47:17.551022 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1457/2910] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:47:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:47:17.772727 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067bf754-915d-4422-86ab-79ac48d121f4 None None] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:47:17.774229 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-067bf754-915d-4422-86ab-79ac48d121f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:47:17.828443 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067bf754-915d-4422-86ab-79ac48d121f4 None None] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:47:17.832043 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff7a67-9751-4f1e-9fe8-803b9d147f93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:47:17.832678 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff7a67-9751-4f1e-9fe8-803b9d147f93 service neutron] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:47:17.832963 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff7a67-9751-4f1e-9fe8-803b9d147f93 service neutron] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:47:17.833236 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff7a67-9751-4f1e-9fe8-803b9d147f93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:47:17.834980 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-beff7a67-9751-4f1e-9fe8-803b9d147f93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:47:17.844202 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff7a67-9751-4f1e-9fe8-803b9d147f93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:47:17.845620 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff7a67-9751-4f1e-9fe8-803b9d147f93 service neutron] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:47:17.857406 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1454/2911] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:47:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:47:18.174140 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba341a31-7141-4751-a58b-4ee7aef07e73 service glance] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:47:18.177578 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff7a67-9751-4f1e-9fe8-803b9d147f93 service neutron] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:47:18.179621 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-beff7a67-9751-4f1e-9fe8-803b9d147f93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:47:18.184034 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba341a31-7141-4751-a58b-4ee7aef07e73 service glance] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:47:18.188033 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473274c-460c-4910-97a9-09823afd0ea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:47:18.188686 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473274c-460c-4910-97a9-09823afd0ea7 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:47:18.188971 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473274c-460c-4910-97a9-09823afd0ea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:47:18.189271 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473274c-460c-4910-97a9-09823afd0ea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:47:18.192033 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-e473274c-460c-4910-97a9-09823afd0ea7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:47:18.205667 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473274c-460c-4910-97a9-09823afd0ea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:47:18.207026 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473274c-460c-4910-97a9-09823afd0ea7 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:47:18.218292 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1458/2912] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:47:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:47:18.247003 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff7a67-9751-4f1e-9fe8-803b9d147f93 service neutron] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:47:18.252339 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15947b63-d587-4e3b-a62f-60554524c7f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319da006b10c41f8aa8a9d5aa2225b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:47:18.252980 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15947b63-d587-4e3b-a62f-60554524c7f8 service placement] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:47:18.253258 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15947b63-d587-4e3b-a62f-60554524c7f8 service placement] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:47:18.253528 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15947b63-d587-4e3b-a62f-60554524c7f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:47:18.255264 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-15947b63-d587-4e3b-a62f-60554524c7f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:47:18.266874 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15947b63-d587-4e3b-a62f-60554524c7f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:47:18.268477 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15947b63-d587-4e3b-a62f-60554524c7f8 service placement] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:47:18.279770 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1455/2913] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:47:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:47:19.398495 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd43c70-0c79-4321-a02a-e1641f5cf502 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:47:19.398987 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd43c70-0c79-4321-a02a-e1641f5cf502 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:47:19.399068 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd43c70-0c79-4321-a02a-e1641f5cf502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:47:19.419472 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-ebd43c70-0c79-4321-a02a-e1641f5cf502 None None] MFA Rules not processed for user `7eb560db53cd4af192bb82abdfad3590`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:47:19.421826 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-ebd43c70-0c79-4321-a02a-e1641f5cf502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:47:19.428913 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1459/2914] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Mar 10 04:47:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 10 04:47:19.441139 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15947b63-d587-4e3b-a62f-60554524c7f8 service placement] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:47:19.453058 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15947b63-d587-4e3b-a62f-60554524c7f8 service placement] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:47:19.458105 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0f9c2-86d8-4091-a9f1-450154a1c323 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260f561c676b4d049553eac4626b5502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:47:19.458817 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0f9c2-86d8-4091-a9f1-450154a1c323 service swift] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:47:19.459106 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0f9c2-86d8-4091-a9f1-450154a1c323 service swift] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:47:19.459383 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0f9c2-86d8-4091-a9f1-450154a1c323 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:47:19.467643 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0f9c2-86d8-4091-a9f1-450154a1c323 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:47:19.469317 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0f9c2-86d8-4091-a9f1-450154a1c323 service swift] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:47:19.478092 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1456/2915] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Mar 10 04:47:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 10 04:47:27.512772 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd43c70-0c79-4321-a02a-e1641f5cf502 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:47:27.514216 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-ebd43c70-0c79-4321-a02a-e1641f5cf502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:47:27.525600 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd43c70-0c79-4321-a02a-e1641f5cf502 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:47:27.529156 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7baf5bd-2394-4fab-9be2-c261a162f83a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:47:27.529792 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7baf5bd-2394-4fab-9be2-c261a162f83a service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:47:27.530074 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7baf5bd-2394-4fab-9be2-c261a162f83a service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:47:27.530345 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7baf5bd-2394-4fab-9be2-c261a162f83a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:47:27.532107 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-d7baf5bd-2394-4fab-9be2-c261a162f83a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:47:27.541851 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7baf5bd-2394-4fab-9be2-c261a162f83a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:47:27.543263 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7baf5bd-2394-4fab-9be2-c261a162f83a service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:47:27.551811 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1460/2916] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:47:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 10 04:47:28.390134 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0f9c2-86d8-4091-a9f1-450154a1c323 service swift] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:47:28.391994 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-bdb0f9c2-86d8-4091-a9f1-450154a1c323 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:47:28.426265 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0f9c2-86d8-4091-a9f1-450154a1c323 service swift] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:47:28.433449 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3d38a-6d02-45d0-8179-122c708c4047 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:47:28.434420 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3d38a-6d02-45d0-8179-122c708c4047 service nova] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:47:28.434710 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3d38a-6d02-45d0-8179-122c708c4047 service nova] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:47:28.434990 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3d38a-6d02-45d0-8179-122c708c4047 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:47:28.436832 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-dfd3d38a-6d02-45d0-8179-122c708c4047 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:47:28.450136 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3d38a-6d02-45d0-8179-122c708c4047 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:47:28.451806 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3d38a-6d02-45d0-8179-122c708c4047 service nova] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:47:28.465293 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1457/2917] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:47:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:47:34.227050 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7baf5bd-2394-4fab-9be2-c261a162f83a service neutron] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:47:34.240007 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7baf5bd-2394-4fab-9be2-c261a162f83a service neutron] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:47:34.245985 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d36264-ccfe-4c7e-b464-793fd5fb9857 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:47:34.246620 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d36264-ccfe-4c7e-b464-793fd5fb9857 service nova] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:47:34.246907 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d36264-ccfe-4c7e-b464-793fd5fb9857 service nova] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:47:34.247182 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d36264-ccfe-4c7e-b464-793fd5fb9857 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:47:34.248928 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-17d36264-ccfe-4c7e-b464-793fd5fb9857 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:47:34.261562 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d36264-ccfe-4c7e-b464-793fd5fb9857 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:47:34.263068 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d36264-ccfe-4c7e-b464-793fd5fb9857 service nova] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:47:34.273451 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1461/2918] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:47:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:47:41.632810 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3d38a-6d02-45d0-8179-122c708c4047 service nova] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:47:41.643602 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3d38a-6d02-45d0-8179-122c708c4047 service nova] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:47:41.649303 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620ff0f-abb0-4bb0-8e36-57fa0f63fad9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319da006b10c41f8aa8a9d5aa2225b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:47:41.649930 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620ff0f-abb0-4bb0-8e36-57fa0f63fad9 service placement] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:47:41.650248 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620ff0f-abb0-4bb0-8e36-57fa0f63fad9 service placement] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:47:41.650522 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620ff0f-abb0-4bb0-8e36-57fa0f63fad9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:47:41.652702 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-c620ff0f-abb0-4bb0-8e36-57fa0f63fad9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:47:41.675880 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620ff0f-abb0-4bb0-8e36-57fa0f63fad9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:47:41.677442 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620ff0f-abb0-4bb0-8e36-57fa0f63fad9 service placement] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:47:41.686943 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1458/2919] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:47:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:48:00.350670 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d36264-ccfe-4c7e-b464-793fd5fb9857 service nova] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:48:00.359985 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d36264-ccfe-4c7e-b464-793fd5fb9857 service nova] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:48:00.363478 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0afa6-0388-4195-92d5-ff9e291d29f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2faf262ae9d643c0b8708dcfecd75b3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:48:00.364141 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0afa6-0388-4195-92d5-ff9e291d29f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:48:00.364422 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0afa6-0388-4195-92d5-ff9e291d29f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:48:00.364696 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0afa6-0388-4195-92d5-ff9e291d29f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:48:00.373394 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f0afa6-0388-4195-92d5-ff9e291d29f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:48:00.374807 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f0afa6-0388-4195-92d5-ff9e291d29f0 service neutron] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:48:00.384288 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1462/2920] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:48:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:48:03.580358 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620ff0f-abb0-4bb0-8e36-57fa0f63fad9 service placement] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:48:03.603790 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620ff0f-abb0-4bb0-8e36-57fa0f63fad9 service placement] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:48:03.610875 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea09f0a-1e79-446e-99e5-c035f4f34825 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd92bd14ed04621af06d68161798fe3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:48:03.611756 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea09f0a-1e79-446e-99e5-c035f4f34825 service nova] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:48:03.612196 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea09f0a-1e79-446e-99e5-c035f4f34825 service nova] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:48:03.612616 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea09f0a-1e79-446e-99e5-c035f4f34825 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:48:03.614645 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-6ea09f0a-1e79-446e-99e5-c035f4f34825 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:48:03.633425 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea09f0a-1e79-446e-99e5-c035f4f34825 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:48:03.635069 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea09f0a-1e79-446e-99e5-c035f4f34825 service nova] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:48:03.661412 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1459/2921] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:48:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 10 04:49:04.030705 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499977a-dda1-411b-96d0-65098d25f523 None None] REQUEST_METHOD: `POST` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:49:04.031210 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499977a-dda1-411b-96d0-65098d25f523 None None] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:49:04.031311 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499977a-dda1-411b-96d0-65098d25f523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:49:04.049542 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.auth.core [None req-d499977a-dda1-411b-96d0-65098d25f523 None None] MFA Rules not processed for user `7eb560db53cd4af192bb82abdfad3590`. Rule list: `[]` (Enabled: `True`). {{(pid=79560) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 10 04:49:04.050736 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-d499977a-dda1-411b-96d0-65098d25f523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:49:04.057814 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1463/2922] 10.222.0.15 () {58 vars in 967 bytes} [Thu Mar 10 04:49:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 10 04:49:04.098214 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea09f0a-1e79-446e-99e5-c035f4f34825 service nova] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:49:04.111196 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea09f0a-1e79-446e-99e5-c035f4f34825 service nova] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:49:04.116209 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1edc47-3db8-4f16-9843-22cbb047cdca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '260f561c676b4d049553eac4626b5502', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:49:04.116827 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1edc47-3db8-4f16-9843-22cbb047cdca service swift] REQUEST_METHOD: `GET` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:49:04.117108 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1edc47-3db8-4f16-9843-22cbb047cdca service swift] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:49:04.117384 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1edc47-3db8-4f16-9843-22cbb047cdca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:49:04.125732 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1edc47-3db8-4f16-9843-22cbb047cdca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:49:04.127298 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1edc47-3db8-4f16-9843-22cbb047cdca service swift] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:49:04.135591 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1460/2923] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Mar 10 04:49:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 10 04:49:10.726386 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499977a-dda1-411b-96d0-65098d25f523 None None] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:49:10.798861 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499977a-dda1-411b-96d0-65098d25f523 None None] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:49:10.804049 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444dc9e-e046-458e-babd-0b79440f87b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:49:10.804929 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444dc9e-e046-458e-babd-0b79440f87b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:49:10.805214 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444dc9e-e046-458e-babd-0b79440f87b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:49:10.805492 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444dc9e-e046-458e-babd-0b79440f87b6 admin admin] PATH_INFO: `/v3/users/26cdd297a2d34ab68168c78f06db42a2` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:49:10.806692 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444dc9e-e046-458e-babd-0b79440f87b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26cdd297a2d34ab68168c78f06db42a2)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:49:10.808674 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444dc9e-e046-458e-babd-0b79440f87b6 admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:49:10.864352 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-0444dc9e-e046-458e-babd-0b79440f87b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26cdd297a2d34ab68168c78f06db42a2'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:49:10.868656 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-0444dc9e-e046-458e-babd-0b79440f87b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26cdd297a2d34ab68168c78f06db42a2'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:49:10.873702 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-0444dc9e-e046-458e-babd-0b79440f87b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26cdd297a2d34ab68168c78f06db42a2'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:49:10.885939 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-0444dc9e-e046-458e-babd-0b79440f87b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26cdd297a2d34ab68168c78f06db42a2'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:49:10.886656 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-0444dc9e-e046-458e-babd-0b79440f87b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26cdd297a2d34ab68168c78f06db42a2'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:49:10.899434 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1464/2924] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:49:10 2022] DELETE /identity/v3/users/26cdd297a2d34ab68168c78f06db42a2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:49:11.067774 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1edc47-3db8-4f16-9843-22cbb047cdca service swift] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:49:11.077959 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1edc47-3db8-4f16-9843-22cbb047cdca service swift] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:49:11.135140 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a521e88-7f07-43f6-ad07-378d7c4526a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:49:11.135985 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a521e88-7f07-43f6-ad07-378d7c4526a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:49:11.136264 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a521e88-7f07-43f6-ad07-378d7c4526a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:49:11.136540 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a521e88-7f07-43f6-ad07-378d7c4526a3 admin admin] PATH_INFO: `/v3/projects/1788531279f54f90ad7bce82b504685c` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:49:11.137696 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a521e88-7f07-43f6-ad07-378d7c4526a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1788531279f54f90ad7bce82b504685c)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:49:11.139569 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a521e88-7f07-43f6-ad07-378d7c4526a3 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:49:11.184149 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5a521e88-7f07-43f6-ad07-378d7c4526a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1788531279f54f90ad7bce82b504685c', 'request_id': 'req-5a521e88-7f07-43f6-ad07-378d7c4526a3'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:49:11.189560 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5a521e88-7f07-43f6-ad07-378d7c4526a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1788531279f54f90ad7bce82b504685c', 'request_id': 'req-5a521e88-7f07-43f6-ad07-378d7c4526a3'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:49:11.195446 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5a521e88-7f07-43f6-ad07-378d7c4526a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1788531279f54f90ad7bce82b504685c', 'request_id': 'req-5a521e88-7f07-43f6-ad07-378d7c4526a3'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:49:11.210952 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5a521e88-7f07-43f6-ad07-378d7c4526a3 admin admin] The token cache is being invalidate because project 1788531279f54f90ad7bce82b504685c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:49:11.211237 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5a521e88-7f07-43f6-ad07-378d7c4526a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:49:11.211886 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-5a521e88-7f07-43f6-ad07-378d7c4526a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:49:11.213385 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1461/2925] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:49:11 2022] DELETE /identity/v3/projects/1788531279f54f90ad7bce82b504685c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:49:11.217464 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444dc9e-e046-458e-babd-0b79440f87b6 admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:49:11.218854 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-0444dc9e-e046-458e-babd-0b79440f87b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:49:11.232124 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444dc9e-e046-458e-babd-0b79440f87b6 admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:49:11.285655 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46dcb5-eb19-4e19-bfd5-143b2c554f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:49:11.286452 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46dcb5-eb19-4e19-bfd5-143b2c554f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:49:11.287338 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46dcb5-eb19-4e19-bfd5-143b2c554f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:49:11.287622 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46dcb5-eb19-4e19-bfd5-143b2c554f8b admin admin] PATH_INFO: `/v3/users/b6706ed9db5245b48490a3ca1ce1f274` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:49:11.288838 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46dcb5-eb19-4e19-bfd5-143b2c554f8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6706ed9db5245b48490a3ca1ce1f274)` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:49:11.291030 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46dcb5-eb19-4e19-bfd5-143b2c554f8b admin admin] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:49:11.336588 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-1b46dcb5-eb19-4e19-bfd5-143b2c554f8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6706ed9db5245b48490a3ca1ce1f274'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:49:11.337274 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-1b46dcb5-eb19-4e19-bfd5-143b2c554f8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6706ed9db5245b48490a3ca1ce1f274'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:49:11.343879 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-1b46dcb5-eb19-4e19-bfd5-143b2c554f8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6706ed9db5245b48490a3ca1ce1f274'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:49:11.355728 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-1b46dcb5-eb19-4e19-bfd5-143b2c554f8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6706ed9db5245b48490a3ca1ce1f274'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:49:11.356450 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.notifications [None req-1b46dcb5-eb19-4e19-bfd5-143b2c554f8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6706ed9db5245b48490a3ca1ce1f274'} {{(pid=79560) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:49:11.368601 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1465/2926] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Mar 10 04:49:11 2022] DELETE /identity/v3/users/b6706ed9db5245b48490a3ca1ce1f274 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:49:11.537907 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a521e88-7f07-43f6-ad07-378d7c4526a3 admin admin] Authenticating user token {{(pid=79561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:49:11.539397 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.fernet_utils [None req-5a521e88-7f07-43f6-ad07-378d7c4526a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:49:11.551733 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a521e88-7f07-43f6-ad07-378d7c4526a3 admin admin] Validating token access rules against request {{(pid=79561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:49:11.605716 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9729bad-a5fe-463f-8ec1-b17f8d2b0476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d6bd1d36bd94be08e18367ce0063fc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15f699ac2a074d6bb8d9dc62578c5328', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:49:11.606555 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9729bad-a5fe-463f-8ec1-b17f8d2b0476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:49:11.606833 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9729bad-a5fe-463f-8ec1-b17f8d2b0476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:49:11.607103 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9729bad-a5fe-463f-8ec1-b17f8d2b0476 admin admin] PATH_INFO: `/v3/projects/e600b161d8d44ce2821132e22e2f853d` {{(pid=79561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:49:11.608283 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9729bad-a5fe-463f-8ec1-b17f8d2b0476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e600b161d8d44ce2821132e22e2f853d)` {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:49:11.610159 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9729bad-a5fe-463f-8ec1-b17f8d2b0476 admin admin] RBAC: Authorization granted {{(pid=79561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:49:11.653359 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b9729bad-a5fe-463f-8ec1-b17f8d2b0476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e600b161d8d44ce2821132e22e2f853d', 'request_id': 'req-b9729bad-a5fe-463f-8ec1-b17f8d2b0476'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:49:11.658486 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b9729bad-a5fe-463f-8ec1-b17f8d2b0476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e600b161d8d44ce2821132e22e2f853d', 'request_id': 'req-b9729bad-a5fe-463f-8ec1-b17f8d2b0476'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:49:11.664385 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b9729bad-a5fe-463f-8ec1-b17f8d2b0476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e600b161d8d44ce2821132e22e2f853d', 'request_id': 'req-b9729bad-a5fe-463f-8ec1-b17f8d2b0476'} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:49:11.675778 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b9729bad-a5fe-463f-8ec1-b17f8d2b0476 admin admin] The token cache is being invalidate because project e600b161d8d44ce2821132e22e2f853d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 10 04:49:11.676072 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b9729bad-a5fe-463f-8ec1-b17f8d2b0476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:49:11.676686 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: DEBUG keystone.notifications [None req-b9729bad-a5fe-463f-8ec1-b17f8d2b0476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 10 04:49:11.678216 dv-cinder-778193-25-iscsi devstack@keystone.service[79561]: [pid: 79561|app: 0|req: 1462/2927] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Mar 10 04:49:11 2022] DELETE /identity/v3/projects/e600b161d8d44ce2821132e22e2f853d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 10 04:52:48.562602 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46dcb5-eb19-4e19-bfd5-143b2c554f8b admin admin] Authenticating user token {{(pid=79560) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 10 04:52:48.564017 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-1b46dcb5-eb19-4e19-bfd5-143b2c554f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:52:48.654268 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46dcb5-eb19-4e19-bfd5-143b2c554f8b admin admin] Validating token access rules against request {{(pid=79560) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 10 04:52:48.709944 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38ce40-34a3-4f82-8a8e-40f62c356633 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '319da006b10c41f8aa8a9d5aa2225b60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0846fccaeb674395a87e45290eda74b7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79560) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 10 04:52:48.710589 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38ce40-34a3-4f82-8a8e-40f62c356633 service placement] REQUEST_METHOD: `GET` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 10 04:52:48.710875 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38ce40-34a3-4f82-8a8e-40f62c356633 service placement] SCRIPT_NAME: `/identity` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 10 04:52:48.711156 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38ce40-34a3-4f82-8a8e-40f62c356633 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79560) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 10 04:52:48.712915 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.fernet_utils [None req-da38ce40-34a3-4f82-8a8e-40f62c356633 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79560) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 10 04:52:48.724242 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38ce40-34a3-4f82-8a8e-40f62c356633 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 10 04:52:48.725803 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38ce40-34a3-4f82-8a8e-40f62c356633 service placement] RBAC: Authorization granted {{(pid=79560) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 10 04:52:48.735997 dv-cinder-778193-25-iscsi devstack@keystone.service[79560]: [pid: 79560|app: 0|req: 1466/2928] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Mar 10 04:52:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)